2021-11-21T03:36:26.724 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-21T03:36:26.725 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} --archive /home/teuthworker/archive/teuthology-2021-11-18_06:00:03-rbd-octopus-distro-default-gibba/6511531 --owner scheduled_teuthology@teuthology --name teuthology-2021-11-18_06:00:03-rbd-octopus-distro-default-gibba -- /home/teuthworker/archive/teuthology-2021-11-18_06:00:03-rbd-octopus-distro-default-gibba/6511531/orig.config.yaml 2021-11-21T03:36:26.778 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-11-21T03:36:26.849 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2021-11-18_06:00:03-rbd-octopus-distro-default-gibba/6511531 branch: octopus description: rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} email: ceph-qa@ceph.io first_in_suite: false job_id: '6511531' kernel: kdb: true sha1: distro last_in_suite: false machine_type: gibba meta: - desc: run two ceph clusters and install rbd-mirror - desc: configure the permissions for client.mirror - desc: 2 ceph clusters with 1 mon and 3 osds each - desc: run four rbd-mirror daemons per cluster - desc: run the rbd_mirror_stress.sh workunit to test the rbd-mirror daemon name: teuthology-2021-11-18_06:00:03-rbd-octopus-distro-default-gibba nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: rhel os_version: '8.3' overrides: admin_socket: branch: octopus ceph: conf: client: debug rbd: 20 debug rbd_mirror: 15 log to stderr: false rbd default features: 125 rbd mirror image policy type: simple client.mirror.0: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid client.mirror.1: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid client.mirror.2: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid client.mirror.3: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid global: mon client directed command retry: 5 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff owner: scheduled_teuthology@teuthology priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - cluster1.mon.a - cluster1.mgr.x - cluster2.mgr.x - cluster1.osd.0 - cluster1.osd.1 - cluster1.osd.2 - cluster1.client.0 - cluster2.client.0 - - cluster2.mon.a - cluster2.osd.0 - cluster2.osd.1 - cluster2.osd.2 - cluster1.client.mirror - cluster1.client.mirror.0 - cluster1.client.mirror.1 - cluster1.client.mirror.2 - cluster1.client.mirror.3 - cluster1.client.mirror.4 - cluster1.client.mirror.5 - cluster1.client.mirror.6 - cluster2.client.mirror - cluster2.client.mirror.0 - cluster2.client.mirror.1 - cluster2.client.mirror.2 - cluster2.client.mirror.3 - cluster2.client.mirror.4 - cluster2.client.mirror.5 - cluster2.client.mirror.6 sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff sleep_before_teardown: 0 suite: rbd suite_branch: octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff targets: gibba022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLxAEXjLpD4E/WZb3tl42Si4cfiZB0BFCFCmCGVeIAF9GDbeP8FPjEtUrzn4M+di0rRmJS82YtXSKHs52CYQFwNV5w+uWHMABbKMbUxNtXGYyBD9jdHijuz+z3An32XaLcWJZCbDaeaZLRjYBQkC/MqoL3vkwSNXxgOMNwYqai3gY6N5YlU+wof4cCRgDkOs+klbWKiJEedG8uTnOm9BbMDANtdtGfjVNvJt9fip+D5G7twr+wJhChpv9nshnIbRPh1eRGbgxIbQlVxrQQ2CedzX9PL8NFK59QHFHyhYqdOD859asCIGNgDWcIEXaC9euxMaEtQ2cl1Keh98k6Q1KlR4a7V6uCLiOid43XBex6GPl1BOuQ80Id3cDY3pr++lj4+FLZx03zU2kPmLWv7oAABAh1Q34iTMBd1eh2YxO5v/P/2t6uLivVzECiJ4MAMEK4d7hnbhLqpYRSd1LOCWKj4w2weOVFSU05XvB8kAW4W0BK8A+KHOt2y0iBEAuY70M= gibba043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZDWVZORVVcSG+wo1CCePocvjDxjTuvXsEfdDaPZ5saRH05achLVWhJHlKGIFhcg00SY9mg76RVwGOVNTbXBnaJe1WwsYFodmHpHksR+Ol0bVQyAcKP7XwmO17mwJnJ7PSp4yK16Wbh8T63Rtr+1ebkUbp++VYTKj5jmb6WNF9ieIthDFA8aSdL/w/VLZK96rKMnuHI/Pah3dIDHv1cbctxTzNvYOpbpAXpq8Fa+TozEuKlcUAIjnuuXZyvwiEL8LlSdU8uKJFzrDrN7uuMgyoGHqXiPIabRP8JPy+w9Az+M7gq2AAmAUlLoTV7ewVRTO5bH+6HrqNpsdnm5Ng3egM1TqDVf4YskxwncriLWu3ACqrGZQIcXbBV2ZmCIU1Wqtl47dTvYKGKt5AuLy7Hf18BH2qb2YDFyfIYmWJu/xUAoYlvMh4xM0LRDT7BNzHy8VM3rixQypwpxXzxT8IQWJ5BB2ZuMpBT+2aoMksfo2mNB24KUyJh47AY77wdCv1Y9M= tasks: - install: extra_packages: - rbd-mirror - ceph: cluster: cluster1 - ceph: cluster: cluster2 - exec: cluster1.client.mirror.0: - sudo ceph --cluster cluster1 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd' - rbd-mirror: client: cluster1.client.mirror.0 thrash: true - rbd-mirror: client: cluster1.client.mirror.1 thrash: true - rbd-mirror: client: cluster1.client.mirror.2 thrash: true - rbd-mirror: client: cluster1.client.mirror.3 thrash: true - rbd-mirror: client: cluster2.client.mirror.0 thrash: true - rbd-mirror: client: cluster2.client.mirror.1 thrash: true - rbd-mirror: client: cluster2.client.mirror.2 thrash: true - rbd-mirror: client: cluster2.client.mirror.3 thrash: true - rbd-mirror-thrash: cluster: cluster1 - rbd-mirror-thrash: cluster: cluster2 - workunit: clients: cluster1.client.mirror: - rbd/rbd_mirror_stress.sh env: CEPH_ARGS: '' MIRROR_IMAGE_MODE: snapshot MIRROR_POOL_MODE: image RBD_IMAGE_FEATURES: layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES: '4' RBD_MIRROR_USE_EXISTING_CLUSTER: '1' RBD_MIRROR_USE_RBD_MIRROR: '1' timeout: 6h teuthology_branch: master teuthology_sha1: 6cfddd5e1c7d5ede1367cf3087c21af44eb88356 timestamp: 2021-11-18_06:00:03 tube: gibba user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.19943 2021-11-21T03:36:26.850 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa; will attempt to use it 2021-11-21T03:36:26.851 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks 2021-11-21T03:36:26.851 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-11-21T03:36:26.853 INFO:teuthology.task.internal:Checking packages... 2021-11-21T03:36:26.873 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'b0aaed0fe8cdfe99c82a70b230004934b51091ff' 2021-11-21T03:36:26.873 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-11-21T03:36:26.874 INFO:teuthology.packaging:ref: None 2021-11-21T03:36:26.874 INFO:teuthology.packaging:tag: None 2021-11-21T03:36:26.875 INFO:teuthology.packaging:branch: octopus 2021-11-21T03:36:26.875 INFO:teuthology.packaging:sha1: b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-21T03:36:26.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2021-11-21T03:36:27.183 INFO:teuthology.task.internal:Found packages for ceph version 15.2.15-36.g911bc85f 2021-11-21T03:36:27.184 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-11-21T03:36:27.193 INFO:teuthology.task.internal:no buildpackages task found 2021-11-21T03:36:27.193 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-11-21T03:36:27.222 INFO:teuthology.task.internal:Saving configuration 2021-11-21T03:36:27.242 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-11-21T03:36:27.253 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-21T03:36:27.276 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-18_06:00:03-rbd-octopus-distro-default-gibba/6511531', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.3', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-21 03:31:51.647328', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLPl1DOYdzo9kgaODM/s5Qr8CiEIHVr79PsCw3yxWhBWidlDZgwors3PQPH26axGN+sEIXzhyhHfxQwLVxUSnhw='} 2021-11-21T03:36:27.299 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-18_06:00:03-rbd-octopus-distro-default-gibba/6511531', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.3', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-21 03:31:51.645814', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEbDW0li+XJwKuLmI5i9s8vQBA4l5S5zAvwpT22WWZCfwz1usmdLs0yvx1Ku6hbo5S1eZ9ABTBPvpgRmsVBW8ic='} 2021-11-21T03:36:27.300 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-11-21T03:36:27.311 INFO:teuthology.task.internal:roles: ubuntu@gibba022.front.sepia.ceph.com - ['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'] 2021-11-21T03:36:27.311 INFO:teuthology.task.internal:roles: ubuntu@gibba043.front.sepia.ceph.com - ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6'] 2021-11-21T03:36:27.311 INFO:teuthology.run_tasks:Running task console_log... 2021-11-21T03:36:27.389 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f07ada18e18>, signals=[15]) 2021-11-21T03:36:27.390 INFO:teuthology.run_tasks:Running task internal.connect... 2021-11-21T03:36:27.402 INFO:teuthology.task.internal:Opening connections... 2021-11-21T03:36:27.402 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba022.front.sepia.ceph.com 2021-11-21T03:36:27.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T03:36:27.470 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba043.front.sepia.ceph.com 2021-11-21T03:36:27.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T03:36:27.538 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-11-21T03:36:27.549 DEBUG:teuthology.orchestra.run.gibba022:> uname -m 2021-11-21T03:36:27.560 INFO:teuthology.orchestra.run.gibba022.stdout:x86_64 2021-11-21T03:36:27.561 DEBUG:teuthology.orchestra.run.gibba022:> cat /etc/os-release 2021-11-21T03:36:27.612 INFO:teuthology.orchestra.run.gibba022.stdout:NAME="Red Hat Enterprise Linux" 2021-11-21T03:36:27.612 INFO:teuthology.orchestra.run.gibba022.stdout:VERSION="8.3 (Ootpa)" 2021-11-21T03:36:27.612 INFO:teuthology.orchestra.run.gibba022.stdout:ID="rhel" 2021-11-21T03:36:27.613 INFO:teuthology.orchestra.run.gibba022.stdout:ID_LIKE="fedora" 2021-11-21T03:36:27.613 INFO:teuthology.orchestra.run.gibba022.stdout:VERSION_ID="8.3" 2021-11-21T03:36:27.613 INFO:teuthology.orchestra.run.gibba022.stdout:PLATFORM_ID="platform:el8" 2021-11-21T03:36:27.613 INFO:teuthology.orchestra.run.gibba022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-11-21T03:36:27.613 INFO:teuthology.orchestra.run.gibba022.stdout:ANSI_COLOR="0;31" 2021-11-21T03:36:27.614 INFO:teuthology.orchestra.run.gibba022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-11-21T03:36:27.614 INFO:teuthology.orchestra.run.gibba022.stdout:HOME_URL="https://www.redhat.com/" 2021-11-21T03:36:27.614 INFO:teuthology.orchestra.run.gibba022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-11-21T03:36:27.614 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:36:27.615 INFO:teuthology.orchestra.run.gibba022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-11-21T03:36:27.615 INFO:teuthology.orchestra.run.gibba022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-11-21T03:36:27.615 INFO:teuthology.orchestra.run.gibba022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-11-21T03:36:27.615 INFO:teuthology.orchestra.run.gibba022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-11-21T03:36:27.616 INFO:teuthology.lock.ops:Updating gibba022.front.sepia.ceph.com on lock server 2021-11-21T03:36:27.643 DEBUG:teuthology.orchestra.run.gibba043:> uname -m 2021-11-21T03:36:27.656 INFO:teuthology.orchestra.run.gibba043.stdout:x86_64 2021-11-21T03:36:27.656 DEBUG:teuthology.orchestra.run.gibba043:> cat /etc/os-release 2021-11-21T03:36:27.707 INFO:teuthology.orchestra.run.gibba043.stdout:NAME="Red Hat Enterprise Linux" 2021-11-21T03:36:27.707 INFO:teuthology.orchestra.run.gibba043.stdout:VERSION="8.3 (Ootpa)" 2021-11-21T03:36:27.707 INFO:teuthology.orchestra.run.gibba043.stdout:ID="rhel" 2021-11-21T03:36:27.707 INFO:teuthology.orchestra.run.gibba043.stdout:ID_LIKE="fedora" 2021-11-21T03:36:27.708 INFO:teuthology.orchestra.run.gibba043.stdout:VERSION_ID="8.3" 2021-11-21T03:36:27.708 INFO:teuthology.orchestra.run.gibba043.stdout:PLATFORM_ID="platform:el8" 2021-11-21T03:36:27.708 INFO:teuthology.orchestra.run.gibba043.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-11-21T03:36:27.708 INFO:teuthology.orchestra.run.gibba043.stdout:ANSI_COLOR="0;31" 2021-11-21T03:36:27.708 INFO:teuthology.orchestra.run.gibba043.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-11-21T03:36:27.709 INFO:teuthology.orchestra.run.gibba043.stdout:HOME_URL="https://www.redhat.com/" 2021-11-21T03:36:27.709 INFO:teuthology.orchestra.run.gibba043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-11-21T03:36:27.709 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:36:27.709 INFO:teuthology.orchestra.run.gibba043.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-11-21T03:36:27.709 INFO:teuthology.orchestra.run.gibba043.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-11-21T03:36:27.710 INFO:teuthology.orchestra.run.gibba043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-11-21T03:36:27.710 INFO:teuthology.orchestra.run.gibba043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-11-21T03:36:27.710 INFO:teuthology.lock.ops:Updating gibba043.front.sepia.ceph.com on lock server 2021-11-21T03:36:27.729 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-11-21T03:36:27.743 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-11-21T03:36:27.763 INFO:teuthology.task.internal:Checking for old test directory... 2021-11-21T03:36:27.764 DEBUG:teuthology.orchestra.run.gibba022:> test '!' -e /home/ubuntu/cephtest 2021-11-21T03:36:27.767 DEBUG:teuthology.orchestra.run.gibba043:> test '!' -e /home/ubuntu/cephtest 2021-11-21T03:36:27.779 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-11-21T03:36:27.792 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-11-21T03:36:27.792 DEBUG:teuthology.orchestra.run.gibba022:> test -z $(ls -A /var/lib/ceph) 2021-11-21T03:36:27.818 DEBUG:teuthology.orchestra.run.gibba043:> test -z $(ls -A /var/lib/ceph) 2021-11-21T03:36:27.845 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-11-21T03:36:27.899 INFO:teuthology.run_tasks:Running task kernel... 2021-11-21T03:36:27.916 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-11-21T03:36:27.917 INFO:teuthology.task.kernel:config {'cluster1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'cluster2.mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-11-21T03:36:27.918 DEBUG:teuthology.orchestra.run.gibba022:> uname -r 2021-11-21T03:36:27.918 DEBUG:teuthology.orchestra.run.gibba043:> uname -r 2021-11-21T03:36:27.929 INFO:teuthology.orchestra.run.gibba022.stdout:4.18.0-305.12.1.el8_4.x86_64 2021-11-21T03:36:27.930 INFO:teuthology.task.kernel:Running kernel on gibba022: 4.18.0-305.12.1.el8_4.x86_64 2021-11-21T03:36:27.930 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum install -y kernel 2021-11-21T03:36:27.931 INFO:teuthology.orchestra.run.gibba043.stdout:4.18.0-305.12.1.el8_4.x86_64 2021-11-21T03:36:27.932 INFO:teuthology.task.kernel:Running kernel on gibba043: 4.18.0-305.12.1.el8_4.x86_64 2021-11-21T03:36:27.932 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum install -y kernel 2021-11-21T03:36:29.092 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:36:29.093 INFO:teuthology.orchestra.run.gibba022.stdout:Unable to read consumer identity 2021-11-21T03:36:29.130 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:36:29.130 INFO:teuthology.orchestra.run.gibba043.stdout:Unable to read consumer identity 2021-11-21T03:36:29.178 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:36:29.178 INFO:teuthology.orchestra.run.gibba022.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-11-21T03:36:29.179 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:36:29.287 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:36:29.287 INFO:teuthology.orchestra.run.gibba043.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-11-21T03:36:29.288 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:36:32.679 INFO:teuthology.orchestra.run.gibba043.stdout:Copr repo for python3-asyncssh owned by ceph 1.7 kB/s | 3.5 kB 00:02 2021-11-21T03:36:32.680 INFO:teuthology.orchestra.run.gibba022.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2021-11-21T03:36:33.492 INFO:teuthology.orchestra.run.gibba022.stdout:Extra Packages for Enterprise Linux 14 MB/s | 11 MB 00:00 2021-11-21T03:36:33.513 INFO:teuthology.orchestra.run.gibba043.stdout:Extra Packages for Enterprise Linux 13 MB/s | 11 MB 00:00 2021-11-21T03:36:35.115 INFO:teuthology.orchestra.run.gibba022.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2021-11-21T03:36:35.142 INFO:teuthology.orchestra.run.gibba043.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2021-11-21T03:36:35.648 INFO:teuthology.orchestra.run.gibba022.stdout:Package kernel-4.18.0-305.12.1.el8_4.x86_64 is already installed. 2021-11-21T03:36:35.649 INFO:teuthology.orchestra.run.gibba022.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-11-21T03:36:35.651 INFO:teuthology.orchestra.run.gibba043.stdout:Package kernel-4.18.0-305.12.1.el8_4.x86_64 is already installed. 2021-11-21T03:36:35.651 INFO:teuthology.orchestra.run.gibba043.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-11-21T03:36:35.758 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:36:35.772 INFO:teuthology.orchestra.run.gibba043.stdout:Nothing to do. 2021-11-21T03:36:35.772 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:36:35.785 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:36:35.797 INFO:teuthology.orchestra.run.gibba022.stdout:Nothing to do. 2021-11-21T03:36:35.797 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:36:35.838 DEBUG:teuthology.orchestra.run.gibba043:> echo no | sudo yum reinstall kernel || true 2021-11-21T03:36:35.868 DEBUG:teuthology.orchestra.run.gibba022:> echo no | sudo yum reinstall kernel || true 2021-11-21T03:36:36.073 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:36:36.074 INFO:teuthology.orchestra.run.gibba043.stdout:Unable to read consumer identity 2021-11-21T03:36:36.104 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:36:36.105 INFO:teuthology.orchestra.run.gibba022.stdout:Unable to read consumer identity 2021-11-21T03:36:36.119 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:36:36.119 INFO:teuthology.orchestra.run.gibba043.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-11-21T03:36:36.120 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:36:36.149 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:36:36.150 INFO:teuthology.orchestra.run.gibba022.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-11-21T03:36:36.150 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:36:36.248 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:01 ago on Sun 21 Nov 2021 03:36:35 AM UTC. 2021-11-21T03:36:36.280 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:01 ago on Sun 21 Nov 2021 03:36:35 AM UTC. 2021-11-21T03:36:36.353 INFO:teuthology.orchestra.run.gibba043.stdout:Installed package kernel-4.18.0-305.12.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2021-11-21T03:36:36.353 INFO:teuthology.orchestra.run.gibba043.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2021-11-21T03:36:36.390 INFO:teuthology.orchestra.run.gibba022.stdout:Installed package kernel-4.18.0-305.12.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2021-11-21T03:36:36.390 INFO:teuthology.orchestra.run.gibba022.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2021-11-21T03:36:36.418 INFO:teuthology.orchestra.run.gibba043.stderr:Error: No packages marked for reinstall. 2021-11-21T03:36:36.436 INFO:teuthology.orchestra.run.gibba022.stderr:Error: No packages marked for reinstall. 2021-11-21T03:36:36.440 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum reinstall -y kernel || true 2021-11-21T03:36:36.458 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum reinstall -y kernel || true 2021-11-21T03:36:36.638 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:36:36.639 INFO:teuthology.orchestra.run.gibba043.stdout:Unable to read consumer identity 2021-11-21T03:36:36.654 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:36:36.654 INFO:teuthology.orchestra.run.gibba022.stdout:Unable to read consumer identity 2021-11-21T03:36:36.693 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:36:36.694 INFO:teuthology.orchestra.run.gibba043.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-11-21T03:36:36.694 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:36:36.705 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:36:36.705 INFO:teuthology.orchestra.run.gibba022.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-11-21T03:36:36.706 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:36:36.819 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:01 ago on Sun 21 Nov 2021 03:36:35 AM UTC. 2021-11-21T03:36:36.830 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:01 ago on Sun 21 Nov 2021 03:36:35 AM UTC. 2021-11-21T03:36:36.948 INFO:teuthology.orchestra.run.gibba022.stdout:Installed package kernel-4.18.0-305.12.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2021-11-21T03:36:36.948 INFO:teuthology.orchestra.run.gibba022.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2021-11-21T03:36:36.952 INFO:teuthology.orchestra.run.gibba043.stdout:Installed package kernel-4.18.0-305.12.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2021-11-21T03:36:36.953 INFO:teuthology.orchestra.run.gibba043.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2021-11-21T03:36:36.978 INFO:teuthology.orchestra.run.gibba022.stderr:Error: No packages marked for reinstall. 2021-11-21T03:36:36.978 INFO:teuthology.orchestra.run.gibba043.stderr:Error: No packages marked for reinstall. 2021-11-21T03:36:36.999 DEBUG:teuthology.orchestra.run.gibba043:> rpm -q kernel --last | head -n 1 2021-11-21T03:36:37.001 DEBUG:teuthology.orchestra.run.gibba022:> rpm -q kernel --last | head -n 1 2021-11-21T03:36:37.070 INFO:teuthology.orchestra.run.gibba043.stdout:kernel-4.18.0-305.12.1.el8_4.x86_64 Wed 18 Aug 2021 04:38:02 PM UTC 2021-11-21T03:36:37.071 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.12.1.el8_4.x86_64 2021-11-21T03:36:37.071 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-11-21T03:36:37.071 INFO:teuthology.task.kernel:Enabling kdb on cluster2.mon.a... 2021-11-21T03:36:37.072 DEBUG:teuthology.orchestra.run.gibba043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-21T03:36:37.077 INFO:teuthology.orchestra.run.gibba022.stdout:kernel-4.18.0-305.12.1.el8_4.x86_64 Wed 18 Aug 2021 04:38:02 PM UTC 2021-11-21T03:36:37.078 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-305.12.1.el8_4.x86_64 2021-11-21T03:36:37.079 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-11-21T03:36:37.079 INFO:teuthology.task.kernel:Enabling kdb on cluster1.mon.a... 2021-11-21T03:36:37.079 DEBUG:teuthology.orchestra.run.gibba022:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-21T03:36:37.093 INFO:teuthology.orchestra.run.gibba043.stdout:ttyS1 2021-11-21T03:36:37.102 INFO:teuthology.orchestra.run.gibba022.stdout:ttyS1 2021-11-21T03:36:37.120 DEBUG:teuthology.parallel:result is None 2021-11-21T03:36:37.130 DEBUG:teuthology.parallel:result is None 2021-11-21T03:36:37.130 INFO:teuthology.run_tasks:Running task internal.base... 2021-11-21T03:36:37.139 INFO:teuthology.task.internal:Creating test directory... 2021-11-21T03:36:37.140 DEBUG:teuthology.orchestra.run.gibba022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-21T03:36:37.172 DEBUG:teuthology.orchestra.run.gibba043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-21T03:36:37.184 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-11-21T03:36:37.194 INFO:teuthology.run_tasks:Running task internal.archive... 2021-11-21T03:36:37.223 INFO:teuthology.task.internal:Creating archive directory... 2021-11-21T03:36:37.224 DEBUG:teuthology.orchestra.run.gibba022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-21T03:36:37.227 DEBUG:teuthology.orchestra.run.gibba043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-21T03:36:37.253 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-11-21T03:36:37.263 INFO:teuthology.task.internal:Enabling coredump saving... 2021-11-21T03:36:37.264 DEBUG:teuthology.orchestra.run.gibba022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-21T03:36:37.281 DEBUG:teuthology.orchestra.run.gibba043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-21T03:36:37.304 INFO:teuthology.orchestra.run.gibba022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-21T03:36:37.312 INFO:teuthology.orchestra.run.gibba022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-21T03:36:37.314 INFO:teuthology.orchestra.run.gibba043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-21T03:36:37.321 INFO:teuthology.orchestra.run.gibba043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-21T03:36:37.322 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-11-21T03:36:37.333 INFO:teuthology.task.internal:Configuring sudo... 2021-11-21T03:36:37.333 DEBUG:teuthology.orchestra.run.gibba022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-21T03:36:37.356 DEBUG:teuthology.orchestra.run.gibba043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-21T03:36:37.382 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-11-21T03:36:37.393 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-11-21T03:36:37.394 DEBUG:teuthology.orchestra.run.gibba022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-21T03:36:37.416 DEBUG:teuthology.orchestra.run.gibba043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-21T03:36:37.434 DEBUG:teuthology.orchestra.run.gibba022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-21T03:36:37.500 DEBUG:teuthology.orchestra.run.gibba022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-21T03:36:37.573 DEBUG:teuthology.orchestra.run.gibba022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-21T03:36:37.609 DEBUG:teuthology.orchestra.run.gibba022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-21T03:36:37.644 DEBUG:teuthology.orchestra.run.gibba022:> set -ex 2021-11-21T03:36:37.645 DEBUG:teuthology.orchestra.run.gibba022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-21T03:36:37.703 DEBUG:teuthology.orchestra.run.gibba043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-21T03:36:37.738 DEBUG:teuthology.orchestra.run.gibba043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-21T03:36:37.794 DEBUG:teuthology.orchestra.run.gibba043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-21T03:36:37.869 DEBUG:teuthology.orchestra.run.gibba043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-21T03:36:37.908 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-11-21T03:36:37.908 DEBUG:teuthology.orchestra.run.gibba043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-21T03:36:37.967 DEBUG:teuthology.orchestra.run.gibba022:> sudo service rsyslog restart 2021-11-21T03:36:37.970 DEBUG:teuthology.orchestra.run.gibba043:> sudo service rsyslog restart 2021-11-21T03:36:38.028 INFO:teuthology.orchestra.run.gibba022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-11-21T03:36:38.063 INFO:teuthology.orchestra.run.gibba043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-11-21T03:36:38.425 INFO:teuthology.run_tasks:Running task internal.timer... 2021-11-21T03:36:38.436 INFO:teuthology.task.internal:Starting timer... 2021-11-21T03:36:38.436 INFO:teuthology.run_tasks:Running task pcp... 2021-11-21T03:36:38.459 INFO:teuthology.run_tasks:Running task selinux... 2021-11-21T03:36:38.474 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-11-21T03:36:38.474 DEBUG:teuthology.orchestra.run.gibba022:> sudo service auditd rotate 2021-11-21T03:36:38.523 INFO:teuthology.orchestra.run.gibba022.stdout:Rotating logs: [ OK ] 2021-11-21T03:36:38.525 DEBUG:teuthology.orchestra.run.gibba043:> sudo service auditd rotate 2021-11-21T03:36:38.583 INFO:teuthology.orchestra.run.gibba043.stdout:Rotating logs: [ OK ] 2021-11-21T03:36:38.584 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-11-21T03:36:38.585 DEBUG:teuthology.orchestra.run.gibba022:> /usr/sbin/getenforce 2021-11-21T03:36:38.601 INFO:teuthology.orchestra.run.gibba022.stdout:Permissive 2021-11-21T03:36:38.601 DEBUG:teuthology.orchestra.run.gibba043:> /usr/sbin/getenforce 2021-11-21T03:36:38.614 INFO:teuthology.orchestra.run.gibba043.stdout:Permissive 2021-11-21T03:36:38.615 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@gibba022.front.sepia.ceph.com': 'permissive', 'ubuntu@gibba043.front.sepia.ceph.com': 'permissive'} 2021-11-21T03:36:38.615 DEBUG:teuthology.orchestra.run.gibba022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-11-21T03:36:38.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T03:36:38.662 DEBUG:teuthology.orchestra.run.gibba043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-11-21T03:36:38.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T03:36:38.681 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-11-21T03:36:38.681 DEBUG:teuthology.orchestra.run.gibba022:> sudo /usr/sbin/setenforce permissive 2021-11-21T03:36:38.720 DEBUG:teuthology.orchestra.run.gibba043:> sudo /usr/sbin/setenforce permissive 2021-11-21T03:36:38.741 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-11-21T03:36:38.751 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-11-21T03:36:38.757 INFO:teuthology.repo_utils:Fetching master from origin 2021-11-21T03:36:38.790 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-11-21T03:36:38.809 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-11-21T03:36:38.810 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba022.front.sepia.ceph.com,gibba043.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-11-21T03:36:39.180 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-11-21T03:36:39.991 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-11-21T03:36:42.898 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-11-21T03:36:43.011 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:43 +0000 (0:00:00.128) 0:00:00.128 ******* 2021-11-21T03:36:43.025 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:43 +0000 (0:00:00.014) 0:00:00.142 ******* 2021-11-21T03:36:44.162 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba022.front.sepia.ceph.com] 2021-11-21T03:36:44.210 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:44 +0000 (0:00:01.185) 0:00:01.328 ******* 2021-11-21T03:36:44.219 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] 2021-11-21T03:36:44.267 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:44 +0000 (0:00:00.056) 0:00:01.384 ******* 2021-11-21T03:36:44.428 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-11-21T03:36:44.430 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-11-21T03:36:44.449 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:44 +0000 (0:00:00.182) 0:00:01.567 ******* 2021-11-21T03:36:44.467 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:44 +0000 (0:00:00.017) 0:00:01.584 ******* 2021-11-21T03:36:44.889 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-11-21T03:36:44.890 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-21T03:36:44.911 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:44 +0000 (0:00:00.444) 0:00:02.028 ******* 2021-11-21T03:36:44.918 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-21T03:36:44.940 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:44 +0000 (0:00:00.029) 0:00:02.058 ******* 2021-11-21T03:36:44.967 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-11-21T03:36:44.968 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:36:44.989 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:44 +0000 (0:00:00.048) 0:00:02.106 ******* 2021-11-21T03:36:45.005 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:36:45.027 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:45 +0000 (0:00:00.037) 0:00:02.144 ******* 2021-11-21T03:36:45.208 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-11-21T03:36:45.210 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-21T03:36:45.233 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:45 +0000 (0:00:00.205) 0:00:02.350 ******* 2021-11-21T03:36:45.251 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:45 +0000 (0:00:00.018) 0:00:02.369 ******* 2021-11-21T03:36:46.041 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-11-21T03:36:46.043 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637465805.2903008-7742-195521092365490/source", "state": "file", "uid": 0} changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637465805.2733462-7739-46075896178940/source", "state": "file", "uid": 0} 2021-11-21T03:36:46.063 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:46 +0000 (0:00:00.811) 0:00:03.181 ******* 2021-11-21T03:36:46.081 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:46 +0000 (0:00:00.017) 0:00:03.199 ******* 2021-11-21T03:36:46.450 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-11-21T03:36:46.452 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-11-21T03:36:46.454 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-21T03:36:46.472 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-11-21T03:36:46.474 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-21T03:36:46.542 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-11-21T03:36:46.544 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-21T03:36:46.557 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Sunday 21 November 2021 03:36:46 +0000 (0:00:00.475) 0:00:03.674 ******* 2021-11-21T03:36:47.009 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] 2021-11-21T03:36:47.019 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] 2021-11-21T03:36:47.035 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** 2021-11-21T03:36:47.037 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:47 +0000 (0:00:00.478) 0:00:04.153 ******* 2021-11-21T03:36:47.059 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-21T03:36:47.070 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-21T03:36:47.074 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-21T03:36:47.225 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:47 +0000 (0:00:00.189) 0:00:04.342 ******* 2021-11-21T03:36:47.244 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:47 +0000 (0:00:00.019) 0:00:04.362 ******* 2021-11-21T03:36:47.762 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba022.front.sepia.ceph.com] 2021-11-21T03:36:47.813 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-11-21T03:36:47.815 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:47 +0000 (0:00:00.569) 0:00:04.931 ******* 2021-11-21T03:36:47.824 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] 2021-11-21T03:36:47.876 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:47 +0000 (0:00:00.062) 0:00:04.993 ******* 2021-11-21T03:36:48.420 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-11-21T03:36:48.422 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.171714", "end": "2021-11-21 03:36:48.390949", "rc": 0, "start": "2021-11-21 03:36:48.219235", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-21T03:36:48.422 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.180060", "end": "2021-11-21 03:36:48.397715", "rc": 0, "start": "2021-11-21 03:36:48.217655", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-21T03:36:48.447 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:48 +0000 (0:00:00.571) 0:00:05.565 ******* 2021-11-21T03:36:48.466 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:48 +0000 (0:00:00.018) 0:00:05.583 ******* 2021-11-21T03:36:48.607 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-11-21T03:36:48.609 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.012782", "end": "2021-11-21 03:36:48.591026", "failed_when_result": false, "rc": 0, "start": "2021-11-21 03:36:48.578244", "stderr": "", "stderr_lines": [], "stdout": "1fc175d7676551b8ec19db9c0addb24dfee19b81", "stdout_lines": ["1fc175d7676551b8ec19db9c0addb24dfee19b81"]} 2021-11-21T03:36:48.630 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:48 +0000 (0:00:00.164) 0:00:05.748 ******* 2021-11-21T03:36:48.637 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007110", "end": "2021-11-21 03:36:48.602388", "failed_when_result": false, "rc": 0, "start": "2021-11-21 03:36:48.595278", "stderr": "", "stderr_lines": [], "stdout": "1fc175d7676551b8ec19db9c0addb24dfee19b81", "stdout_lines": ["1fc175d7676551b8ec19db9c0addb24dfee19b81"]} 2021-11-21T03:36:48.661 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:48 +0000 (0:00:00.030) 0:00:05.778 ******* 2021-11-21T03:36:48.688 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-11-21T03:36:48.690 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:36:48.712 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:48 +0000 (0:00:00.050) 0:00:05.829 ******* 2021-11-21T03:36:48.729 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:36:48.752 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:48 +0000 (0:00:00.040) 0:00:05.869 ******* 2021-11-21T03:36:48.778 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-11-21T03:36:48.780 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:36:48.802 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:48 +0000 (0:00:00.049) 0:00:05.919 ******* 2021-11-21T03:36:48.818 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:36:48.841 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:48 +0000 (0:00:00.039) 0:00:05.958 ******* 2021-11-21T03:36:48.867 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-11-21T03:36:48.870 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:36:48.890 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:48 +0000 (0:00:00.049) 0:00:06.008 ******* 2021-11-21T03:36:48.907 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:36:48.929 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:48 +0000 (0:00:00.038) 0:00:06.047 ******* 2021-11-21T03:36:48.956 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-11-21T03:36:48.957 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:36:48.979 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:48 +0000 (0:00:00.049) 0:00:06.097 ******* 2021-11-21T03:36:48.997 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:36:49.021 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:49 +0000 (0:00:00.041) 0:00:06.138 ******* 2021-11-21T03:36:49.049 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-11-21T03:36:49.050 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:36:49.072 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:49 +0000 (0:00:00.051) 0:00:06.190 ******* 2021-11-21T03:36:49.091 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:36:49.114 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:49 +0000 (0:00:00.041) 0:00:06.231 ******* 2021-11-21T03:36:49.277 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-11-21T03:36:49.278 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-21T03:36:49.299 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:49 +0000 (0:00:00.185) 0:00:06.416 ******* 2021-11-21T03:36:49.316 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-21T03:36:49.339 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:36:49 +0000 (0:00:00.040) 0:00:06.457 ******* 2021-11-21T03:36:49.543 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-11-21T03:36:49.545 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-21T03:36:49.586 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-21T03:36:49.691 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-21T03:36:49.743 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-21T03:36:49.849 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-21T03:36:49.900 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-21T03:36:49.997 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-21T03:36:50.050 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-21T03:36:50.170 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-21T03:36:50.208 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-21T03:36:50.346 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-21T03:36:50.389 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-21T03:36:50.493 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-21T03:36:50.536 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-21T03:36:50.651 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-21T03:36:50.704 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-21T03:36:50.808 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-21T03:36:50.850 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-21T03:36:50.955 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-21T03:36:51.008 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-21T03:36:51.112 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-21T03:36:51.154 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-21T03:36:51.259 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-21T03:36:51.311 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-21T03:36:51.418 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-21T03:36:51.461 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-21T03:36:51.575 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-21T03:36:51.618 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-21T03:36:51.723 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-21T03:36:51.765 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-21T03:36:51.880 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-21T03:36:51.922 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-21T03:36:52.026 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-21T03:36:52.069 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-21T03:36:52.183 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-21T03:36:52.226 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-21T03:36:52.341 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-21T03:36:52.383 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-21T03:36:52.488 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-21T03:36:52.530 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-21T03:36:52.645 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-21T03:36:52.687 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-21T03:36:52.803 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-21T03:36:52.845 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-21T03:36:52.959 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-21T03:36:52.991 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-21T03:36:53.106 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-21T03:36:53.149 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-21T03:36:53.263 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-21T03:36:53.305 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-21T03:36:53.420 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-21T03:36:53.462 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-21T03:36:53.577 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-21T03:36:53.619 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-21T03:36:53.733 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-21T03:36:53.776 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-21T03:36:53.880 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-21T03:36:53.923 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-21T03:36:54.032 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-21T03:36:54.074 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-21T03:36:54.189 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-21T03:36:54.231 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-21T03:36:54.348 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-21T03:36:54.390 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-21T03:36:54.494 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-21T03:36:54.536 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-21T03:36:54.662 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-11-21T03:36:54.694 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-11-21T03:36:54.818 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-21T03:36:54.850 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-21T03:36:54.975 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-21T03:36:55.007 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-21T03:36:55.131 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-21T03:36:55.153 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-21T03:36:55.288 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-21T03:36:55.311 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-21T03:36:55.452 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-21T03:36:55.463 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-21T03:36:55.600 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-21T03:36:55.621 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-21T03:36:55.756 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-21T03:36:55.778 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-21T03:36:55.913 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-21T03:36:55.924 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-21T03:36:56.070 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-21T03:36:56.081 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-21T03:36:56.217 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-21T03:36:56.228 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-21T03:36:56.374 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-21T03:36:56.385 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-21T03:36:56.531 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-21T03:36:56.542 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-21T03:36:56.687 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-21T03:36:56.699 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-21T03:36:56.835 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-21T03:36:56.846 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-21T03:36:56.992 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-21T03:36:57.004 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-21T03:36:57.149 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-21T03:36:57.150 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-21T03:36:57.296 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-21T03:36:57.309 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-21T03:36:57.464 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-21T03:36:57.475 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-21T03:36:57.610 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-21T03:36:57.621 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-21T03:36:57.768 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-21T03:36:57.779 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-21T03:36:57.925 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-21T03:36:57.926 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-21T03:36:58.081 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-21T03:36:58.082 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-21T03:36:58.230 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-21T03:36:58.241 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-21T03:36:58.387 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-21T03:36:58.398 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-21T03:36:58.544 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-21T03:36:58.556 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-21T03:36:58.701 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-21T03:36:58.702 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-21T03:36:58.848 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-21T03:36:58.859 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-21T03:36:59.004 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-21T03:36:59.016 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-21T03:36:59.161 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-21T03:36:59.162 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-21T03:36:59.308 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-21T03:36:59.319 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-21T03:36:59.465 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-21T03:36:59.466 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-21T03:36:59.612 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-21T03:36:59.624 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-21T03:36:59.769 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-21T03:36:59.781 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-21T03:36:59.926 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-21T03:36:59.938 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-21T03:37:00.084 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-21T03:37:00.086 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-21T03:37:00.241 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-21T03:37:00.242 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-21T03:37:00.387 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-21T03:37:00.425 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-21T03:37:00.544 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-21T03:37:00.545 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-21T03:37:00.703 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-21T03:37:00.704 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-21T03:37:00.849 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-21T03:37:00.861 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-21T03:37:01.006 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-21T03:37:01.007 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-21T03:37:01.163 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-21T03:37:01.164 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-21T03:37:01.309 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-21T03:37:01.310 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-21T03:37:01.466 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-21T03:37:01.467 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-21T03:37:01.614 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-21T03:37:01.615 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-21T03:37:01.772 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-21T03:37:01.773 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-21T03:37:01.930 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-11-21T03:37:01.931 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-11-21T03:37:02.076 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-21T03:37:02.087 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-21T03:37:02.245 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1187} ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-21T03:37:02.391 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-21T03:37:02.392 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-21T03:37:02.548 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-21T03:37:02.549 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-21T03:37:02.694 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-21T03:37:02.695 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-21T03:37:02.851 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-21T03:37:02.852 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-21T03:37:03.008 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-21T03:37:03.009 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-21T03:37:03.158 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-21T03:37:03.169 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-21T03:37:03.315 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-21T03:37:03.317 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-21T03:37:03.471 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-21T03:37:03.472 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-21T03:37:03.629 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-21T03:37:03.630 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-21T03:37:03.787 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-21T03:37:03.788 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-21T03:37:03.945 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1198} ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-21T03:37:04.090 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-21T03:37:04.101 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-21T03:37:04.247 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-21T03:37:04.258 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-21T03:37:04.407 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-21T03:37:04.418 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-21T03:37:04.564 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-21T03:37:04.575 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-21T03:37:04.711 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-21T03:37:04.722 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-21T03:37:04.868 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-21T03:37:04.879 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-21T03:37:05.015 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-21T03:37:05.037 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-21T03:37:05.172 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-21T03:37:05.194 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-21T03:37:05.329 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-21T03:37:05.340 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-21T03:37:05.476 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-21T03:37:05.498 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-21T03:37:05.636 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-21T03:37:05.647 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-21T03:37:05.793 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-21T03:37:05.804 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-21T03:37:05.949 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-21T03:37:05.961 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-21T03:37:06.106 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-21T03:37:06.118 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-21T03:37:06.255 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-21T03:37:06.277 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-21T03:37:06.412 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-21T03:37:06.434 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-21T03:37:06.559 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-21T03:37:06.581 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-21T03:37:06.716 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-21T03:37:06.738 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-21T03:37:06.873 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-21T03:37:06.894 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-21T03:37:07.040 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-21T03:37:07.051 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-21T03:37:07.197 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-21T03:37:07.208 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-21T03:37:07.354 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-21T03:37:07.355 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-21T03:37:07.501 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-21T03:37:07.502 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-21T03:37:07.503 INFO:teuthology.task.ansible.out: 2021-11-21T03:37:07.663 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-21T03:37:07.674 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-21T03:37:07.823 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-21T03:37:07.835 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-21T03:37:07.982 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-21T03:37:07.983 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-21T03:37:08.138 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-21T03:37:08.139 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-21T03:37:08.295 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-21T03:37:08.298 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-21T03:37:08.452 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-21T03:37:08.454 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-21T03:37:08.609 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-21T03:37:08.611 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-21T03:37:08.765 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-21T03:37:08.767 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-21T03:37:08.923 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-21T03:37:08.924 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-21T03:37:09.081 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-11-21T03:37:09.093 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-11-21T03:37:09.238 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-21T03:37:09.250 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-21T03:37:09.386 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-21T03:37:09.408 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-21T03:37:09.544 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-21T03:37:09.567 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-21T03:37:09.702 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-21T03:37:09.724 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-21T03:37:09.859 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-21T03:37:09.870 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-21T03:37:10.026 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-21T03:37:10.028 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-21T03:37:10.174 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1238, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 1238} 2021-11-21T03:37:10.186 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1238, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 1238} 2021-11-21T03:37:10.331 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1239, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 1239} 2021-11-21T03:37:10.343 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1239, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 1239} 2021-11-21T03:37:10.488 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1240, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 1240} 2021-11-21T03:37:10.489 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1240, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 1240} 2021-11-21T03:37:10.634 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1241, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 1241} 2021-11-21T03:37:10.646 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1241, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 1241} 2021-11-21T03:37:10.791 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1242, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 1242} 2021-11-21T03:37:10.803 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1242, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 1242} 2021-11-21T03:37:10.939 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1243, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 1243} 2021-11-21T03:37:10.950 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1243, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 1243} 2021-11-21T03:37:11.095 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1244, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 1244} 2021-11-21T03:37:11.096 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1244, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 1244} 2021-11-21T03:37:11.252 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1245, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 1245} 2021-11-21T03:37:11.254 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1245, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 1245} 2021-11-21T03:37:11.408 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1246, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 1246} 2021-11-21T03:37:11.410 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1246, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 1246} 2021-11-21T03:37:11.555 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1247, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 1247} 2021-11-21T03:37:11.577 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1247, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 1247} 2021-11-21T03:37:11.714 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1248, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 1248} 2021-11-21T03:37:11.736 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1248, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 1248} 2021-11-21T03:37:11.871 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1249, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 1249} 2021-11-21T03:37:11.893 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1249, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 1249} 2021-11-21T03:37:12.028 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1250, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 1250} 2021-11-21T03:37:12.050 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1250, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 1250} 2021-11-21T03:37:12.185 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1251, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 1251} 2021-11-21T03:37:12.196 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1251, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 1251} 2021-11-21T03:37:12.332 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1252, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 1252} 2021-11-21T03:37:12.354 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1252, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 1252} 2021-11-21T03:37:12.491 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1253, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 1253} 2021-11-21T03:37:12.513 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1253, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 1253} 2021-11-21T03:37:12.638 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1254, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 1254} 2021-11-21T03:37:12.660 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1254, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 1254} 2021-11-21T03:37:14.072 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-11-21T03:37:14.146 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-11-21T03:37:15.467 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-11-21T03:37:15.655 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-11-21T03:37:16.782 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-11-21T03:37:16.825 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-11-21T03:37:17.984 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-11-21T03:37:17.995 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-11-21T03:37:18.182 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:18 +0000 (0:00:28.842) 0:00:35.299 ******* 2021-11-21T03:37:18.201 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:18 +0000 (0:00:00.019) 0:00:35.319 ******* 2021-11-21T03:37:18.243 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-11-21T03:37:18.267 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:18 +0000 (0:00:00.065) 0:00:35.384 ******* 2021-11-21T03:37:18.296 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:18 +0000 (0:00:00.029) 0:00:35.414 ******* 2021-11-21T03:37:18.502 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-11-21T03:37:18.504 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-21T03:37:18.506 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-21T03:37:18.507 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-21T03:37:18.509 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-21T03:37:18.511 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "va 2021-11-21T03:37:18.511 INFO:teuthology.task.ansible.out:su", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-21T03:37:18.513 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-21T03:37:18.514 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-21T03:37:18.516 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-11-21T03:37:18.518 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-11-21T03:37:18.519 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "kh 2021-11-21T03:37:18.520 INFO:teuthology.task.ansible.out:iremat@kotresh-T490s 7o9Jje 2021-11-21T03:37:18.521 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-11-21T03:37:18.523 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a2 2021-11-21T03:37:18.524 INFO:teuthology.task.ansible.out:8ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "z 2021-11-21T03:37:18.526 INFO:teuthology.task.ansible.out:l31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9 2021-11-21T03:37:18.527 INFO:teuthology.task.ansible.out:fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b95 2021-11-21T03:37:18.529 INFO:teuthology.task.ansible.out:17faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai 2021-11-21T03:37:18.531 INFO:teuthology.task.ansible.out:YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@adm 2021-11-21T03:37:18.532 INFO:teuthology.task.ansible.out:in-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebb 2021-11-21T03:37:18.533 INFO:teuthology.task.ansible.out:a6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca45 2021-11-21T03:37:18.534 INFO:teuthology.task.ansible.out:5b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb2802992184 2021-11-21T03:37:18.536 INFO:teuthology.task.ansible.out:41a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135af 2021-11-21T03:37:18.537 INFO:teuthology.task.ansible.out:df4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, 2021-11-21T03:37:18.539 INFO:teuthology.task.ansible.out: {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"n 2021-11-21T03:37:18.539 INFO:teuthology.task.ansible.out:ame": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepik 2021-11-21T03:37:18.541 INFO:teuthology.task.ansible.out:a", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, { 2021-11-21T03:37:18.543 INFO:teuthology.task.ansible.out:"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7e 2021-11-21T03:37:18.544 INFO:teuthology.task.ansible.out:b3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@ 2021-11-21T03:37:18.546 INFO:teuthology.task.ansible.out:localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e52 2021-11-21T03:37:18.546 INFO:teuthology.task.ansible.out:99298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052 2021-11-21T03:37:18.548 INFO:teuthology.task.ansible.out:887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdi 2021-11-21T03:37:18.549 INFO:teuthology.task.ansible.out:azbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} 2021-11-21T03:37:18.572 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:18 +0000 (0:00:00.275) 0:00:35.690 ******* 2021-11-21T03:37:18.594 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:18 +0000 (0:00:00.021) 0:00:35.711 ******* 2021-11-21T03:37:19.420 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-11-21T03:37:19.421 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} ok: [gibba022.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-21T03:37:19.442 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:19 +0000 (0:00:00.848) 0:00:36.560 ******* 2021-11-21T03:37:19.463 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:19 +0000 (0:00:00.021) 0:00:36.581 ******* 2021-11-21T03:37:19.729 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-21T03:37:19.730 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-21T03:37:19.751 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-21T03:37:19.927 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-21T03:37:19.949 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-21T03:37:20.126 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-21T03:37:20.136 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-21T03:37:20.312 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-21T03:37:20.314 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-21T03:37:20.323 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-21T03:37:20.325 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-21T03:37:20.500 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-21T03:37:20.511 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-21T03:37:20.720 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-21T03:37:20.722 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-21T03:37:20.814 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-21T03:37:20.816 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-21T03:37:20.908 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-21T03:37:20.992 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-21T03:37:21.107 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-21T03:37:21.170 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-21T03:37:21.348 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-21T03:37:21.358 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:21.432 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-21T03:37:21.442 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:21.537 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-21T03:37:21.539 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-21T03:37:21.631 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-21T03:37:21.633 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-21T03:37:21.725 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-21T03:37:21.726 INFO:teuthology.task.ansible.out:on", "validate_certs": true} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:21.736 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:21.820 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-21T03:37:21.822 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-11-21T03:37:21.831 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:21.831 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:21.915 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-21T03:37:22.029 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-21T03:37:22.102 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-21T03:37:22.104 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-21T03:37:22.217 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-21T03:37:22.219 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-21T03:37:22.290 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-21T03:37:22.415 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-21T03:37:22.457 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-21T03:37:22.593 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-21T03:37:22.645 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-21T03:37:22.780 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-21T03:37:22.832 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-21T03:37:22.834 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-21T03:37:22.957 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-21T03:37:22.958 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-21T03:37:23.009 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-21T03:37:23.011 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-21T03:37:23.135 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-21T03:37:23.137 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-21T03:37:23.188 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-21T03:37:23.312 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-21T03:37:23.354 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-21T03:37:23.500 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-21T03:37:23.542 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-21T03:37:23.543 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-21T03:37:23.677 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-21T03:37:23.679 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-21T03:37:23.719 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-21T03:37:23.856 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-21T03:37:23.898 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-21T03:37:24.033 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-21T03:37:24.075 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-21T03:37:24.220 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-21T03:37:24.262 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-21T03:37:24.398 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-21T03:37:24.440 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-21T03:37:24.575 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-21T03:37:24.628 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-21T03:37:24.630 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-21T03:37:24.773 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-21T03:37:24.774 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-21T03:37:24.815 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-21T03:37:24.950 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-21T03:37:24.992 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-21T03:37:25.137 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-21T03:37:25.170 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-21T03:37:25.326 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-21T03:37:25.347 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-21T03:37:25.505 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-21T03:37:25.537 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-21T03:37:25.692 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-21T03:37:25.714 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-21T03:37:25.891 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-21T03:37:25.995 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-21T03:37:26.067 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-21T03:37:26.069 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-21T03:37:26.172 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-21T03:37:26.256 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-21T03:37:26.257 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-21T03:37:26.359 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-21T03:37:26.361 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-21T03:37:26.433 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-21T03:37:26.538 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-21T03:37:26.538 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-21T03:37:26.611 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-21T03:37:26.715 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-21T03:37:26.798 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-21T03:37:26.904 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-21T03:37:26.987 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-21T03:37:26.989 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-21T03:37:27.081 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-21T03:37:27.175 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-21T03:37:27.177 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-21T03:37:27.179 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-21T03:37:27.259 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-21T03:37:27.261 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-21T03:37:27.353 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-21T03:37:27.446 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-21T03:37:27.448 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-21T03:37:27.450 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-21T03:37:27.530 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-21T03:37:27.634 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-21T03:37:27.707 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-21T03:37:27.821 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-21T03:37:27.884 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-21T03:37:27.998 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-21T03:37:28.071 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-21T03:37:28.186 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-21T03:37:28.259 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-21T03:37:28.261 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-21T03:37:28.363 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-21T03:37:28.437 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-21T03:37:28.541 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-21T03:37:28.543 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-21T03:37:28.625 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-21T03:37:28.729 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-21T03:37:28.802 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-21T03:37:28.804 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-11-21T03:37:28.907 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-21T03:37:28.990 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-21T03:37:29.095 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-21T03:37:29.096 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-11-21T03:37:29.179 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-21T03:37:29.284 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-21T03:37:29.430 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-21T03:37:29.432 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-21T03:37:29.462 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-21T03:37:29.608 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-21T03:37:29.639 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-21T03:37:29.641 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-21T03:37:29.795 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-21T03:37:29.816 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-21T03:37:29.972 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-21T03:37:30.004 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-21T03:37:30.150 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-21T03:37:30.181 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-21T03:37:30.327 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-21T03:37:30.359 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-21T03:37:30.504 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-21T03:37:30.536 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-21T03:37:30.691 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-21T03:37:30.723 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-21T03:37:30.869 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-21T03:37:30.901 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-21T03:37:31.056 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-21T03:37:31.077 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-21T03:37:31.234 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-21T03:37:31.265 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-21T03:37:31.411 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-21T03:37:31.443 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-21T03:37:31.590 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-21T03:37:31.622 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-21T03:37:31.769 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-21T03:37:31.802 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-21T03:37:31.959 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-21T03:37:31.981 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-21T03:37:32.136 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-21T03:37:32.158 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-21T03:37:32.314 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-21T03:37:32.335 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-21T03:37:32.491 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-21T03:37:32.523 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-21T03:37:32.678 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-21T03:37:32.699 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-21T03:37:32.855 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-21T03:37:32.876 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-21T03:37:33.042 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-21T03:37:33.053 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-21T03:37:33.220 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-21T03:37:33.222 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-21T03:37:33.231 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-21T03:37:33.396 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-21T03:37:33.407 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-21T03:37:33.409 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-21T03:37:33.575 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-21T03:37:33.597 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-21T03:37:33.763 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-21T03:37:33.774 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-21T03:37:33.940 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-21T03:37:33.942 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-21T03:37:33.951 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-21T03:37:34.127 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-21T03:37:34.127 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-21T03:37:34.130 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-21T03:37:34.305 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-21T03:37:34.306 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-21T03:37:34.482 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-21T03:37:34.484 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-21T03:37:34.670 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-21T03:37:34.670 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-21T03:37:34.847 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-21T03:37:34.848 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-21T03:37:35.025 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "ch 2021-11-21T03:37:35.027 INFO:teuthology.task.ansible.out:anged": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-21T03:37:35.201 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-21T03:37:35.202 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-21T03:37:35.380 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-21T03:37:35.381 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-21T03:37:35.383 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-21T03:37:35.567 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-21T03:37:35.570 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-21T03:37:35.572 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-21T03:37:35.746 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-21T03:37:35.762 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-21T03:37:35.938 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-21T03:37:35.950 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-21T03:37:36.116 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-21T03:37:36.127 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-21T03:37:36.294 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-21T03:37:36.305 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-21T03:37:36.481 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-21T03:37:36.493 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-21T03:37:36.660 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-21T03:37:36.661 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-21T03:37:36.671 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-21T03:37:36.837 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-21T03:37:36.848 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-21T03:37:36.850 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-21T03:37:37.016 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-21T03:37:37.038 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-21T03:37:37.194 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-21T03:37:37.216 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-21T03:37:37.382 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-21T03:37:37.404 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-21T03:37:37.570 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-21T03:37:37.581 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-21T03:37:37.757 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-21T03:37:37.768 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-21T03:37:37.955 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-21T03:37:37.957 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-21T03:37:38.132 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-21T03:37:38.154 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-21T03:37:38.321 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-21T03:37:38.332 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-21T03:37:38.489 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-21T03:37:38.511 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-21T03:37:38.677 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-21T03:37:38.699 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-21T03:37:38.854 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-21T03:37:38.876 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-21T03:37:39.032 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-21T03:37:39.053 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-21T03:37:39.208 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-21T03:37:39.240 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-21T03:37:39.395 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-21T03:37:39.417 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-21T03:37:39.572 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-21T03:37:39.604 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-21T03:37:39.750 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-21T03:37:39.781 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-21T03:37:39.938 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-21T03:37:39.959 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-21T03:37:40.126 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-21T03:37:40.149 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-21T03:37:40.150 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-21T03:37:40.314 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-21T03:37:40.316 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-21T03:37:40.326 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-21T03:37:40.491 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-21T03:37:40.503 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-21T03:37:40.682 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-21T03:37:40.683 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-21T03:37:40.861 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-21T03:37:40.861 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-21T03:37:41.038 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-21T03:37:41.049 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-21T03:37:41.214 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-21T03:37:41.225 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-21T03:37:41.404 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-21T03:37:41.415 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-21T03:37:41.582 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-21T03:37:41.594 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-21T03:37:41.782 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-21T03:37:41.803 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-21T03:37:41.959 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-21T03:37:41.980 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-21T03:37:42.147 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-21T03:37:42.168 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-21T03:37:42.324 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-21T03:37:42.345 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-21T03:37:42.501 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-21T03:37:42.532 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-21T03:37:42.534 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-21T03:37:42.688 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-21T03:37:42.690 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-21T03:37:42.710 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-21T03:37:42.865 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-21T03:37:42.887 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-21T03:37:43.042 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-21T03:37:43.064 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-21T03:37:43.065 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-21T03:37:43.229 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-21T03:37:43.231 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-21T03:37:43.240 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-21T03:37:43.407 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-21T03:37:43.429 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-21T03:37:43.584 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-21T03:37:43.607 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-21T03:37:43.763 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-21T03:37:43.785 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-21T03:37:43.951 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-21T03:37:43.973 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-21T03:37:44.129 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-21T03:37:44.150 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-21T03:37:44.307 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-21T03:37:44.328 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-21T03:37:44.485 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-21T03:37:44.506 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-21T03:37:44.672 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-21T03:37:44.683 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-21T03:37:44.849 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-21T03:37:44.860 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-21T03:37:45.037 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-21T03:37:45.038 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-21T03:37:45.214 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-21T03:37:45.226 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-21T03:37:45.392 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-21T03:37:45.404 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-21T03:37:45.570 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-21T03:37:45.581 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-21T03:37:45.768 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-21T03:37:45.770 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-21T03:37:45.955 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-21T03:37:45.966 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-21T03:37:46.145 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-21T03:37:46.146 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-21T03:37:46.323 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-21T03:37:46.335 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-21T03:37:46.501 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-21T03:37:46.512 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-21T03:37:46.689 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-21T03:37:46.691 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-21T03:37:46.867 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-21T03:37:46.869 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-21T03:37:47.055 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-21T03:37:47.056 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-21T03:37:47.244 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-21T03:37:47.245 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-21T03:37:47.437 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-21T03:37:47.517 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:47 +0000 (0:00:28.053) 0:01:04.634 ******* 2021-11-21T03:37:47.539 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:47 +0000 (0:00:00.021) 0:01:04.656 ******* 2021-11-21T03:37:47.623 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-21T03:37:47.625 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.635 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.636 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.647 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.649 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.659 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.661 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62 2021-11-21T03:37:47.662 INFO:teuthology.task.ansible.out:e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.671 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.673 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.682 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.684 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.694 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.870 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-21T03:37:47.872 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e19 2021-11-21T03:37:47.874 INFO:teuthology.task.ansible.out:02a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.883 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:47.884 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.060 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-21T03:37:48.061 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-21T03:37:48.238 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-11-21T03:37:48.239 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-11-21T03:37:48.239 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada2 2021-11-21T03:37:48.241 INFO:teuthology.task.ansible.out:8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.251 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.252 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.263 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.264 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.275 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.276 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e 2021-11-21T03:37:48.278 INFO:teuthology.task.ansible.out:28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.287 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.288 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.288 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.289 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": 2021-11-21T03:37:48.290 INFO:teuthology.task.ansible.out:"jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.299 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.301 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.311 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.312 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.324 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.335 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.336 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.338 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.348 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.349 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.351 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.352 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.363 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.364 INFO:teuthology.task.ansible.out: skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.366 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.376 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.377 INFO:teuthology.task.ansible.out: 2021-11-21T03:37:48.378 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.380 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.382 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.392 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.393 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.394 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.405 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.406 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.407 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjd 2021-11-21T03:37:48.408 INFO:teuthology.task.ansible.out:Liw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.417 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.419 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.429 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.431 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.441 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.443 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.454 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.455 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.456 INFO:teuthology.task.ansible.out: skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.467 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.468 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.469 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.480 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.482 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.492 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.494 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.503 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.505 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.515 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.516 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.517 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.517 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.518 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H 2021-11-21T03:37:48.519 INFO:teuthology.task.ansible.out:4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.528 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.530 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.530 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.541 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.543 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.554 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.555 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.556 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.557 INFO:teuthology.task.ansible.out: 2021-11-21T03:37:48.567 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.569 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.579 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.580 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.591 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.593 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.604 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.605 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.616 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.617 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.627 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.628 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.629 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.630 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.640 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.642 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.652 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.653 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.664 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.665 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.676 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.678 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.688 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.690 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.700 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.701 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.711 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.713 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.723 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.725 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.735 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.737 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.747 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.749 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.749 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.760 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.761 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.772 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.773 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.784 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.785 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.795 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.797 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.808 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.809 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.820 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.821 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.832 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.833 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.844 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.846 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.856 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.858 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.869 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.870 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.880 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.882 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.884 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.894 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.895 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.906 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.908 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.917 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.919 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.929 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.931 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.942 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.943 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.954 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.955 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.966 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.968 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.978 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.980 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.989 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:48.991 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.001 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.003 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.013 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.015 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.026 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.027 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.038 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.038 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.039 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.039 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.050 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.052 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.062 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.064 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.074 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.076 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.086 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.087 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.098 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.100 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.110 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.112 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.122 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.124 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.134 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.136 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.146 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.147 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.147 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.148 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.159 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.161 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.217 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:49 +0000 (0:00:01.678) 0:01:06.335 ******* 2021-11-21T03:37:49.236 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:49 +0000 (0:00:00.018) 0:01:06.354 ******* 2021-11-21T03:37:49.285 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-11-21T03:37:49.286 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.307 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:49 +0000 (0:00:00.070) 0:01:06.424 ******* 2021-11-21T03:37:49.313 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:37:49.337 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:37:49 +0000 (0:00:00.029) 0:01:06.454 ******* 2021-11-21T03:37:49.530 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-21T03:37:49.532 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-21T03:37:49.564 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-21T03:37:49.679 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-21T03:37:49.712 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-21T03:37:49.837 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-21T03:37:49.859 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-21T03:37:49.989 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-21T03:37:50.011 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-21T03:37:50.135 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-21T03:37:50.167 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-21T03:37:50.281 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-21T03:37:50.314 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-21T03:37:50.438 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-21T03:37:50.459 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-21T03:37:50.594 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-21T03:37:50.616 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-21T03:37:50.761 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-21T03:37:50.784 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-21T03:37:50.919 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-21T03:37:50.930 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-21T03:37:51.064 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-21T03:37:51.086 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-21T03:37:51.210 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-21T03:37:51.232 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-21T03:37:51.357 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-21T03:37:51.378 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-21T03:37:51.513 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-21T03:37:51.535 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-21T03:37:51.659 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-21T03:37:51.681 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-21T03:37:51.816 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-21T03:37:51.837 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-21T03:37:51.962 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-21T03:37:51.984 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-21T03:37:52.109 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-21T03:37:52.130 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-21T03:37:52.255 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-21T03:37:52.287 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-21T03:37:52.402 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-21T03:37:52.433 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-21T03:37:52.558 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-21T03:37:52.580 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-21T03:37:52.704 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-21T03:37:52.736 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-21T03:37:52.850 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-21T03:37:52.882 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-21T03:37:53.006 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-21T03:37:53.027 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-21T03:37:53.152 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-21T03:37:53.183 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-21T03:37:53.298 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-21T03:37:53.329 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-21T03:37:53.454 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-21T03:37:53.486 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-21T03:37:53.600 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-21T03:37:53.632 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-21T03:37:53.756 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-21T03:37:53.778 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-21T03:37:53.905 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-21T03:37:53.927 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-21T03:37:54.061 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-21T03:37:54.083 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-21T03:37:54.207 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-21T03:37:54.229 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-21T03:37:54.354 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-21T03:37:54.375 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-21T03:37:54.510 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-21T03:37:54.532 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-21T03:37:54.656 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-21T03:37:54.678 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-21T03:37:54.813 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-21T03:37:54.834 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-21T03:37:54.959 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-21T03:37:54.981 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-21T03:37:55.106 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-21T03:37:55.127 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-21T03:37:55.252 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-21T03:37:55.273 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-21T03:37:56.563 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-11-21T03:37:56.564 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-11-21T03:37:57.669 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-11-21T03:37:57.888 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-11-21T03:37:58.903 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-11-21T03:37:59.264 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-11-21T03:38:00.008 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-11-21T03:38:00.556 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-11-21T03:38:01.217 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-11-21T03:38:01.888 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-11-21T03:38:02.506 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-11-21T03:38:02.662 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-21T03:38:02.818 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-21T03:38:02.964 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-21T03:38:03.006 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-11-21T03:38:03.121 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-21T03:38:03.235 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-21T03:38:03.277 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-21T03:38:03.393 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-21T03:38:03.425 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-21T03:38:03.550 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-21T03:38:03.582 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-21T03:38:03.697 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-21T03:38:03.728 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-21T03:38:03.843 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-21T03:38:03.885 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-21T03:38:03.999 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-21T03:38:04.031 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-21T03:38:04.087 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:04 +0000 (0:00:14.750) 0:01:21.204 ******* 2021-11-21T03:38:04.147 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-21T03:38:04.304 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-21T03:38:04.450 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-21T03:38:04.545 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637465884.1762958-10929-149636494643256/source", "state": "file", "uid": 0} 2021-11-21T03:38:04.566 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:04 +0000 (0:00:00.479) 0:01:21.684 ******* 2021-11-21T03:38:04.604 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-21T03:38:04.605 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-21T03:38:04.637 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-21T03:38:04.639 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => { "msg": "Host gibba022.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2021-11-21T03:38:04.659 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:04 +0000 (0:00:00.092) 0:01:21.777 ******* 2021-11-21T03:38:04.678 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:04 +0000 (0:00:00.018) 0:01:21.795 ******* 2021-11-21T03:38:04.738 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-21T03:38:04.740 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2021-11-21T03:38:04.762 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:04 +0000 (0:00:00.083) 0:01:21.879 ******* 2021-11-21T03:38:04.831 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-11-21T03:38:04.832 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:04.853 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:04 +0000 (0:00:00.091) 0:01:21.971 ******* 2021-11-21T03:38:05.153 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-21T03:38:05.154 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637465884.7906356-10976-215247641391550/source", "state": "file", "uid": 0} 2021-11-21T03:38:05.176 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:05 +0000 (0:00:00.322) 0:01:22.293 ******* 2021-11-21T03:38:05.247 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-21T03:38:05.249 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => { "msg": "Host gibba043.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2021-11-21T03:38:05.269 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:05 +0000 (0:00:00.092) 0:01:22.387 ******* 2021-11-21T03:38:05.347 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-21T03:38:05.349 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2021-11-21T03:38:05.371 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:05 +0000 (0:00:00.102) 0:01:22.489 ******* 2021-11-21T03:38:05.440 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-11-21T03:38:05.441 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.396606", "end": "2021-11-21 03:38:05.428615", "rc": 0, "start": "2021-11-21 03:38:05.032009", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-21T03:38:05.462 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:05 +0000 (0:00:00.090) 0:01:22.580 ******* 2021-11-21T03:38:05.482 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:05 +0000 (0:00:00.019) 0:01:22.599 ******* 2021-11-21T03:38:05.529 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-21T03:38:05.531 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:05.552 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:05 +0000 (0:00:00.070) 0:01:22.670 ******* 2021-11-21T03:38:05.630 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-11-21T03:38:05.632 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:05.652 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:05 +0000 (0:00:00.099) 0:01:22.769 ******* 2021-11-21T03:38:05.720 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-21T03:38:05.722 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:05.741 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:05 +0000 (0:00:00.089) 0:01:22.859 ******* 2021-11-21T03:38:05.808 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-11-21T03:38:05.810 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:05.830 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:05 +0000 (0:00:00.088) 0:01:22.948 ******* 2021-11-21T03:38:05.898 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-11-21T03:38:05.900 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:05.919 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:05 +0000 (0:00:00.089) 0:01:23.037 ******* 2021-11-21T03:38:06.010 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-11-21T03:38:06.012 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2021-11-21T03:38:06.032 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:06 +0000 (0:00:00.113) 0:01:23.150 ******* 2021-11-21T03:38:06.102 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-11-21T03:38:06.103 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.421391", "end": "2021-11-21 03:38:06.083149", "rc": 0, "start": "2021-11-21 03:38:05.661758", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-21T03:38:06.124 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:06 +0000 (0:00:00.091) 0:01:23.241 ******* 2021-11-21T03:38:06.130 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-11-21T03:38:06.132 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [gibba022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-21T03:38:06.156 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:06 +0000 (0:00:00.030) 0:01:23.272 ******* 2021-11-21T03:38:06.193 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-21T03:38:06.195 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:06.216 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:06 +0000 (0:00:00.061) 0:01:23.333 ******* 2021-11-21T03:38:06.233 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-11-21T03:38:06.234 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2021-11-21T03:38:06.256 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:06 +0000 (0:00:00.040) 0:01:23.373 ******* 2021-11-21T03:38:06.284 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-11-21T03:38:06.285 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:06.306 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:06 +0000 (0:00:00.050) 0:01:23.424 ******* 2021-11-21T03:38:06.386 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-21T03:38:06.388 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:06.408 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:06 +0000 (0:00:00.101) 0:01:23.526 ******* 2021-11-21T03:38:06.498 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-11-21T03:38:06.500 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:06.524 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:06 +0000 (0:00:00.115) 0:01:23.641 ******* 2021-11-21T03:38:06.604 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-11-21T03:38:06.605 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:06.625 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:06 +0000 (0:00:00.100) 0:01:23.742 ******* 2021-11-21T03:38:06.714 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-11-21T03:38:06.716 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2021-11-21T03:38:06.737 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:06 +0000 (0:00:00.112) 0:01:23.855 ******* 2021-11-21T03:38:06.826 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-11-21T03:38:06.827 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [gibba043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-21T03:38:06.848 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:06 +0000 (0:00:00.110) 0:01:23.965 ******* 2021-11-21T03:38:06.927 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2021-11-21T03:38:06.948 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:06 +0000 (0:00:00.099) 0:01:24.065 ******* 2021-11-21T03:38:07.316 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-21T03:38:07.318 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1637465887.2065406-wkz73shg/katello-ca-consumer-latest.noarchebsaf8th.rpm"]} 2021-11-21T03:38:07.339 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:07 +0000 (0:00:00.391) 0:01:24.457 ******* 2021-11-21T03:38:07.713 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1637465887.6059294-r5_hu83t/katello-ca-consumer-latest.noarchz2h2iuu_.rpm"]} 2021-11-21T03:38:07.736 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:07 +0000 (0:00:00.396) 0:01:24.853 ******* 2021-11-21T03:38:07.836 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-11-21T03:38:07.838 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "a626a25b7b500f9214acf310b1376506a11f0de8", "dest": "/etc/yum/vars/releasever", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/yum/vars/releasever", "secontext": "system_u:object_r:etc_t:s0", "size": 3, "state": "file", "uid": 0} 2021-11-21T03:38:07.860 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:07 +0000 (0:00:00.124) 0:01:24.977 ******* 2021-11-21T03:38:08.153 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "a626a25b7b500f9214acf310b1376506a11f0de8", "dest": "/etc/yum/vars/releasever", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/yum/vars/releasever", "secontext": "system_u:object_r:etc_t:s0", "size": 3, "state": "file", "uid": 0} 2021-11-21T03:38:08.175 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:08 +0000 (0:00:00.315) 0:01:25.293 ******* 2021-11-21T03:38:08.316 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-11-21T03:38:08.317 INFO:teuthology.task.ansible.out:fatal: [gibba022.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2021-11-21T03:38:08.339 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:08 +0000 (0:00:00.163) 0:01:25.456 ******* 2021-11-21T03:38:08.417 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-11-21T03:38:08.419 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2021-11-21T03:38:08.442 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:08 +0000 (0:00:00.102) 0:01:25.559 ******* 2021-11-21T03:38:08.665 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-11-21T03:38:08.667 INFO:teuthology.task.ansible.out:fatal: [gibba043.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2021-11-21T03:38:08.688 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:08 +0000 (0:00:00.245) 0:01:25.805 ******* 2021-11-21T03:38:08.766 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-11-21T03:38:08.768 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2021-11-21T03:38:08.788 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:08 +0000 (0:00:00.100) 0:01:25.905 ******* 2021-11-21T03:38:24.762 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [gibba043.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-11-21T03:38:24.784 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:24 +0000 (0:00:15.995) 0:01:41.901 ******* 2021-11-21T03:38:24.862 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-21T03:38:24.864 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2021-11-21T03:38:24.884 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:24 +0000 (0:00:00.100) 0:01:42.002 ******* 2021-11-21T03:38:24.944 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [gibba022.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-11-21T03:38:24.968 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:24 +0000 (0:00:00.083) 0:01:42.085 ******* 2021-11-21T03:38:25.059 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2021-11-21T03:38:25.082 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:25 +0000 (0:00:00.114) 0:01:42.199 ******* 2021-11-21T03:38:25.373 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-11-21T03:38:25.375 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.287798", "end": "2021-11-21 03:38:25.351623", "failed_when_result": false, "rc": 0, "start": "2021-11-21 03:38:25.063825", "stderr": "", "stderr_lines": [], "stdout": "7.8\n7.9\n7Server\n8\n8.2\n8.3\n8.4", "stdout_lines": ["7.8", "7.9", "7Server", "8", "8.2", "8.3", "8.4"]} 2021-11-21T03:38:25.401 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:25 +0000 (0:00:00.318) 0:01:42.518 ******* 2021-11-21T03:38:25.476 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-11-21T03:38:25.477 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:25.498 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:25 +0000 (0:00:00.097) 0:01:42.616 ******* 2021-11-21T03:38:25.567 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-11-21T03:38:25.569 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:25.589 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:25 +0000 (0:00:00.091) 0:01:42.707 ******* 2021-11-21T03:38:25.596 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-11-21T03:38:25.597 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.287377", "end": "2021-11-21 03:38:25.561526", "failed_when_result": false, "rc": 0, "start": "2021-11-21 03:38:25.274149", "stderr": "", "stderr_lines": [], "stdout": "7.8\n7.9\n7Server\n8\n8.2\n8.3\n8.4", "stdout_lines": ["7.8", "7.9", "7Server", "8", "8.2", "8.3", "8.4"]} 2021-11-21T03:38:25.621 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:25 +0000 (0:00:00.031) 0:01:42.738 ******* 2021-11-21T03:38:25.659 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-11-21T03:38:25.661 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-21T03:38:25.683 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:25 +0000 (0:00:00.061) 0:01:42.800 ******* 2021-11-21T03:38:25.700 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-11-21T03:38:25.701 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:25.723 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:25 +0000 (0:00:00.040) 0:01:42.841 ******* 2021-11-21T03:38:25.751 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-21T03:38:25.753 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:25.775 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:25 +0000 (0:00:00.051) 0:01:42.893 ******* 2021-11-21T03:38:25.803 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-11-21T03:38:25.805 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:25.826 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:25 +0000 (0:00:00.050) 0:01:42.944 ******* 2021-11-21T03:38:25.895 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-11-21T03:38:25.897 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-21T03:38:25.918 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:25 +0000 (0:00:00.092) 0:01:43.036 ******* 2021-11-21T03:38:25.998 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-21T03:38:26.000 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:26.030 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:26 +0000 (0:00:00.111) 0:01:43.148 ******* 2021-11-21T03:38:28.087 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-11-21T03:38:28.089 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.119531", "end": "2021-11-21 03:38:28.076802", "rc": 0, "start": "2021-11-21 03:38:25.957271", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2021-11-21T03:38:28.109 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:28 +0000 (0:00:02.078) 0:01:45.226 ******* 2021-11-21T03:38:28.191 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-11-21T03:38:28.193 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2021-11-21T03:38:28.214 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:28 +0000 (0:00:00.105) 0:01:45.332 ******* 2021-11-21T03:38:28.282 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-11-21T03:38:28.284 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:28.303 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:28 +0000 (0:00:00.089) 0:01:45.421 ******* 2021-11-21T03:38:28.329 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-11-21T03:38:28.331 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.094485", "end": "2021-11-21 03:38:28.310215", "rc": 0, "start": "2021-11-21 03:38:26.215730", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2021-11-21T03:38:28.353 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:28 +0000 (0:00:00.049) 0:01:45.471 ******* 2021-11-21T03:38:28.380 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-21T03:38:28.382 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2021-11-21T03:38:28.403 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:28 +0000 (0:00:00.049) 0:01:45.520 ******* 2021-11-21T03:38:28.429 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-11-21T03:38:28.431 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2021-11-21T03:38:28.452 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:28 +0000 (0:00:00.049) 0:01:45.570 ******* 2021-11-21T03:38:28.480 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-11-21T03:38:28.481 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2021-11-21T03:38:28.502 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:28 +0000 (0:00:00.049) 0:01:45.620 ******* 2021-11-21T03:38:28.529 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-11-21T03:38:28.531 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:28.565 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:28 +0000 (0:00:00.062) 0:01:45.682 ******* 2021-11-21T03:38:28.638 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-21T03:38:28.639 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2021-11-21T03:38:28.660 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:28 +0000 (0:00:00.095) 0:01:45.778 ******* 2021-11-21T03:38:28.740 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2021-11-21T03:38:28.762 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:28 +0000 (0:00:00.101) 0:01:45.879 ******* 2021-11-21T03:38:30.809 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-11-21T03:38:30.811 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-11-21T03:38:30.831 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:30 +0000 (0:00:02.069) 0:01:47.948 ******* 2021-11-21T03:38:31.214 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-11-21T03:38:31.236 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:31 +0000 (0:00:00.404) 0:01:48.353 ******* 2021-11-21T03:38:33.907 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:02.872903", "end": "2021-11-21 03:38:33.888491", "rc": 0, "start": "2021-11-21 03:38:31.015588", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2021-11-21T03:38:33.929 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:33 +0000 (0:00:02.693) 0:01:51.047 ******* 2021-11-21T03:38:34.124 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-11-21T03:38:34.126 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2021-11-21T03:38:34.147 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:34 +0000 (0:00:00.217) 0:01:51.264 ******* 2021-11-21T03:38:34.298 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-11-21T03:38:34.300 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:02.861531", "end": "2021-11-21 03:38:34.283365", "rc": 0, "start": "2021-11-21 03:38:31.421834", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2021-11-21T03:38:34.325 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:34 +0000 (0:00:00.178) 0:01:51.443 ******* 2021-11-21T03:38:34.343 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-11-21T03:38:34.345 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-21T03:38:34.366 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:34 +0000 (0:00:00.040) 0:01:51.483 ******* 2021-11-21T03:38:34.531 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-11-21T03:38:34.533 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2021-11-21T03:38:34.554 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:34 +0000 (0:00:00.188) 0:01:51.672 ******* 2021-11-21T03:38:34.760 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-11-21T03:38:34.761 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-21T03:38:34.783 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:34 +0000 (0:00:00.228) 0:01:51.900 ******* 2021-11-21T03:38:34.814 INFO:teuthology.task.ansible.out: 2021-11-21T03:38:34.815 INFO:teuthology.task.ansible.out:TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [gibba043.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-11-21T03:38:35.148 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-11-21T03:38:35.174 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:35 +0000 (0:00:00.390) 0:01:52.291 ******* 2021-11-21T03:38:35.212 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-11-21T03:38:35.555 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-11-21T03:38:35.581 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:35 +0000 (0:00:00.407) 0:01:52.698 ******* 2021-11-21T03:38:35.598 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-21T03:38:35.600 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-11-21T03:38:35.960 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-11-21T03:38:35.984 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:35 +0000 (0:00:00.403) 0:01:53.102 ******* 2021-11-21T03:38:36.014 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-11-21T03:38:36.059 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-21T03:38:36.061 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.083 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.099) 0:01:53.201 ******* 2021-11-21T03:38:36.145 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-21T03:38:36.147 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.167 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.083) 0:01:53.284 ******* 2021-11-21T03:38:36.243 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-11-21T03:38:36.244 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.276 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.109) 0:01:53.394 ******* 2021-11-21T03:38:36.350 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-21T03:38:36.352 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.374 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.097) 0:01:53.491 ******* 2021-11-21T03:38:36.383 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-21T03:38:36.385 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-11-21T03:38:36.413 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.039) 0:01:53.530 ******* 2021-11-21T03:38:36.441 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-21T03:38:36.442 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.452 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.454 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.463 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.489 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.075) 0:01:53.606 ******* 2021-11-21T03:38:36.494 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-21T03:38:36.496 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.519 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.030) 0:01:53.637 ******* 2021-11-21T03:38:36.550 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-21T03:38:36.552 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.584 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.064) 0:01:53.702 ******* 2021-11-21T03:38:36.602 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-21T03:38:36.605 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.626 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.041) 0:01:53.744 ******* 2021-11-21T03:38:36.654 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-11-21T03:38:36.656 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.678 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.052) 0:01:53.796 ******* 2021-11-21T03:38:36.696 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-11-21T03:38:36.698 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.720 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.041) 0:01:53.837 ******* 2021-11-21T03:38:36.748 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-11-21T03:38:36.749 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.773 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.051) 0:01:53.889 ******* 2021-11-21T03:38:36.800 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-21T03:38:36.802 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.823 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.052) 0:01:53.941 ******* 2021-11-21T03:38:36.841 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-11-21T03:38:36.842 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.864 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.040) 0:01:53.981 ******* 2021-11-21T03:38:36.892 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** skipping: [gibba022.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.903 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.905 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.927 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.063) 0:01:54.045 ******* 2021-11-21T03:38:36.945 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-21T03:38:36.946 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:36.968 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:36 +0000 (0:00:00.040) 0:01:54.085 ******* 2021-11-21T03:38:36.997 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-21T03:38:36.999 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:37.033 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:37 +0000 (0:00:00.065) 0:01:54.151 ******* 2021-11-21T03:38:37.114 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-11-21T03:38:37.116 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:37.136 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:37 +0000 (0:00:00.102) 0:01:54.253 ******* 2021-11-21T03:38:37.195 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-11-21T03:38:37.197 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:37.219 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:37 +0000 (0:00:00.082) 0:01:54.336 ******* 2021-11-21T03:38:37.276 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-11-21T03:38:37.278 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:37.298 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:37 +0000 (0:00:00.079) 0:01:54.416 ******* 2021-11-21T03:38:37.356 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-21T03:38:37.358 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:37.378 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:37 +0000 (0:00:00.080) 0:01:54.496 ******* 2021-11-21T03:38:37.520 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-11-21T03:38:37.522 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.397646", "end": "2021-11-21 03:38:37.500945", "rc": 0, "start": "2021-11-21 03:38:37.103299", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:38:37.546 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:37 +0000 (0:00:00.167) 0:01:54.663 ******* 2021-11-21T03:38:38.510 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.985567", "end": "2021-11-21 03:38:38.500927", "rc": 0, "start": "2021-11-21 03:38:37.515360", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:38:38.533 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:38 +0000 (0:00:00.987) 0:01:55.651 ******* 2021-11-21T03:38:46.340 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-11-21T03:38:46.342 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:38:46.363 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:46 +0000 (0:00:07.829) 0:02:03.481 ******* 2021-11-21T03:38:46.445 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:46.467 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:46 +0000 (0:00:00.103) 0:02:03.584 ******* 2021-11-21T03:38:46.535 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:46.556 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:46 +0000 (0:00:00.089) 0:02:03.674 ******* 2021-11-21T03:38:46.624 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-21T03:38:46.625 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:46.646 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:46 +0000 (0:00:00.089) 0:02:03.763 ******* 2021-11-21T03:38:46.714 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-11-21T03:38:46.716 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:46.736 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:46 +0000 (0:00:00.090) 0:02:03.854 ******* 2021-11-21T03:38:47.150 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-21T03:38:47.152 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-11-21T03:38:47.172 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:47 +0000 (0:00:00.436) 0:02:04.290 ******* 2021-11-21T03:38:47.355 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-11-21T03:38:47.357 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:38:47.378 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:47 +0000 (0:00:00.205) 0:02:04.496 ******* 2021-11-21T03:38:47.459 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:47.482 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:47 +0000 (0:00:00.103) 0:02:04.599 ******* 2021-11-21T03:38:47.551 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-11-21T03:38:47.553 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:47.584 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:47 +0000 (0:00:00.102) 0:02:04.702 ******* 2021-11-21T03:38:47.655 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-21T03:38:47.657 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:47.683 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:47 +0000 (0:00:00.099) 0:02:04.801 ******* 2021-11-21T03:38:47.754 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:47.777 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:47 +0000 (0:00:00.093) 0:02:04.894 ******* 2021-11-21T03:38:48.190 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-21T03:38:48.192 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-11-21T03:38:48.213 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:48 +0000 (0:00:00.436) 0:02:05.330 ******* 2021-11-21T03:38:49.209 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-21T03:38:49.210 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:38:49.232 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:49 +0000 (0:00:01.019) 0:02:06.350 ******* 2021-11-21T03:38:49.668 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-21T03:38:49.669 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-11-21T03:38:50.188 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-11-21T03:38:50.272 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-21T03:38:50.273 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:38:50.294 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:50 +0000 (0:00:01.061) 0:02:07.412 ******* 2021-11-21T03:38:50.523 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-21T03:38:50.525 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-11-21T03:38:50.548 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:50 +0000 (0:00:00.253) 0:02:07.665 ******* 2021-11-21T03:38:50.700 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-21T03:38:50.702 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-21T03:38:50.722 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:50 +0000 (0:00:00.174) 0:02:07.839 ******* 2021-11-21T03:38:50.741 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [gibba022.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-11-21T03:38:51.077 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-11-21T03:38:51.153 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [gibba043.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-11-21T03:38:51.406 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-21T03:38:51.407 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-11-21T03:38:51.443 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:51 +0000 (0:00:00.721) 0:02:08.561 ******* 2021-11-21T03:38:51.500 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [gibba043.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-11-21T03:38:51.607 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-21T03:38:51.628 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:51 +0000 (0:00:00.184) 0:02:08.746 ******* 2021-11-21T03:38:51.845 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-21T03:38:51.847 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "state": "file", "uid": 0} 2021-11-21T03:38:51.906 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:51 +0000 (0:00:00.277) 0:02:09.024 ******* 2021-11-21T03:38:51.945 INFO:teuthology.task.ansible.out: TASK [common : Include dnf_system vars] **************************************** ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/dnf_systems.yml"], "changed": false} 2021-11-21T03:38:51.969 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:51 +0000 (0:00:00.060) 0:02:09.084 ******* 2021-11-21T03:38:52.058 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-21T03:38:52.060 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-11-21T03:38:52.124 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-21T03:38:52.125 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-11-21T03:38:52.147 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:52 +0000 (0:00:00.180) 0:02:09.265 ******* 2021-11-21T03:38:52.206 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-21T03:38:52.207 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:52.209 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:52.219 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:52.230 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:52.253 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:52 +0000 (0:00:00.105) 0:02:09.371 ******* 2021-11-21T03:38:52.400 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-21T03:38:52.402 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-11-21T03:38:52.761 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "state": "file", "uid": 0} 2021-11-21T03:38:52.789 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:52 +0000 (0:00:00.536) 0:02:09.907 ******* 2021-11-21T03:38:52.828 INFO:teuthology.task.ansible.out: TASK [common : Include dnf_system vars] **************************************** 2021-11-21T03:38:52.830 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/dnf_systems.yml"], "changed": false} 2021-11-21T03:38:52.850 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:52 +0000 (0:00:00.060) 0:02:09.967 ******* 2021-11-21T03:38:53.004 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-21T03:38:53.006 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-11-21T03:38:53.025 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:53 +0000 (0:00:00.175) 0:02:10.143 ******* 2021-11-21T03:38:53.073 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-21T03:38:53.075 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:53.086 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:53.097 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:53.108 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:53.135 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:53 +0000 (0:00:00.109) 0:02:10.252 ******* 2021-11-21T03:38:54.296 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-21T03:38:54.298 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:38:54.319 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:54 +0000 (0:00:01.184) 0:02:11.437 ******* 2021-11-21T03:38:54.346 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-21T03:38:54.348 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:54.368 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:54 +0000 (0:00:00.048) 0:02:11.485 ******* 2021-11-21T03:38:54.740 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-21T03:38:54.742 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-11-21T03:38:54.764 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:54 +0000 (0:00:00.395) 0:02:11.881 ******* 2021-11-21T03:38:55.150 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-21T03:38:55.152 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-11-21T03:38:55.174 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:55 +0000 (0:00:00.410) 0:02:12.292 ******* 2021-11-21T03:38:55.212 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-21T03:38:55.214 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:55.224 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:55.246 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:55 +0000 (0:00:00.071) 0:02:12.363 ******* 2021-11-21T03:38:55.252 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-21T03:38:55.254 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:38:55.276 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:55 +0000 (0:00:00.030) 0:02:12.394 ******* 2021-11-21T03:38:55.313 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-21T03:38:55.315 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:55.340 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:55 +0000 (0:00:00.064) 0:02:12.458 ******* 2021-11-21T03:38:55.401 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-21T03:38:55.402 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-21T03:38:55.424 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:55 +0000 (0:00:00.083) 0:02:12.542 ******* 2021-11-21T03:38:55.661 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-21T03:38:55.663 INFO:teuthology.task.ansible.out:fatal: [gibba043.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-11-21T03:38:55.684 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:55 +0000 (0:00:00.259) 0:02:12.801 ******* 2021-11-21T03:38:55.722 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-21T03:38:55.724 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:55.746 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:55 +0000 (0:00:00.062) 0:02:12.864 ******* 2021-11-21T03:38:55.765 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:55 +0000 (0:00:00.019) 0:02:12.883 ******* 2021-11-21T03:38:56.132 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-21T03:38:56.134 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-11-21T03:38:56.156 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:56 +0000 (0:00:00.390) 0:02:13.273 ******* 2021-11-21T03:38:56.165 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-21T03:38:56.166 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-11-21T03:38:56.192 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:56 +0000 (0:00:00.036) 0:02:13.309 ******* 2021-11-21T03:38:56.199 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-21T03:38:56.201 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:56.211 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-11-21T03:38:56.241 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:56 +0000 (0:00:00.048) 0:02:13.358 ******* 2021-11-21T03:38:56.399 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-21T03:38:56.407 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-21T03:38:56.428 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:56 +0000 (0:00:00.186) 0:02:13.545 ******* 2021-11-21T03:38:56.656 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [gibba022.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-11-21T03:38:56.678 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:56 +0000 (0:00:00.250) 0:02:13.795 ******* 2021-11-21T03:38:56.705 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-11-21T03:38:56.707 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:38:56.729 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:56 +0000 (0:00:00.050) 0:02:13.846 ******* 2021-11-21T03:38:56.787 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-21T03:38:56.788 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1183", "ExecMainStartTimestamp": "Sun 2021-11-21 03:36:13 UTC", "ExecMainStartTimestampMonotonic": "21162681", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Sun 2021-11-21 03:36:13 UTC] ; stop_time=[n/a] ; pid=1183 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "984", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Li 2021-11-21T03:38:56.790 INFO:teuthology.task.ansible.out:mitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127285", "LimitNPROCSoft": "127285", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127285", "LimitSIGPENDINGSoft": "127285", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "1183", "MemoryAccounting": "yes", "MemoryCurrent": "671744", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "on-abort", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203656", "TimeoutStart 2021-11-21T03:38:56.792 INFO:teuthology.task.ansible.out:USec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Type": "simple", "UID": "988", "UMask": "0022", "WatchdogTimestamp": "Sun 2021-11-21 03:36:13 UTC", "WatchdogTimestampMonotonic": "21162697", "WatchdogUSec": "0"}} 2021-11-21T03:38:56.815 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:56 +0000 (0:00:00.086) 0:02:13.932 ******* 2021-11-21T03:38:56.967 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-11-21T03:38:56.969 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001094", "end": "2021-11-21 03:38:56.952958", "rc": 0, "start": "2021-11-21 03:38:56.951864", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-11-21T03:38:56.990 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:56 +0000 (0:00:00.174) 0:02:14.107 ******* 2021-11-21T03:38:57.113 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-21T03:38:57.115 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-11-21T03:38:57.137 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:57 +0000 (0:00:00.147) 0:02:14.255 ******* 2021-11-21T03:38:57.396 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-21T03:38:57.397 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1183", "ExecMainStartTimestamp": "Sun 2021-11-21 03:36:06 UTC", "ExecMainStartTimestampMonotonic": "20757245", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Sun 2021-11-21 03:36:06 UTC] ; stop_time=[n/a] ; pid=1183 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "984", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Li 2021-11-21T03:38:57.399 INFO:teuthology.task.ansible.out:mitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127285", "LimitNPROCSoft": "127285", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127285", "LimitSIGPENDINGSoft": "127285", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "1183", "MemoryAccounting": "yes", "MemoryCurrent": "675840", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "on-abort", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203656", "TimeoutStart 2021-11-21T03:38:57.400 INFO:teuthology.task.ansible.out:USec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Type": "simple", "UID": "988", "UMask": "0022", "WatchdogTimestamp": "Sun 2021-11-21 03:36:06 UTC", "WatchdogTimestampMonotonic": "20757260", "WatchdogUSec": "0"}} 2021-11-21T03:38:57.421 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:57 +0000 (0:00:00.283) 0:02:14.539 ******* 2021-11-21T03:38:57.585 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001161", "end": "2021-11-21 03:38:57.566756", "rc": 0, "start": "2021-11-21 03:38:57.565595", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-11-21T03:38:57.608 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:57 +0000 (0:00:00.186) 0:02:14.725 ******* 2021-11-21T03:38:59.033 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-11-21T03:38:59.035 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:38:59.056 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:59 +0000 (0:00:01.448) 0:02:16.173 ******* 2021-11-21T03:38:59.624 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:38:59.647 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:38:59 +0000 (0:00:00.591) 0:02:16.765 ******* 2021-11-21T03:39:01.146 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:39:01.169 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:01 +0000 (0:00:01.522) 0:02:18.287 ******* 2021-11-21T03:39:01.718 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:39:01.743 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:01 +0000 (0:00:00.573) 0:02:18.860 ******* 2021-11-21T03:39:02.064 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-11-21T03:39:02.067 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-11-21T03:39:02.091 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:02 +0000 (0:00:00.347) 0:02:19.208 ******* 2021-11-21T03:39:02.338 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-11-21T03:39:02.361 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:02 +0000 (0:00:00.270) 0:02:19.478 ******* 2021-11-21T03:39:11.708 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-11-21T03:39:11.710 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:09.456420", "end": "2021-11-21 03:39:11.690917", "failed_when_result": false, "rc": 0, "start": "2021-11-21 03:39:02.234497", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-11-21T03:39:11.731 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:11 +0000 (0:00:09.370) 0:02:28.849 ******* 2021-11-21T03:39:11.982 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:09.460425", "end": "2021-11-21 03:39:11.961999", "failed_when_result": false, "rc": 0, "start": "2021-11-21 03:39:02.501574", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-11-21T03:39:12.006 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:11 +0000 (0:00:00.275) 0:02:29.124 ******* 2021-11-21T03:39:12.110 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-21T03:39:12.112 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-11-21T03:39:12.134 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:12 +0000 (0:00:00.127) 0:02:29.251 ******* 2021-11-21T03:39:12.310 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-11-21T03:39:12.312 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013174", "end": "2021-11-21 03:39:12.291410", "rc": 0, "start": "2021-11-21 03:39:12.278236", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:39:12.334 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:12 +0000 (0:00:00.199) 0:02:29.451 ******* 2021-11-21T03:39:12.393 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-21T03:39:12.396 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-11-21T03:39:12.418 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:12 +0000 (0:00:00.083) 0:02:29.535 ******* 2021-11-21T03:39:12.508 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-11-21T03:39:12.510 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.006485", "end": "2021-11-21 03:39:12.491300", "rc": 0, "start": "2021-11-21 03:39:12.484815", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:39:12.547 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:12 +0000 (0:00:00.128) 0:02:29.664 ******* 2021-11-21T03:39:12.596 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-11-21T03:39:12.598 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.016773", "end": "2021-11-21 03:39:12.579069", "rc": 0, "start": "2021-11-21 03:39:12.562296", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:39:12.620 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:12 +0000 (0:00:00.073) 0:02:29.738 ******* 2021-11-21T03:39:12.796 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-11-21T03:39:12.798 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.001504", "end": "2021-11-21 03:39:12.780155", "rc": 0, "start": "2021-11-21 03:39:12.778651", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:39:12.820 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:12 +0000 (0:00:00.199) 0:02:29.937 ******* 2021-11-21T03:39:22.384 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-11-21T03:39:22.386 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:09.405251", "end": "2021-11-21 03:39:22.364947", "rc": 0, "start": "2021-11-21 03:39:12.959696", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:39:22.409 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:22 +0000 (0:00:09.589) 0:02:39.526 ******* 2021-11-21T03:39:22.416 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:09.701650", "end": "2021-11-21 03:39:22.389888", "rc": 0, "start": "2021-11-21 03:39:12.688238", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:39:22.450 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:22 +0000 (0:00:00.041) 0:02:39.567 ******* 2021-11-21T03:39:22.583 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-11-21T03:39:22.585 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-11-21T03:39:22.608 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:22 +0000 (0:00:00.158) 0:02:39.726 ******* 2021-11-21T03:39:22.628 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-11-21T03:39:22.656 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:22 +0000 (0:00:00.042) 0:02:39.768 ******* 2021-11-21T03:39:22.658 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-11-21T03:39:22.660 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-11-21T03:39:22.690 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:22 +0000 (0:00:00.039) 0:02:39.808 ******* 2021-11-21T03:39:22.699 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-11-21T03:39:22.724 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:22 +0000 (0:00:00.032) 0:02:39.840 ******* 2021-11-21T03:39:22.740 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-11-21T03:39:22.742 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-21T03:39:22.764 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:22 +0000 (0:00:00.041) 0:02:39.881 ******* 2021-11-21T03:39:22.771 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-21T03:39:22.796 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:22 +0000 (0:00:00.032) 0:02:39.913 ******* 2021-11-21T03:39:22.815 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-11-21T03:39:22.817 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"apache-arrow": {"baseurl": "https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch", "enabled": 1, "gpgcheck": 1, "name": "Apache Arrow"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "redhat-lsb", "firewalld", "wget", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "make", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2021-11-21T03:39:22.844 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:22 +0000 (0:00:00.048) 0:02:39.962 ******* 2021-11-21T03:39:22.856 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"apache-arrow": {"baseurl": "https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch", "enabled": 1, "gpgcheck": 1, "name": "Apache Arrow"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "redhat-lsb", "firewalld", "wget", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "make", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2021-11-21T03:39:22.883 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:22 +0000 (0:00:00.038) 0:02:40.000 ******* 2021-11-21T03:39:22.905 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [gibba022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-21T03:39:22.927 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:22 +0000 (0:00:00.043) 0:02:40.044 ******* 2021-11-21T03:39:22.945 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-21T03:39:22.971 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:22 +0000 (0:00:00.044) 0:02:40.089 ******* 2021-11-21T03:39:23.085 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-11-21T03:39:23.086 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-11-21T03:39:23.112 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:23 +0000 (0:00:00.141) 0:02:40.230 ******* 2021-11-21T03:39:23.132 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-11-21T03:39:23.166 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:23 +0000 (0:00:00.053) 0:02:40.284 ******* 2021-11-21T03:39:23.269 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-21T03:39:23.270 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "gid": 1255, "name": "ubuntu", "state": "present", "system": false} 2021-11-21T03:39:23.293 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:23 +0000 (0:00:00.127) 0:02:40.411 ******* 2021-11-21T03:39:23.322 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-11-21T03:39:23.324 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:23.344 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:23 +0000 (0:00:00.050) 0:02:40.462 ******* 2021-11-21T03:39:23.351 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-21T03:39:23.353 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 1255, "name": "ubuntu", "state": "present", "system": false} 2021-11-21T03:39:23.374 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:23 +0000 (0:00:00.029) 0:02:40.491 ******* 2021-11-21T03:39:23.381 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:23.403 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:23 +0000 (0:00:00.029) 0:02:40.521 ******* 2021-11-21T03:39:23.411 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:23.435 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:23 +0000 (0:00:00.031) 0:02:40.552 ******* 2021-11-21T03:39:23.474 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-21T03:39:23.475 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:23.495 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:23 +0000 (0:00:00.060) 0:02:40.613 ******* 2021-11-21T03:39:23.575 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-21T03:39:23.577 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-11-21T03:39:23.598 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:23 +0000 (0:00:00.102) 0:02:40.716 ******* 2021-11-21T03:39:23.680 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-11-21T03:39:23.713 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:23 +0000 (0:00:00.114) 0:02:40.831 ******* 2021-11-21T03:39:24.088 INFO:teuthology.task.ansible.out: 2021-11-21T03:39:24.090 INFO:teuthology.task.ansible.out:TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-11-21T03:39:24.118 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:24 +0000 (0:00:00.405) 0:02:41.236 ******* 2021-11-21T03:39:24.158 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-21T03:39:24.160 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba022"}, "changed": false} 2021-11-21T03:39:24.185 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:24 +0000 (0:00:00.065) 0:02:41.301 ******* 2021-11-21T03:39:24.212 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-21T03:39:24.215 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-11-21T03:39:24.238 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:24 +0000 (0:00:00.054) 0:02:41.355 ******* 2021-11-21T03:39:24.276 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-21T03:39:24.278 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba043"}, "changed": false} 2021-11-21T03:39:24.301 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:24 +0000 (0:00:00.061) 0:02:41.417 ******* 2021-11-21T03:39:25.055 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-21T03:39:25.057 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "gibba043", "ansible_hostname": "gibba043", "ansible_nodename": "gibba043"}, "changed": false, "name": "gibba043"} ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "gibba022", "ansible_hostname": "gibba022", "ansible_nodename": "gibba022"}, "changed": false, "name": "gibba022"} 2021-11-21T03:39:25.083 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:25 +0000 (0:00:00.783) 0:02:42.200 ******* 2021-11-21T03:39:25.105 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:25 +0000 (0:00:00.022) 0:02:42.222 ******* 2021-11-21T03:39:25.456 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-11-21T03:39:25.487 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:25 +0000 (0:00:00.381) 0:02:42.604 ******* 2021-11-21T03:39:25.498 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-11-21T03:39:25.533 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:25 +0000 (0:00:00.046) 0:02:42.650 ******* 2021-11-21T03:39:25.847 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-21T03:39:25.848 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-11-21T03:39:25.872 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:25 +0000 (0:00:00.339) 0:02:42.989 ******* 2021-11-21T03:39:25.912 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-11-21T03:39:25.937 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:25 +0000 (0:00:00.064) 0:02:43.054 ******* 2021-11-21T03:39:26.332 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-21T03:39:26.333 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-21T03:39:26.356 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:26 +0000 (0:00:00.419) 0:02:43.474 ******* 2021-11-21T03:39:26.416 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-21T03:39:26.447 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:26 +0000 (0:00:00.090) 0:02:43.564 ******* 2021-11-21T03:39:26.766 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-21T03:39:26.768 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-11-21T03:39:26.789 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:26 +0000 (0:00:00.342) 0:02:43.907 ******* 2021-11-21T03:39:26.839 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-11-21T03:39:26.862 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:26 +0000 (0:00:00.072) 0:02:43.979 ******* 2021-11-21T03:39:26.952 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-21T03:39:26.954 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-11-21T03:39:26.979 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:26 +0000 (0:00:00.117) 0:02:44.097 ******* 2021-11-21T03:39:27.019 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-11-21T03:39:27.042 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:27 +0000 (0:00:00.062) 0:02:44.160 ******* 2021-11-21T03:39:27.145 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-21T03:39:27.147 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-11-21T03:39:27.170 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:27 +0000 (0:00:00.127) 0:02:44.287 ******* 2021-11-21T03:39:27.208 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-11-21T03:39:27.233 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:27 +0000 (0:00:00.062) 0:02:44.350 ******* 2021-11-21T03:39:27.345 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-21T03:39:27.346 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1255, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-21T03:39:27.369 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:27 +0000 (0:00:00.135) 0:02:44.486 ******* 2021-11-21T03:39:27.419 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1255, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-21T03:39:27.444 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:27 +0000 (0:00:00.075) 0:02:44.562 ******* 2021-11-21T03:39:27.777 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-21T03:39:27.779 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-11-21T03:39:27.800 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:27 +0000 (0:00:00.356) 0:02:44.918 ******* 2021-11-21T03:39:27.839 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-11-21T03:39:27.863 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:27 +0000 (0:00:00.062) 0:02:44.981 ******* 2021-11-21T03:39:28.196 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-21T03:39:28.198 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-11-21T03:39:28.221 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:28 +0000 (0:00:00.357) 0:02:45.339 ******* 2021-11-21T03:39:28.250 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-11-21T03:39:28.274 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:28 +0000 (0:00:00.052) 0:02:45.392 ******* 2021-11-21T03:39:30.208 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-21T03:39:30.210 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.780171", "end": "2021-11-21 03:39:30.193091", "rc": 0, "start": "2021-11-21 03:39:28.412920", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:39:30.231 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:30 +0000 (0:00:01.956) 0:02:47.348 ******* 2021-11-21T03:39:30.239 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.840722", "end": "2021-11-21 03:39:30.201954", "rc": 0, "start": "2021-11-21 03:39:28.361232", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:39:30.264 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:30 +0000 (0:00:00.033) 0:02:47.381 ******* 2021-11-21T03:39:30.272 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:30.301 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:30 +0000 (0:00:00.037) 0:02:47.419 ******* 2021-11-21T03:39:30.311 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:30.339 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:30 +0000 (0:00:00.036) 0:02:47.455 ******* 2021-11-21T03:39:30.345 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-21T03:39:30.346 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:30.369 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:30 +0000 (0:00:00.031) 0:02:47.486 ******* 2021-11-21T03:39:30.376 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:30.401 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:30 +0000 (0:00:00.031) 0:02:47.518 ******* 2021-11-21T03:39:30.418 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-21T03:39:30.420 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-11-21T03:39:30.443 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:30 +0000 (0:00:00.041) 0:02:47.560 ******* 2021-11-21T03:39:30.450 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-11-21T03:39:30.476 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:30 +0000 (0:00:00.033) 0:02:47.594 ******* 2021-11-21T03:39:30.483 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-21T03:39:30.485 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:30.521 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:30 +0000 (0:00:00.044) 0:02:47.639 ******* 2021-11-21T03:39:30.531 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:30.557 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:30 +0000 (0:00:00.035) 0:02:47.674 ******* 2021-11-21T03:39:30.923 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-21T03:39:30.926 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-11-21T03:39:30.983 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-11-21T03:39:31.352 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'apache-arrow', 'value': {'name': 'Apache Arrow', 'baseurl': 'https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch', 'enabled': 1, 'gpgcheck': 1}}) => {"ansible_loop_var": "item", "changed": true, "checksum": "86b924db6e383ddad921a207c09a708e6cca6a67", "dest": "/etc/yum.repos.d/apache-arrow.repo", "gid": 0, "group": "root", "item": {"key": "apache-arrow", "value": {"baseurl": "https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch", "enabled": 1, "gpgcheck": 1, "name": "Apache Arrow"}}, "md5sum": "183d0889f7213a1e38c7f48965d7549e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 215, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637465970.9571998-16726-225050556077857/source", "state": "file", "uid": 0} 2021-11-21T03:39:31.377 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:31 +0000 (0:00:00.820) 0:02:48.495 ******* 2021-11-21T03:39:31.406 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'apache-arrow', 'value': {'name': 'Apache Arrow', 'baseurl': 'https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch', 'enabled': 1, 'gpgcheck': 1}}) => {"ansible_loop_var": "item", "changed": true, "checksum": "86b924db6e383ddad921a207c09a708e6cca6a67", "dest": "/etc/yum.repos.d/apache-arrow.repo", "gid": 0, "group": "root", "item": {"key": "apache-arrow", "value": {"baseurl": "https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch", "enabled": 1, "gpgcheck": 1, "name": "Apache Arrow"}}, "md5sum": "183d0889f7213a1e38c7f48965d7549e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 215, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637465971.0166798-16728-10762937400802/source", "state": "file", "uid": 0} 2021-11-21T03:39:31.409 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-21T03:39:31.432 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:31 +0000 (0:00:00.055) 0:02:48.550 ******* 2021-11-21T03:39:31.453 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:31 +0000 (0:00:00.020) 0:02:48.570 ******* 2021-11-21T03:39:31.485 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:31 +0000 (0:00:00.031) 0:02:48.602 ******* 2021-11-21T03:39:32.127 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** changed: [gibba043.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.505203", "end": "2021-11-21 03:39:32.110126", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-11-21 03:39:31.604923", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Updating Subscription Management repositories.\nRepository successfully enabled.", "stdout_lines": ["Updating Subscription Management repositories.", "Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2021-11-21T03:39:32.138 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2021-11-21T03:39:32.161 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:32 +0000 (0:00:00.676) 0:02:49.279 ******* 2021-11-21T03:39:32.170 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.506522", "end": "2021-11-21 03:39:32.145697", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-11-21 03:39:31.639175", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Updating Subscription Management repositories.\nRepository successfully enabled.", "stdout_lines": ["Updating Subscription Management repositories.", "Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2021-11-21T03:39:32.208 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:32 +0000 (0:00:00.046) 0:02:49.326 ******* 2021-11-21T03:39:36.730 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:39:36.752 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:36 +0000 (0:00:04.543) 0:02:53.869 ******* 2021-11-21T03:39:36.761 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:39:36.786 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:36 +0000 (0:00:00.033) 0:02:53.903 ******* 2021-11-21T03:39:37.517 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-11-21T03:39:37.519 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": true, "item": "https://download.ceph.com/keys/release.asc"} 2021-11-21T03:39:37.540 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": true, "item": "https://download.ceph.com/keys/release.asc"} 2021-11-21T03:39:37.950 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": true, "item": "https://download.ceph.com/keys/autobuild.asc"} 2021-11-21T03:39:37.994 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": true, "item": "https://download.ceph.com/keys/autobuild.asc"} 2021-11-21T03:39:39.308 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": true, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS"} 2021-11-21T03:39:39.340 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:39 +0000 (0:00:02.553) 0:02:56.456 ******* 2021-11-21T03:39:39.361 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": true, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS"} 2021-11-21T03:39:39.387 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:39 +0000 (0:00:00.048) 0:02:56.505 ******* 2021-11-21T03:39:40.065 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** [WARNING]: Consider using the yum module rather than running 'yum'. If you need to use command because yum is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:00.495455", "end": "2021-11-21 03:39:40.045832", "rc": 0, "start": "2021-11-21 03:39:39.550377", "stderr": "", "stderr_lines": [], "stdout": "Updating Subscription Management repositories.\n54 files removed", "stdout_lines": ["Updating Subscription Management repositories.", "54 files removed"]} changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:00.522164", "end": "2021-11-21 03:39:40.050099", "rc": 0, "start": "2021-11-21 03:39:39.527935", "stderr": "", "stderr_lines": [], "stdout": "Updating Subscription Management repositories.\n54 files removed", "stdout_lines": ["Updating Subscription Management repositories.", "54 files removed"]} 2021-11-21T03:39:40.084 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:40 +0000 (0:00:00.696) 0:02:57.201 ******* 2021-11-21T03:39:40.105 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:40 +0000 (0:00:00.021) 0:02:57.222 ******* 2021-11-21T03:39:40.123 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-21T03:39:40.125 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:40.146 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:40 +0000 (0:00:00.040) 0:02:57.263 ******* 2021-11-21T03:39:40.154 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:40.180 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:40 +0000 (0:00:00.034) 0:02:57.298 ******* 2021-11-21T03:39:40.189 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-11-21T03:39:40.190 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:40.217 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:40 +0000 (0:00:00.036) 0:02:57.334 ******* 2021-11-21T03:39:40.224 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:40.250 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:40 +0000 (0:00:00.033) 0:02:57.368 ******* 2021-11-21T03:39:40.257 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-11-21T03:39:40.259 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:40.285 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:40 +0000 (0:00:00.035) 0:02:57.403 ******* 2021-11-21T03:39:40.292 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:40.317 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:40 +0000 (0:00:00.031) 0:02:57.434 ******* 2021-11-21T03:39:40.449 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-11-21T03:39:40.450 INFO:teuthology.task.ansible.out:fatal: [gibba022.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.005333", "end": "2021-11-21 03:39:40.434527", "msg": "non-zero return code", "rc": 1, "start": "2021-11-21 03:39:40.429194", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-11-21T03:39:40.475 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:40 +0000 (0:00:00.157) 0:02:57.592 ******* 2021-11-21T03:39:40.493 INFO:teuthology.task.ansible.out:fatal: [gibba043.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.005337", "end": "2021-11-21 03:39:40.474000", "msg": "non-zero return code", "rc": 1, "start": "2021-11-21 03:39:40.468663", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-11-21T03:39:40.517 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:40 +0000 (0:00:00.042) 0:02:57.634 ******* 2021-11-21T03:39:40.524 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-11-21T03:39:40.526 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:40.548 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:40 +0000 (0:00:00.031) 0:02:57.666 ******* 2021-11-21T03:39:40.555 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:39:40.579 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:39:40 +0000 (0:00:00.030) 0:02:57.696 ******* 2021-11-21T03:40:08.548 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+10437+1ca0c2ba.5.x86_64"]} 2021-11-21T03:40:08.570 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:40:08 +0000 (0:00:27.991) 0:03:25.688 ******* 2021-11-21T03:40:08.927 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+10437+1ca0c2ba.5.x86_64"]} 2021-11-21T03:40:08.950 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:40:08 +0000 (0:00:00.379) 0:03:26.067 ******* 2021-11-21T03:40:29.162 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-21T03:40:29.164 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-11-21T03:40:29.186 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:40:29 +0000 (0:00:20.235) 0:03:46.303 ******* 2021-11-21T03:40:30.059 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-11-21T03:40:30.084 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:40:30 +0000 (0:00:00.897) 0:03:47.201 ******* 2021-11-21T03:40:50.914 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-21T03:40:50.916 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+10437+1ca0c2ba.5.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64"]} 2021-11-21T03:40:50.942 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:40:50 +0000 (0:00:20.858) 0:04:08.059 ******* 2021-11-21T03:40:51.962 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+10437+1ca0c2ba.5.x86_64"]} 2021-11-21T03:40:51.986 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:40:51 +0000 (0:00:01.044) 0:04:09.103 ******* 2021-11-21T03:40:59.530 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-21T03:40:59.531 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:40:59.554 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:40:59 +0000 (0:00:07.568) 0:04:16.672 ******* 2021-11-21T03:41:00.526 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:41:00.551 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:00 +0000 (0:00:00.996) 0:04:17.668 ******* 2021-11-21T03:41:01.626 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:41:01.651 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:01 +0000 (0:00:01.099) 0:04:18.768 ******* 2021-11-21T03:41:01.679 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-21T03:41:01.681 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:01.701 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:01 +0000 (0:00:00.050) 0:04:18.819 ******* 2021-11-21T03:41:01.962 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-11-21T03:41:01.964 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveState": "inactive", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity" 2021-11-21T03:41:01.965 INFO:teuthology.task.ansible.out:, "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127285", "LimitNPROCSoft": "127285", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127285", "LimitSIGPENDINGSoft": "127285", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203656", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-21T03:41:01.985 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:01 +0000 (0:00:00.284) 0:04:19.103 ******* 2021-11-21T03:41:02.230 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [gibba022.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-11-21T03:41:02.256 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:02 +0000 (0:00:00.270) 0:04:19.374 ******* 2021-11-21T03:41:02.676 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:41:02.722 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:02 +0000 (0:00:00.466) 0:04:19.840 ******* 2021-11-21T03:41:02.764 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-21T03:41:02.765 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:02.785 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:02 +0000 (0:00:00.063) 0:04:19.903 ******* 2021-11-21T03:41:02.889 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-11-21T03:41:02.891 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-11-21T03:41:02.913 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:02 +0000 (0:00:00.127) 0:04:20.031 ******* 2021-11-21T03:41:02.943 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-11-21T03:41:02.944 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:02.971 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:02 +0000 (0:00:00.058) 0:04:20.089 ******* 2021-11-21T03:41:02.999 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-11-21T03:41:03.001 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.023 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.051) 0:04:20.141 ******* 2021-11-21T03:41:03.049 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-11-21T03:41:03.050 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveState": "inactive", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity" 2021-11-21T03:41:03.052 INFO:teuthology.task.ansible.out:, "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127285", "LimitNPROCSoft": "127285", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127285", "LimitSIGPENDINGSoft": "127285", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203656", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-21T03:41:03.072 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.048) 0:04:20.189 ******* 2021-11-21T03:41:03.078 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-11-21T03:41:03.079 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.103 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.031) 0:04:20.220 ******* 2021-11-21T03:41:03.158 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-11-21T03:41:03.160 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.185 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.081) 0:04:20.302 ******* 2021-11-21T03:41:03.224 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.246 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.061) 0:04:20.363 ******* 2021-11-21T03:41:03.273 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-21T03:41:03.275 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.297 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.051) 0:04:20.415 ******* 2021-11-21T03:41:03.317 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-11-21T03:41:03.318 INFO:teuthology.task.ansible.out:fatal: [gibba043.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-11-21T03:41:03.341 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.044) 0:04:20.459 ******* 2021-11-21T03:41:03.349 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-21T03:41:03.372 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.030) 0:04:20.490 ******* 2021-11-21T03:41:03.400 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-21T03:41:03.402 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.423 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.049) 0:04:20.540 ******* 2021-11-21T03:41:03.454 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-11-21T03:41:03.456 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.478 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.054) 0:04:20.594 ******* 2021-11-21T03:41:03.516 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-21T03:41:03.518 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.542 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.065) 0:04:20.660 ******* 2021-11-21T03:41:03.572 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-21T03:41:03.573 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-11-21T03:41:03.595 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.052) 0:04:20.713 ******* 2021-11-21T03:41:03.617 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.021) 0:04:20.735 ******* 2021-11-21T03:41:03.624 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-21T03:41:03.649 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.031) 0:04:20.767 ******* 2021-11-21T03:41:03.657 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.680 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.031) 0:04:20.798 ******* 2021-11-21T03:41:03.694 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.714 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.031) 0:04:20.829 ******* 2021-11-21T03:41:03.728 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-11-21T03:41:03.729 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.752 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.039) 0:04:20.869 ******* 2021-11-21T03:41:03.760 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-11-21T03:41:03.761 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.784 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.032) 0:04:20.902 ******* 2021-11-21T03:41:03.792 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-11-21T03:41:03.794 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.818 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.033) 0:04:20.936 ******* 2021-11-21T03:41:03.828 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-11-21T03:41:03.830 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.854 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.035) 0:04:20.971 ******* 2021-11-21T03:41:03.861 INFO:teuthology.task.ansible.out: 2021-11-21T03:41:03.862 INFO:teuthology.task.ansible.out:TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.895 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.042) 0:04:21.013 ******* 2021-11-21T03:41:03.902 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.930 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.034) 0:04:21.047 ******* 2021-11-21T03:41:03.949 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-11-21T03:41:03.951 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:03.971 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.041) 0:04:21.089 ******* 2021-11-21T03:41:03.977 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-21T03:41:03.980 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.002 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:03 +0000 (0:00:00.030) 0:04:21.119 ******* 2021-11-21T03:41:04.009 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.032 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.030) 0:04:21.149 ******* 2021-11-21T03:41:04.038 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-21T03:41:04.040 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.062 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.030) 0:04:21.180 ******* 2021-11-21T03:41:04.070 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-21T03:41:04.093 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.030) 0:04:21.211 ******* 2021-11-21T03:41:04.099 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-21T03:41:04.101 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.131 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.037) 0:04:21.248 ******* 2021-11-21T03:41:04.140 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-21T03:41:04.142 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.170 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.039) 0:04:21.288 ******* 2021-11-21T03:41:04.178 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.206 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.035) 0:04:21.324 ******* 2021-11-21T03:41:04.215 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-11-21T03:41:04.217 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.241 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.034) 0:04:21.358 ******* 2021-11-21T03:41:04.250 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-21T03:41:04.251 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.283 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.042) 0:04:21.401 ******* 2021-11-21T03:41:04.291 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-21T03:41:04.293 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.325 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.041) 0:04:21.442 ******* 2021-11-21T03:41:04.333 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-21T03:41:04.335 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.361 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.036) 0:04:21.479 ******* 2021-11-21T03:41:04.369 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-21T03:41:04.371 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.394 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.033) 0:04:21.512 ******* 2021-11-21T03:41:04.402 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-21T03:41:04.404 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.426 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.031) 0:04:21.543 ******* 2021-11-21T03:41:04.433 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-21T03:41:04.455 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.029) 0:04:21.573 ******* 2021-11-21T03:41:04.461 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-21T03:41:04.463 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.486 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.031) 0:04:21.604 ******* 2021-11-21T03:41:04.493 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-21T03:41:04.495 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.517 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.030) 0:04:21.635 ******* 2021-11-21T03:41:04.523 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-11-21T03:41:04.525 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.547 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.029) 0:04:21.665 ******* 2021-11-21T03:41:04.554 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-11-21T03:41:04.556 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.578 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.030) 0:04:21.695 ******* 2021-11-21T03:41:04.584 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-21T03:41:04.586 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.610 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.031) 0:04:21.727 ******* 2021-11-21T03:41:04.618 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-11-21T03:41:04.620 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.644 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.034) 0:04:21.762 ******* 2021-11-21T03:41:04.651 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-21T03:41:04.652 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.676 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.031) 0:04:21.793 ******* 2021-11-21T03:41:04.683 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-21T03:41:04.683 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.708 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.032) 0:04:21.825 ******* 2021-11-21T03:41:04.716 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-21T03:41:04.718 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.742 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.033) 0:04:21.859 ******* 2021-11-21T03:41:04.753 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-21T03:41:04.755 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.781 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.035) 0:04:21.894 ******* 2021-11-21T03:41:04.785 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-21T03:41:04.786 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.813 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.035) 0:04:21.930 ******* 2021-11-21T03:41:04.820 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-21T03:41:04.822 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.844 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.031) 0:04:21.962 ******* 2021-11-21T03:41:04.851 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-21T03:41:04.853 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.876 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.031) 0:04:21.994 ******* 2021-11-21T03:41:04.884 INFO:teuthology.task.ansible.out: 2021-11-21T03:41:04.884 INFO:teuthology.task.ansible.out:TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-21T03:41:04.885 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.913 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.037) 0:04:22.031 ******* 2021-11-21T03:41:04.925 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.953 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.039) 0:04:22.071 ******* 2021-11-21T03:41:04.971 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:04.993 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:04 +0000 (0:00:00.039) 0:04:22.110 ******* 2021-11-21T03:41:05.002 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.026 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.032) 0:04:22.143 ******* 2021-11-21T03:41:05.043 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-21T03:41:05.045 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.065 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.039) 0:04:22.183 ******* 2021-11-21T03:41:05.074 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-21T03:41:05.074 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.101 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.035) 0:04:22.218 ******* 2021-11-21T03:41:05.108 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-21T03:41:05.110 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.134 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.032) 0:04:22.251 ******* 2021-11-21T03:41:05.142 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-21T03:41:05.144 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.169 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.035) 0:04:22.287 ******* 2021-11-21T03:41:05.176 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-21T03:41:05.177 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.200 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.030) 0:04:22.317 ******* 2021-11-21T03:41:05.207 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.232 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.032) 0:04:22.349 ******* 2021-11-21T03:41:05.239 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-21T03:41:05.241 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.263 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.031) 0:04:22.380 ******* 2021-11-21T03:41:05.270 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.294 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.031) 0:04:22.411 ******* 2021-11-21T03:41:05.301 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.331 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.030) 0:04:22.442 ******* 2021-11-21T03:41:05.332 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.358 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.032) 0:04:22.475 ******* 2021-11-21T03:41:05.366 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-21T03:41:05.367 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.369 INFO:teuthology.task.ansible.out: 2021-11-21T03:41:05.391 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.033) 0:04:22.509 ******* 2021-11-21T03:41:05.399 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-21T03:41:05.401 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.430 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.038) 0:04:22.548 ******* 2021-11-21T03:41:05.437 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-21T03:41:05.439 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.461 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.030) 0:04:22.578 ******* 2021-11-21T03:41:05.467 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-21T03:41:05.468 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.493 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.031) 0:04:22.610 ******* 2021-11-21T03:41:05.500 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-21T03:41:05.502 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.525 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.032) 0:04:22.643 ******* 2021-11-21T03:41:05.532 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-21T03:41:05.534 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.557 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.031) 0:04:22.674 ******* 2021-11-21T03:41:05.564 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-21T03:41:05.565 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.587 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.029) 0:04:22.704 ******* 2021-11-21T03:41:05.594 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-21T03:41:05.595 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.618 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.030) 0:04:22.735 ******* 2021-11-21T03:41:05.625 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-21T03:41:05.627 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.648 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.030) 0:04:22.765 ******* 2021-11-21T03:41:05.654 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-21T03:41:05.656 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.678 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.030) 0:04:22.796 ******* 2021-11-21T03:41:05.684 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-21T03:41:05.686 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.708 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.029) 0:04:22.825 ******* 2021-11-21T03:41:05.714 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-21T03:41:05.716 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.740 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.032) 0:04:22.858 ******* 2021-11-21T03:41:05.746 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-21T03:41:05.748 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.770 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.029) 0:04:22.887 ******* 2021-11-21T03:41:05.775 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-21T03:41:05.777 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.799 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.029) 0:04:22.917 ******* 2021-11-21T03:41:05.807 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-21T03:41:05.808 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.831 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.031) 0:04:22.948 ******* 2021-11-21T03:41:05.837 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-21T03:41:05.839 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.862 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.031) 0:04:22.979 ******* 2021-11-21T03:41:05.869 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-21T03:41:05.872 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.893 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.031) 0:04:23.010 ******* 2021-11-21T03:41:05.904 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.931 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.037) 0:04:23.048 ******* 2021-11-21T03:41:05.940 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-21T03:41:05.942 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:05.964 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.033) 0:04:23.082 ******* 2021-11-21T03:41:05.981 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.003 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:05 +0000 (0:00:00.038) 0:04:23.120 ******* 2021-11-21T03:41:06.010 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-21T03:41:06.012 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.035 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.031) 0:04:23.152 ******* 2021-11-21T03:41:06.042 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-21T03:41:06.044 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.068 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.031) 0:04:23.184 ******* 2021-11-21T03:41:06.073 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-21T03:41:06.074 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.098 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.031) 0:04:23.216 ******* 2021-11-21T03:41:06.105 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-21T03:41:06.105 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.132 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.032) 0:04:23.248 ******* 2021-11-21T03:41:06.138 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-21T03:41:06.140 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.162 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.031) 0:04:23.280 ******* 2021-11-21T03:41:06.168 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-21T03:41:06.170 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.192 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.029) 0:04:23.309 ******* 2021-11-21T03:41:06.200 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-21T03:41:06.201 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.224 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.031) 0:04:23.341 ******* 2021-11-21T03:41:06.230 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-21T03:41:06.231 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.255 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.031) 0:04:23.372 ******* 2021-11-21T03:41:06.261 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-21T03:41:06.263 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.289 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.034) 0:04:23.407 ******* 2021-11-21T03:41:06.301 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.326 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.036) 0:04:23.443 ******* 2021-11-21T03:41:06.345 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-21T03:41:06.347 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.368 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.042) 0:04:23.485 ******* 2021-11-21T03:41:06.377 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.404 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.035) 0:04:23.521 ******* 2021-11-21T03:41:06.412 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-21T03:41:06.413 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.436 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.032) 0:04:23.553 ******* 2021-11-21T03:41:06.442 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-11-21T03:41:06.444 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.466 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.029) 0:04:23.583 ******* 2021-11-21T03:41:06.473 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-21T03:41:06.474 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.496 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.029) 0:04:23.613 ******* 2021-11-21T03:41:06.502 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-21T03:41:06.504 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.540 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.044) 0:04:23.658 ******* 2021-11-21T03:41:06.548 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-21T03:41:06.550 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.577 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.035) 0:04:23.694 ******* 2021-11-21T03:41:06.593 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.616 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.039) 0:04:23.734 ******* 2021-11-21T03:41:06.624 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-21T03:41:06.626 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.648 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.031) 0:04:23.765 ******* 2021-11-21T03:41:06.654 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-11-21T03:41:06.656 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.679 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.030) 0:04:23.796 ******* 2021-11-21T03:41:06.686 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-21T03:41:06.688 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.712 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.033) 0:04:23.829 ******* 2021-11-21T03:41:06.718 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-11-21T03:41:06.720 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.744 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.032) 0:04:23.862 ******* 2021-11-21T03:41:06.752 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-21T03:41:06.755 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.776 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.031) 0:04:23.894 ******* 2021-11-21T03:41:06.782 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-21T03:41:06.784 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.807 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.031) 0:04:23.925 ******* 2021-11-21T03:41:06.813 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-21T03:41:06.815 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.837 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.029) 0:04:23.955 ******* 2021-11-21T03:41:06.843 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-11-21T03:41:06.844 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.867 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.029) 0:04:23.984 ******* 2021-11-21T03:41:06.874 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.897 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.029) 0:04:24.014 ******* 2021-11-21T03:41:06.904 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-11-21T03:41:06.905 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.930 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.033) 0:04:24.048 ******* 2021-11-21T03:41:06.938 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-21T03:41:06.939 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.961 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.031) 0:04:24.079 ******* 2021-11-21T03:41:06.968 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-11-21T03:41:06.970 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:06.994 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:06 +0000 (0:00:00.033) 0:04:24.112 ******* 2021-11-21T03:41:07.004 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-21T03:41:07.005 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.029 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.034) 0:04:24.147 ******* 2021-11-21T03:41:07.035 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-11-21T03:41:07.037 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.060 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.030) 0:04:24.177 ******* 2021-11-21T03:41:07.068 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-21T03:41:07.069 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.091 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.030) 0:04:24.208 ******* 2021-11-21T03:41:07.097 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-11-21T03:41:07.099 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.121 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.030) 0:04:24.239 ******* 2021-11-21T03:41:07.130 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-11-21T03:41:07.131 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.154 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.033) 0:04:24.272 ******* 2021-11-21T03:41:07.161 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-21T03:41:07.163 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.185 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.030) 0:04:24.303 ******* 2021-11-21T03:41:07.192 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-11-21T03:41:07.194 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.217 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.031) 0:04:24.334 ******* 2021-11-21T03:41:07.223 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-21T03:41:07.225 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-21T03:41:07.253 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.035) 0:04:24.370 ******* 2021-11-21T03:41:07.260 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-21T03:41:07.262 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.284 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.031) 0:04:24.402 ******* 2021-11-21T03:41:07.304 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-21T03:41:07.305 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.315 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-21T03:41:07.317 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.326 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.328 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba022.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.355 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.070) 0:04:24.473 ******* 2021-11-21T03:41:07.363 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.365 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.393 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.037) 0:04:24.510 ******* 2021-11-21T03:41:07.400 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.425 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.032) 0:04:24.543 ******* 2021-11-21T03:41:07.468 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-11-21T03:41:07.469 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.490 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.064) 0:04:24.607 ******* 2021-11-21T03:41:07.517 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-21T03:41:07.519 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.546 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.055) 0:04:24.663 ******* 2021-11-21T03:41:07.574 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.606 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.060) 0:04:24.724 ******* 2021-11-21T03:41:07.615 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-11-21T03:41:07.616 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004880", "end": "2021-11-21 03:41:07.577568", "rc": 0, "start": "2021-11-21 03:41:07.572688", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology-lock"]} 2021-11-21T03:41:07.654 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.047) 0:04:24.771 ******* 2021-11-21T03:41:07.661 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-11-21T03:41:07.662 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.685 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.031) 0:04:24.803 ******* 2021-11-21T03:41:07.708 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.731 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.045) 0:04:24.849 ******* 2021-11-21T03:41:07.739 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-11-21T03:41:07.741 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.763 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.032) 0:04:24.881 ******* 2021-11-21T03:41:07.771 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-11-21T03:41:07.773 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.795 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.031) 0:04:24.912 ******* 2021-11-21T03:41:07.803 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-11-21T03:41:07.805 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.827 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.031) 0:04:24.944 ******* 2021-11-21T03:41:07.835 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-21T03:41:07.837 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.860 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.033) 0:04:24.978 ******* 2021-11-21T03:41:07.867 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-11-21T03:41:07.869 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.892 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.031) 0:04:25.009 ******* 2021-11-21T03:41:07.898 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-21T03:41:07.899 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.922 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.029) 0:04:25.039 ******* 2021-11-21T03:41:07.929 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-21T03:41:07.931 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:07.954 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.032) 0:04:25.072 ******* 2021-11-21T03:41:07.982 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-21T03:41:07.984 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-21T03:41:08.005 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:07 +0000 (0:00:00.050) 0:04:25.122 ******* 2021-11-21T03:41:08.055 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-21T03:41:08.057 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:08.068 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-21T03:41:08.070 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:08.080 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:08.082 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:08.091 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:08.092 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:08.116 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:08 +0000 (0:00:00.111) 0:04:25.234 ******* 2021-11-21T03:41:08.314 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-11-21T03:41:08.316 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003359", "end": "2021-11-21 03:41:08.289822", "rc": 0, "start": "2021-11-21 03:41:08.286463", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology-lock"]} 2021-11-21T03:41:08.339 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:08 +0000 (0:00:00.222) 0:04:25.456 ******* 2021-11-21T03:41:08.376 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-11-21T03:41:08.378 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:08.401 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:08 +0000 (0:00:00.062) 0:04:25.518 ******* 2021-11-21T03:41:08.428 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:08.455 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:08 +0000 (0:00:00.053) 0:04:25.572 ******* 2021-11-21T03:41:08.481 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-21T03:41:08.483 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:08.504 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:08 +0000 (0:00:00.049) 0:04:25.622 ******* 2021-11-21T03:41:08.532 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-21T03:41:08.532 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:08.557 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:08 +0000 (0:00:00.052) 0:04:25.674 ******* 2021-11-21T03:41:10.422 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-21T03:41:10.424 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:41:10.446 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:10 +0000 (0:00:01.889) 0:04:27.564 ******* 2021-11-21T03:41:10.495 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-21T03:41:10.496 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930284322816, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227120196, 'block_used': 12974912, 'inode_total': 61054976, 'inode_available': 60983362, 'inode_used': 71614, 'uuid': 'a4769506-e8ae-4359-8d9b-8f0bce290717'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227120196, "block_size": 4096, "block_total": 240095108, "block_used": 12974912, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60983362, "inode_total": 61054976, "inode_used": 71614, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930284322816, "size_total": 983429562368, "uuid": "a4769506-e8ae-4359-8d9b-8f0bce290717"}} 2021-11-21T03:41:10.518 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:10 +0000 (0:00:00.071) 0:04:27.636 ******* 2021-11-21T03:41:10.640 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-21T03:41:10.642 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:41:10.665 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:10 +0000 (0:00:00.147) 0:04:27.783 ******* 2021-11-21T03:41:10.684 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-21T03:41:10.686 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.003583", "end": "2021-11-21 03:41:10.665522", "rc": 0, "start": "2021-11-21 03:41:10.661939", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:10.708 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:10 +0000 (0:00:00.042) 0:04:27.825 ******* 2021-11-21T03:41:10.726 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-21T03:41:10.728 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930284322816, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227120196, 'block_used': 12974912, 'inode_total': 61054976, 'inode_available': 60983362, 'inode_used': 71614, 'uuid': 'a4769506-e8ae-4359-8d9b-8f0bce290717'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227120196, "block_size": 4096, "block_total": 240095108, "block_used": 12974912, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60983362, "inode_total": 61054976, "inode_used": 71614, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930284322816, "size_total": 983429562368, "uuid": "a4769506-e8ae-4359-8d9b-8f0bce290717"}} 2021-11-21T03:41:10.751 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:10 +0000 (0:00:00.042) 0:04:27.868 ******* 2021-11-21T03:41:10.757 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-21T03:41:10.759 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930284322816, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227120196, 'block_used': 12974912, 'inode_total': 61054976, 'inode_available': 60983362, 'inode_used': 71614, 'uuid': 'a4769506-e8ae-4359-8d9b-8f0bce290717'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227120196, "block_size": 4096, "block_total": 240095108, "block_used": 12974912, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60983362, "inode_total": 61054976, "inode_used": 71614, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930284322816, "size_total": 983429562368, "uuid": "a4769506-e8ae-4359-8d9b-8f0bce290717"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:10.791 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:10 +0000 (0:00:00.032) 0:04:27.901 ******* 2021-11-21T03:41:10.830 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-21T03:41:10.852 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:10 +0000 (0:00:00.069) 0:04:27.970 ******* 2021-11-21T03:41:10.913 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-21T03:41:10.915 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.003606", "end": "2021-11-21 03:41:10.899923", "rc": 0, "start": "2021-11-21 03:41:10.896317", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:10.938 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:10 +0000 (0:00:00.085) 0:04:28.056 ******* 2021-11-21T03:41:11.197 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-21T03:41:11.199 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930284322816, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227120196, 'block_used': 12974912, 'inode_total': 61054976, 'inode_available': 60983362, 'inode_used': 71614, 'uuid': 'a4769506-e8ae-4359-8d9b-8f0bce290717'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227120196, "block_size": 4096, "block_total": 240095108, "block_used": 12974912, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60983362, "inode_total": 61054976, "inode_used": 71614, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930284322816, "size_total": 983429562368, "uuid": "a4769506-e8ae-4359-8d9b-8f0bce290717"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:11.332 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:11 +0000 (0:00:00.393) 0:04:28.450 ******* 2021-11-21T03:41:11.369 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-21T03:41:11.391 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:11 +0000 (0:00:00.058) 0:04:28.508 ******* 2021-11-21T03:41:12.495 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-21T03:41:12.496 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhThg34rUlAFmplccfQ2qdpmJz0pvTVu2x'], 'uuids': ['c6369e56-d9af-4e7a-b17a-ddbe7518975b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.266872", "end": "2021-11-21 03:41:12.466522", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhThg34rUlAFmplccfQ2qdpmJz0pvTVu2x"], "labels": [], "masters": [], "uuids": ["c6369e56-d9af-4e7a-b17a-ddbe7518975b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:11.199650", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-21T03:41:12.675 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukFalSaJUHd22Ka9u02tEMh4zngZHqHp9q'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.105650", "end": "2021-11-21 03:41:12.653342", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukFalSaJUHd22Ka9u02tEMh4zngZHqHp9q"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:11.547692", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-21T03:41:13.712 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-8pTiTZ-dIGM-sxWt-5tO7-41oc-DIAb-oe4dgS', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400AU375A', 'nvme-nvme.8086-50484b4d393133343030415533373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.078017", "end": "2021-11-21 03:41:13.691058", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-8pTiTZ-dIGM-sxWt-5tO7-41oc-DIAb-oe4dgS", "nvme-INTEL_SSDPEL1K375GA_PHKM913400AU375A", "nvme-nvme.8086-50484b4d393133343030415533373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:12.613041", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now par 2021-11-21T03:41:13.714 INFO:teuthology.task.ansible.out:tition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-21T03:41:13.911 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-BuV61z-0AFx-Au14-jh9W-WRpo-wugZ-nQ5jm1', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400LD375A', 'nvme-nvme.8086-50484b4d3931333430304c4433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.075695", "end": "2021-11-21 03:41:13.882903", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-BuV61z-0AFx-Au14-jh9W-WRpo-wugZ-nQ5jm1", "nvme-INTEL_SSDPEL1K375GA_PHKM913400LD375A", "nvme-nvme.8086-50484b4d3931333430304c4433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:12.807208", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now par 2021-11-21T03:41:13.912 INFO:teuthology.task.ansible.out:tition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-21T03:41:14.903 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhVWcdKZK2QOS9UiUqGBq0elNpDC0PCIwg'], 'uuids': ['0477af5f-2bc9-4ddd-84bf-b4f0b37127ae'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.051992", "end": "2021-11-21 03:41:14.885557", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhVWcdKZK2QOS9UiUqGBq0elNpDC0PCIwg"], "labels": [], "masters": [], "uuids": ["0477af5f-2bc9-4ddd-84bf-b4f0b37127ae"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:13.833565", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-21T03:41:15.082 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukLecYeKHgVHMlefZRLKYGgW28BG9F2q2Q'], 'uuids': ['97d3dab6-0b6c-4a0f-abfd-525f653df0bf'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.040689", "end": "2021-11-21 03:41:15.068634", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukLecYeKHgVHMlefZRLKYGgW28BG9F2q2Q"], "labels": [], "masters": [], "uuids": ["97d3dab6-0b6c-4a0f-abfd-525f653df0bf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:14.027945", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-21T03:41:16.093 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhCv64xm7DHkLJ6hYi8rhtCSC5JISaRyJ9'], 'uuids': ['b1439725-9e95-4138-8227-0e82fa9fea1d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.050968", "end": "2021-11-21 03:41:16.077226", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhCv64xm7DHkLJ6hYi8rhtCSC5JISaRyJ9"], "labels": [], "masters": [], "uuids": ["b1439725-9e95-4138-8227-0e82fa9fea1d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:15.026258", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-21T03:41:16.292 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukVOlQh7YN9itQcypRdAzak9msQ68Qw5YD'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.059326", "end": "2021-11-21 03:41:16.269509", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukVOlQh7YN9itQcypRdAzak9msQ68Qw5YD"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:15.210183", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-21T03:41:17.288 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhJ9LLNfSXy4sIPT3tfKKhDJxYbDSC2aTo'], 'uuids': ['a08fc340-7b77-4291-8274-ffc8b992fe6f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.054243", "end": "2021-11-21 03:41:17.269587", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhJ9LLNfSXy4sIPT3tfKKhDJxYbDSC2aTo"], "labels": [], "masters": [], "uuids": ["a08fc340-7b77-4291-8274-ffc8b992fe6f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:16.215344", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-21T03:41:17.300 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF', 'scsi-350000399ab9813d1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF', 'wwn-0x50000399ab9813d1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9I6K2K3F6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399ab9813d1', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF-part1', 'scsi-350000399ab9813d1-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF-part1', 'wwn-0x50000399ab9813d1-part1'], 'uuids': ['a4769506-e8ae-4359-8d9b-8f0bce290717'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a4769506-e8ae-4359-8d9b-8f0bce290717', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF", "scsi-350000399ab9813d1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF", "wwn-0x50000399ab9813d1"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF-part1", "scsi-1ATA_TOSHI 2021-11-21T03:41:17.302 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9I6K2K3F6XF-part1", "scsi-350000399ab9813d1-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF-part1", "wwn-0x50000399ab9813d1-part1"], "labels": [], "masters": [], "uuids": ["a4769506-e8ae-4359-8d9b-8f0bce290717"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a4769506-e8ae-4359-8d9b-8f0bce290717"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2K3F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813d1"}}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:17.488 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukdp6JD2gei2DzgiqZNs0MkhhJpco9hCM7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.058811", "end": "2021-11-21 03:41:17.470374", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukdp6JD2gei2DzgiqZNs0MkhhJpco9hCM7"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:16.411563", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-21T03:41:17.500 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I8K38GF6XF', 'scsi-350000399aba81666', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF', 'wwn-0x50000399aba81666'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9I8K38GF6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399aba81666', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I8K38GF6XF-part1', 'scsi-350000399aba81666-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF-part1', 'wwn-0x50000399aba81666-part1'], 'uuids': ['a4769506-e8ae-4359-8d9b-8f0bce290717'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a4769506-e8ae-4359-8d9b-8f0bce290717', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I8K38GF6XF", "scsi-350000399aba81666", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF", "wwn-0x50000399aba81666"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF-part1", "scsi-1ATA_TOSHI 2021-11-21T03:41:17.502 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9I8K38GF6XF-part1", "scsi-350000399aba81666-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF-part1", "wwn-0x50000399aba81666-part1"], "labels": [], "masters": [], "uuids": ["a4769506-e8ae-4359-8d9b-8f0bce290717"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a4769506-e8ae-4359-8d9b-8f0bce290717"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38GF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba81666"}}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:18.491 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhNqVZeDJH3Bzj9r4uKf5xpxkO1fGy7N3b'], 'uuids': ['165823e2-4575-4c2e-a75d-c189b8e4c52b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.050648", "end": "2021-11-21 03:41:18.468931", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhNqVZeDJH3Bzj9r4uKf5xpxkO1fGy7N3b"], "labels": [], "masters": [], "uuids": ["165823e2-4575-4c2e-a75d-c189b8e4c52b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:17.418283", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-21T03:41:18.520 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:18 +0000 (0:00:07.129) 0:04:35.638 ******* 2021-11-21T03:41:18.707 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukDS37CgfFn2r19sE7k4OOCbudDF4XpgwY'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.071341", "end": "2021-11-21 03:41:18.689018", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukDS37CgfFn2r19sE7k4OOCbudDF4XpgwY"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:17.617677", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-21T03:41:18.748 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:18 +0000 (0:00:00.227) 0:04:35.866 ******* 2021-11-21T03:41:18.778 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-21T03:41:18.780 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhThg34rUlAFmplccfQ2qdpmJz0pvTVu2x'], 'uuids': ['c6369e56-d9af-4e7a-b17a-ddbe7518975b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.079928", "end": "2021-11-21 03:41:18.757661", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhThg34rUlAFmplccfQ2qdpmJz0pvTVu2x"], "labels": [], "masters": [], "uuids": ["c6369e56-d9af-4e7a-b17a-ddbe7518975b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:18.677733", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0782554 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0782554 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:18.950 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-8pTiTZ-dIGM-sxWt-5tO7-41oc-DIAb-oe4dgS', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400AU375A', 'nvme-nvme.8086-50484b4d393133343030415533373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.027465", "end": "2021-11-21 03:41:18.928923", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-8pTiTZ-dIGM-sxWt-5tO7-41oc-DIAb-oe4dgS", "nvme-INTEL_SSDPEL1K375GA_PHKM913400AU375A", "nvme-nvme.8086-50484b4d393133343030415533373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:18.901458", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0257623 s, 4.5 GB/s", "stderr_lines": ["1 2021-11-21T03:41:18.952 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0257623 s, 4.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:19.036 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukFalSaJUHd22Ka9u02tEMh4zngZHqHp9q'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.080847", "end": "2021-11-21 03:41:19.008178", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukFalSaJUHd22Ka9u02tEMh4zngZHqHp9q"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:18.927331", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0790506 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0790506 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:19.166 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhVWcdKZK2QOS9UiUqGBq0elNpDC0PCIwg'], 'uuids': ['0477af5f-2bc9-4ddd-84bf-b4f0b37127ae'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.080050", "end": "2021-11-21 03:41:19.147310", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhVWcdKZK2QOS9UiUqGBq0elNpDC0PCIwg"], "labels": [], "masters": [], "uuids": ["0477af5f-2bc9-4ddd-84bf-b4f0b37127ae"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:19.067260", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0783184 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0783184 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:19.199 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-BuV61z-0AFx-Au14-jh9W-WRpo-wugZ-nQ5jm1', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400LD375A', 'nvme-nvme.8086-50484b4d3931333430304c4433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.026652", "end": "2021-11-21 03:41:19.180169", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-BuV61z-0AFx-Au14-jh9W-WRpo-wugZ-nQ5jm1", "nvme-INTEL_SSDPEL1K375GA_PHKM913400LD375A", "nvme-nvme.8086-50484b4d3931333430304c4433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:19.153517", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0249259 s, 4.6 GB/s", "stderr_lines": ["1 2021-11-21T03:41:19.202 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0249259 s, 4.6 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:20.398 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhCv64xm7DHkLJ6hYi8rhtCSC5JISaRyJ9'], 'uuids': ['b1439725-9e95-4138-8227-0e82fa9fea1d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:01.082086", "end": "2021-11-21 03:41:20.376887", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhCv64xm7DHkLJ6hYi8rhtCSC5JISaRyJ9"], "labels": [], "masters": [], "uuids": ["b1439725-9e95-4138-8227-0e82fa9fea1d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:19.294801", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0790554 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0790554 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:20.433 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukLecYeKHgVHMlefZRLKYGgW28BG9F2q2Q'], 'uuids': ['97d3dab6-0b6c-4a0f-abfd-525f653df0bf'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:01.083428", "end": "2021-11-21 03:41:20.407294", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukLecYeKHgVHMlefZRLKYGgW28BG9F2q2Q"], "labels": [], "masters": [], "uuids": ["97d3dab6-0b6c-4a0f-abfd-525f653df0bf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:19.323866", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0801762 s, 1.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0801762 s, 1.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:20.635 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhJ9LLNfSXy4sIPT3tfKKhDJxYbDSC2aTo'], 'uuids': ['a08fc340-7b77-4291-8274-ffc8b992fe6f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.081060", "end": "2021-11-21 03:41:20.612559", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhJ9LLNfSXy4sIPT3tfKKhDJxYbDSC2aTo"], "labels": [], "masters": [], "uuids": ["a08fc340-7b77-4291-8274-ffc8b992fe6f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:20.531499", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0793107 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0793107 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:20.637 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF', 'scsi-350000399ab9813d1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF', 'wwn-0x50000399ab9813d1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9I6K2K3F6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399ab9813d1', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF-part1', 'scsi-350000399ab9813d1-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF-part1', 'wwn-0x50000399ab9813d1-part1'], 'uuids': ['a4769506-e8ae-4359-8d9b-8f0bce290717'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a4769506-e8ae-4359-8d9b-8f0bce290717', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF", "scsi-350000399ab9813d1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF", "wwn-0x50000399ab9813d1"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2K3F6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF-part1", "scsi-1ATA_TOSHI 2021-11-21T03:41:20.639 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9I6K2K3F6XF-part1", "scsi-350000399ab9813d1-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2K3F6XF-part1", "wwn-0x50000399ab9813d1-part1"], "labels": [], "masters": [], "uuids": ["a4769506-e8ae-4359-8d9b-8f0bce290717"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a4769506-e8ae-4359-8d9b-8f0bce290717"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2K3F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813d1"}}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:20.660 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukVOlQh7YN9itQcypRdAzak9msQ68Qw5YD'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.079686", "end": "2021-11-21 03:41:20.637863", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukVOlQh7YN9itQcypRdAzak9msQ68Qw5YD"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:20.558177", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0780387 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0780387 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:20.862 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhNqVZeDJH3Bzj9r4uKf5xpxkO1fGy7N3b'], 'uuids': ['165823e2-4575-4c2e-a75d-c189b8e4c52b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.079715", "end": "2021-11-21 03:41:20.839624", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-usc5OyTXeOax9dYd5JYE9ZS86CJvccIhNqVZeDJH3Bzj9r4uKf5xpxkO1fGy7N3b"], "labels": [], "masters": [], "uuids": ["165823e2-4575-4c2e-a75d-c189b8e4c52b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:20.759909", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0780544 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0780544 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:20.894 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:20 +0000 (0:00:02.145) 0:04:38.012 ******* 2021-11-21T03:41:20.906 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukdp6JD2gei2DzgiqZNs0MkhhJpco9hCM7'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.080830", "end": "2021-11-21 03:41:20.858376", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukdp6JD2gei2DzgiqZNs0MkhhJpco9hCM7"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:20.777546", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0791246 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0791246 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:20.908 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I8K38GF6XF', 'scsi-350000399aba81666', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF', 'wwn-0x50000399aba81666'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9I8K38GF6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399aba81666', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I8K38GF6XF-part1', 'scsi-350000399aba81666-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF-part1', 'wwn-0x50000399aba81666-part1'], 'uuids': ['a4769506-e8ae-4359-8d9b-8f0bce290717'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a4769506-e8ae-4359-8d9b-8f0bce290717', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I8K38GF6XF", "scsi-350000399aba81666", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF", "wwn-0x50000399aba81666"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38GF6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF-part1", "scsi-1ATA_TOSHI 2021-11-21T03:41:20.910 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9I8K38GF6XF-part1", "scsi-350000399aba81666-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38GF6XF-part1", "wwn-0x50000399aba81666-part1"], "labels": [], "masters": [], "uuids": ["a4769506-e8ae-4359-8d9b-8f0bce290717"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a4769506-e8ae-4359-8d9b-8f0bce290717"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38GF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba81666"}}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:21.122 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukDS37CgfFn2r19sE7k4OOCbudDF4XpgwY'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.080606", "end": "2021-11-21 03:41:21.094647", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-wPKO4IGFo7bBwCkpZOFaU0pVTL24zDukDS37CgfFn2r19sE7k4OOCbudDF4XpgwY"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-21 03:41:21.014041", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.078934 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.078934 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:21.153 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.258) 0:04:38.270 ******* 2021-11-21T03:41:21.161 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-11-21T03:41:21.162 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.059505", "end": "2021-11-21 03:41:21.100429", "rc": 0, "start": "2021-11-21 03:41:21.040924", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:21.186 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.033) 0:04:38.303 ******* 2021-11-21T03:41:21.390 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.071128", "end": "2021-11-21 03:41:21.357490", "rc": 0, "start": "2021-11-21 03:41:21.286362", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:21.392 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.052752", "end": "2021-11-21 03:41:21.377444", "rc": 0, "start": "2021-11-21 03:41:21.324692", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:21.413 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.227) 0:04:38.531 ******* 2021-11-21T03:41:21.436 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.022) 0:04:38.553 ******* 2021-11-21T03:41:21.454 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-21T03:41:21.481 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.045) 0:04:38.599 ******* 2021-11-21T03:41:21.524 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:21.569 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.088) 0:04:38.687 ******* 2021-11-21T03:41:21.611 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:21.637 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.067) 0:04:38.755 ******* 2021-11-21T03:41:21.645 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-21T03:41:21.646 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.044414", "end": "2021-11-21 03:41:21.619657", "rc": 0, "start": "2021-11-21 03:41:21.575243", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:21.673 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.036) 0:04:38.791 ******* 2021-11-21T03:41:21.684 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-21T03:41:21.686 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:21.714 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.040) 0:04:38.832 ******* 2021-11-21T03:41:21.725 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-21T03:41:21.758 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.043) 0:04:38.875 ******* 2021-11-21T03:41:21.766 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-21T03:41:21.768 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:21.796 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.037) 0:04:38.913 ******* 2021-11-21T03:41:21.805 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:21.840 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.044) 0:04:38.957 ******* 2021-11-21T03:41:21.880 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:21.906 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.066) 0:04:39.023 ******* 2021-11-21T03:41:21.940 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-21T03:41:21.942 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:21.971 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:21 +0000 (0:00:00.064) 0:04:39.088 ******* 2021-11-21T03:41:21.983 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [gibba022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-21T03:41:22.012 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.040) 0:04:39.129 ******* 2021-11-21T03:41:22.021 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-21T03:41:22.023 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.049 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.037) 0:04:39.167 ******* 2021-11-21T03:41:22.070 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-21T03:41:22.072 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930284322816, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227120196, 'block_used': 12974912, 'inode_total': 61054976, 'inode_available': 60983362, 'inode_used': 71614, 'uuid': 'a4769506-e8ae-4359-8d9b-8f0bce290717'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227120196, "block_size": 4096, "block_total": 240095108, "block_used": 12974912, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60983362, "inode_total": 61054976, "inode_used": 71614, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930284322816, "size_total": 983429562368, "uuid": "a4769506-e8ae-4359-8d9b-8f0bce290717"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.097 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.047) 0:04:39.215 ******* 2021-11-21T03:41:22.138 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-11-21T03:41:22.140 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.161 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.063) 0:04:39.278 ******* 2021-11-21T03:41:22.189 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-21T03:41:22.191 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.216 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.055) 0:04:39.334 ******* 2021-11-21T03:41:22.224 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-21T03:41:22.226 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-21T03:41:22.252 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.035) 0:04:39.370 ******* 2021-11-21T03:41:22.261 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-21T03:41:22.263 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.293 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.040) 0:04:39.411 ******* 2021-11-21T03:41:22.314 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-21T03:41:22.316 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930284322816, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227120196, 'block_used': 12974912, 'inode_total': 61054976, 'inode_available': 60983362, 'inode_used': 71614, 'uuid': 'a4769506-e8ae-4359-8d9b-8f0bce290717'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227120196, "block_size": 4096, "block_total": 240095108, "block_used": 12974912, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60983362, "inode_total": 61054976, "inode_used": 71614, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930284322816, "size_total": 983429562368, "uuid": "a4769506-e8ae-4359-8d9b-8f0bce290717"}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.359 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.065) 0:04:39.477 ******* 2021-11-21T03:41:22.369 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-21T03:41:22.370 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.401 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.041) 0:04:39.518 ******* 2021-11-21T03:41:22.408 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-11-21T03:41:22.410 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.448 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.046) 0:04:39.565 ******* 2021-11-21T03:41:22.459 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-21T03:41:22.461 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.488 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.040) 0:04:39.605 ******* 2021-11-21T03:41:22.499 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-21T03:41:22.501 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.532 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.043) 0:04:39.649 ******* 2021-11-21T03:41:22.539 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-21T03:41:22.542 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.564 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.032) 0:04:39.682 ******* 2021-11-21T03:41:22.571 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-21T03:41:22.573 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.597 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.031) 0:04:39.713 ******* 2021-11-21T03:41:22.625 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.646 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.049) 0:04:39.763 ******* 2021-11-21T03:41:22.684 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-21T03:41:22.686 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.719 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.073) 0:04:39.836 ******* 2021-11-21T03:41:22.760 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-21T03:41:22.762 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:22.786 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:22 +0000 (0:00:00.066) 0:04:39.903 ******* 2021-11-21T03:41:23.053 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-21T03:41:23.054 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-21T03:41:23.078 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:23 +0000 (0:00:00.292) 0:04:40.195 ******* 2021-11-21T03:41:23.245 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-21T03:41:23.278 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:23 +0000 (0:00:00.200) 0:04:40.396 ******* 2021-11-21T03:41:23.514 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-21T03:41:23.615 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-21T03:41:23.827 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-21T03:41:23.901 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-21T03:41:24.148 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-21T03:41:24.214 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-21T03:41:24.470 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-21T03:41:24.531 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-21T03:41:24.811 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-21T03:41:24.835 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:24 +0000 (0:00:01.553) 0:04:41.949 ******* 2021-11-21T03:41:24.844 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-21T03:41:24.874 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:24 +0000 (0:00:00.042) 0:04:41.991 ******* 2021-11-21T03:41:24.999 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-21T03:41:25.001 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-21T03:41:25.024 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:25 +0000 (0:00:00.150) 0:04:42.142 ******* 2021-11-21T03:41:25.047 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-21T03:41:25.087 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:25 +0000 (0:00:00.058) 0:04:42.200 ******* 2021-11-21T03:41:25.217 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-21T03:41:25.282 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-21T03:41:25.372 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-21T03:41:25.439 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-21T03:41:25.521 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-21T03:41:25.602 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-21T03:41:25.657 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-21T03:41:25.681 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:25.720 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:25 +0000 (0:00:00.636) 0:04:42.837 ******* 2021-11-21T03:41:25.755 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-11-21T03:41:25.758 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:25.791 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:25 +0000 (0:00:00.069) 0:04:42.906 ******* 2021-11-21T03:41:25.811 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-21T03:41:25.813 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:25.844 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:25 +0000 (0:00:00.055) 0:04:42.962 ******* 2021-11-21T03:41:25.865 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-21T03:41:25.867 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:25.901 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:25 +0000 (0:00:00.056) 0:04:43.018 ******* 2021-11-21T03:41:25.912 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-11-21T03:41:25.919 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:25.947 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:25 +0000 (0:00:00.045) 0:04:43.063 ******* 2021-11-21T03:41:26.003 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:26.037 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:26 +0000 (0:00:00.091) 0:04:43.155 ******* 2021-11-21T03:41:26.092 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-21T03:41:26.135 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:26 +0000 (0:00:00.097) 0:04:43.252 ******* 2021-11-21T03:41:26.173 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:26.222 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:26 +0000 (0:00:00.078) 0:04:43.331 ******* 2021-11-21T03:41:26.257 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-21T03:41:26.259 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-21T03:41:26.293 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:26 +0000 (0:00:00.078) 0:04:43.410 ******* 2021-11-21T03:41:26.378 INFO:teuthology.task.ansible.out: 2021-11-21T03:41:26.380 INFO:teuthology.task.ansible.out:TASK [testnode : Set xfs_opts on newer OSes] *********************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:26.409 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:26 +0000 (0:00:00.116) 0:04:43.527 ******* 2021-11-21T03:41:26.535 INFO:teuthology.task.ansible.out: 2021-11-21T03:41:26.536 INFO:teuthology.task.ansible.out:TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-21T03:41:26.538 INFO:teuthology.task.ansible.out: changed: [gibba022.front.sepia.ceph.com] => {"changed": true} 2021-11-21T03:41:26.566 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:26 +0000 (0:00:00.156) 0:04:43.684 ******* 2021-11-21T03:41:26.568 INFO:teuthology.task.ansible.out: 2021-11-21T03:41:26.932 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-21T03:41:26.959 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:26 +0000 (0:00:00.393) 0:04:44.077 ******* 2021-11-21T03:41:26.991 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-21T03:41:26.992 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.020 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.060) 0:04:44.138 ******* 2021-11-21T03:41:27.048 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.073 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.052) 0:04:44.191 ******* 2021-11-21T03:41:27.101 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-21T03:41:27.103 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.133 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.059) 0:04:44.250 ******* 2021-11-21T03:41:27.163 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-21T03:41:27.166 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.193 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.060) 0:04:44.311 ******* 2021-11-21T03:41:27.227 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-21T03:41:27.229 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.253 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.059) 0:04:44.370 ******* 2021-11-21T03:41:27.254 INFO:teuthology.task.ansible.out: 2021-11-21T03:41:27.282 INFO:teuthology.task.ansible.out: 2021-11-21T03:41:27.284 INFO:teuthology.task.ansible.out:TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.305 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.052) 0:04:44.423 ******* 2021-11-21T03:41:27.337 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-21T03:41:27.339 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.360 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.054) 0:04:44.478 ******* 2021-11-21T03:41:27.389 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.414 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.053) 0:04:44.531 ******* 2021-11-21T03:41:27.443 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-11-21T03:41:27.445 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.467 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.053) 0:04:44.584 ******* 2021-11-21T03:41:27.496 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-21T03:41:27.498 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.530 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.063) 0:04:44.648 ******* 2021-11-21T03:41:27.562 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.593 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.062) 0:04:44.711 ******* 2021-11-21T03:41:27.626 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-11-21T03:41:27.628 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.657 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.064) 0:04:44.775 ******* 2021-11-21T03:41:27.667 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-21T03:41:27.669 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true} 2021-11-21T03:41:27.699 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.041) 0:04:44.817 ******* 2021-11-21T03:41:27.710 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-21T03:41:27.711 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.745 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.045) 0:04:44.862 ******* 2021-11-21T03:41:27.786 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.808 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.063) 0:04:44.925 ******* 2021-11-21T03:41:27.857 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-21T03:41:27.859 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:27.880 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.071) 0:04:44.997 ******* 2021-11-21T03:41:27.975 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-21T03:41:27.999 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:27 +0000 (0:00:00.119) 0:04:45.117 ******* 2021-11-21T03:41:28.027 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-21T03:41:28.029 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.049 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.050) 0:04:45.167 ******* 2021-11-21T03:41:28.076 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-21T03:41:28.078 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.100 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.050) 0:04:45.217 ******* 2021-11-21T03:41:28.139 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-21T03:41:28.141 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.162 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.062) 0:04:45.280 ******* 2021-11-21T03:41:28.189 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.212 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.050) 0:04:45.330 ******* 2021-11-21T03:41:28.241 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-21T03:41:28.243 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.269 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.056) 0:04:45.387 ******* 2021-11-21T03:41:28.276 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-21T03:41:28.278 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-11-21T03:41:28.301 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.031) 0:04:45.418 ******* 2021-11-21T03:41:28.308 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-21T03:41:28.310 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.334 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.032) 0:04:45.451 ******* 2021-11-21T03:41:28.361 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-21T03:41:28.363 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.383 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.049) 0:04:45.501 ******* 2021-11-21T03:41:28.411 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-21T03:41:28.413 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.433 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.049) 0:04:45.551 ******* 2021-11-21T03:41:28.472 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-11-21T03:41:28.474 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.499 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.065) 0:04:45.616 ******* 2021-11-21T03:41:28.526 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-21T03:41:28.528 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.560 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.060) 0:04:45.677 ******* 2021-11-21T03:41:28.569 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-21T03:41:28.571 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "995", "ExecMainStartTimestamp": "Sun 2021-11-21 03:35:59 UTC", "ExecMainStartTimestampMonotonic": "13518636", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Sun 2021-11-21 03:35:58 UTC] ; stop_time=[Sun 2021-11-21 03:35:59 UTC] ; pid=977 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Sun 2021-11-21 03:35:59 UTC] ; stop_time=[Sun 2021-11-21 03:35:59 UTC] ; pid=1059 ; code=exited ; status=0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infi 2021-11-21T03:41:28.572 INFO:teuthology.task.ansible.out:nity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127285", "LimitNPROCSoft": "127285", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127285", "LimitSIGPENDINGSoft": "127285", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "995", "MemoryAccounting": "yes", "MemoryCurrent": "1576960", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203656", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000" 2021-11-21T03:41:28.574 INFO:teuthology.task.ansible.out:, "Type": "forking", "UID": "[not set]", "UMask": "0022", "WatchdogTimestamp": "Sun 2021-11-21 03:35:59 UTC", "WatchdogTimestampMonotonic": "13518643", "WatchdogUSec": "0"}} 2021-11-21T03:41:28.598 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.037) 0:04:45.714 ******* 2021-11-21T03:41:28.606 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.629 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.031) 0:04:45.746 ******* 2021-11-21T03:41:28.636 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-21T03:41:28.638 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-21T03:41:28.660 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.031) 0:04:45.778 ******* 2021-11-21T03:41:28.667 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-11-21T03:41:28.669 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.696 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.035) 0:04:45.813 ******* 2021-11-21T03:41:28.717 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-21T03:41:28.743 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.047) 0:04:45.861 ******* 2021-11-21T03:41:28.753 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-21T03:41:28.755 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.779 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.035) 0:04:45.896 ******* 2021-11-21T03:41:28.787 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.811 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.031) 0:04:45.928 ******* 2021-11-21T03:41:28.817 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-11-21T03:41:28.818 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.841 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.030) 0:04:45.959 ******* 2021-11-21T03:41:28.848 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-21T03:41:28.849 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.871 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.030) 0:04:45.989 ******* 2021-11-21T03:41:28.877 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-21T03:41:28.879 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.903 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.031) 0:04:46.021 ******* 2021-11-21T03:41:28.912 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-21T03:41:28.913 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:28.942 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:28 +0000 (0:00:00.038) 0:04:46.059 ******* 2021-11-21T03:41:29.108 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-21T03:41:29.110 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "gid": 1255, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-11-21T03:41:29.131 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:29 +0000 (0:00:00.188) 0:04:46.248 ******* 2021-11-21T03:41:29.315 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-21T03:41:29.316 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-11-21T03:41:29.338 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:29 +0000 (0:00:00.207) 0:04:46.456 ******* 2021-11-21T03:41:29.538 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-21T03:41:29.540 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1255, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-11-21T03:41:29.564 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:29 +0000 (0:00:00.225) 0:04:46.681 ******* 2021-11-21T03:41:29.603 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-21T03:41:29.604 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "995", "ExecMainStartTimestamp": "Sun 2021-11-21 03:36:05 UTC", "ExecMainStartTimestampMonotonic": "13652721", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Sun 2021-11-21 03:36:04 UTC] ; stop_time=[Sun 2021-11-21 03:36:05 UTC] ; pid=967 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Sun 2021-11-21 03:36:05 UTC] ; stop_time=[Sun 2021-11-21 03:36:05 UTC] ; pid=1055 ; code=exited ; status=0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infi 2021-11-21T03:41:29.605 INFO:teuthology.task.ansible.out:nity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127285", "LimitNPROCSoft": "127285", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127285", "LimitSIGPENDINGSoft": "127285", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "995", "MemoryAccounting": "yes", "MemoryCurrent": "1720320", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203656", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000" 2021-11-21T03:41:29.607 INFO:teuthology.task.ansible.out:, "Type": "forking", "UID": "[not set]", "UMask": "0022", "WatchdogTimestamp": "Sun 2021-11-21 03:36:05 UTC", "WatchdogTimestampMonotonic": "13652728", "WatchdogUSec": "0"}} 2021-11-21T03:41:29.630 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:29 +0000 (0:00:00.066) 0:04:46.748 ******* 2021-11-21T03:41:29.661 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-21T03:41:29.693 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:29 +0000 (0:00:00.062) 0:04:46.810 ******* 2021-11-21T03:41:29.733 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-21T03:41:29.735 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-21T03:41:29.756 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:29 +0000 (0:00:00.063) 0:04:46.874 ******* 2021-11-21T03:41:29.787 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-21T03:41:29.789 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:29.811 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:29 +0000 (0:00:00.054) 0:04:46.928 ******* 2021-11-21T03:41:29.840 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:29.863 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:29 +0000 (0:00:00.051) 0:04:46.980 ******* 2021-11-21T03:41:29.889 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-21T03:41:29.891 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:29.912 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:29 +0000 (0:00:00.049) 0:04:47.030 ******* 2021-11-21T03:41:30.078 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-21T03:41:30.080 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "gid": 1255, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-11-21T03:41:30.109 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:30 +0000 (0:00:00.196) 0:04:47.226 ******* 2021-11-21T03:41:30.492 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-11-21T03:41:30.494 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-11-21T03:41:30.517 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:30 +0000 (0:00:00.408) 0:04:47.635 ******* 2021-11-21T03:41:30.529 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-21T03:41:30.531 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1255, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-11-21T03:41:30.555 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:30 +0000 (0:00:00.037) 0:04:47.672 ******* 2021-11-21T03:41:30.562 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-21T03:41:30.566 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:30.596 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:30 +0000 (0:00:00.041) 0:04:47.714 ******* 2021-11-21T03:41:30.627 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-21T03:41:30.629 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-21T03:41:30.657 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:30 +0000 (0:00:00.061) 0:04:47.775 ******* 2021-11-21T03:41:30.820 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-11-21T03:41:30.843 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:30 +0000 (0:00:00.185) 0:04:47.960 ******* 2021-11-21T03:41:30.872 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-21T03:41:30.874 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:30.895 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:30 +0000 (0:00:00.052) 0:04:48.013 ******* 2021-11-21T03:41:30.924 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-21T03:41:30.925 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-21T03:41:30.948 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:30 +0000 (0:00:00.051) 0:04:48.065 ******* 2021-11-21T03:41:30.978 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-21T03:41:30.980 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:31.006 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.058) 0:04:48.123 ******* 2021-11-21T03:41:31.165 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [gibba022.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-21T03:41:31.193 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.186) 0:04:48.310 ******* 2021-11-21T03:41:31.351 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [gibba022.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-21T03:41:31.378 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.185) 0:04:48.496 ******* 2021-11-21T03:41:31.420 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-21T03:41:31.422 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages via pip] ************************************* ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-11-21T03:41:31.446 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.068) 0:04:48.564 ******* 2021-11-21T03:41:31.468 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.021) 0:04:48.585 ******* 2021-11-21T03:41:31.486 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-21T03:41:31.487 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:31.498 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} TASK [testnode : Purge resolvconf] ********************************************* 2021-11-21T03:41:31.500 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [gibba022.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:31.521 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.053) 0:04:48.639 ******* 2021-11-21T03:41:31.542 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.020) 0:04:48.659 ******* 2021-11-21T03:41:31.560 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-21T03:41:31.561 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:31.573 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:31.574 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} TASK [testnode : Set interface] ************************************************ ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-21T03:41:31.596 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.054) 0:04:48.714 ******* 2021-11-21T03:41:31.603 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-21T03:41:31.605 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba022.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:31.634 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.037) 0:04:48.751 ******* 2021-11-21T03:41:31.673 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:31.710 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.076) 0:04:48.828 ******* 2021-11-21T03:41:31.712 INFO:teuthology.task.ansible.out: 2021-11-21T03:41:31.739 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-21T03:41:31.741 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:31.762 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.052) 0:04:48.880 ******* 2021-11-21T03:41:31.770 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-11-21T03:41:31.795 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.032) 0:04:48.912 ******* 2021-11-21T03:41:31.802 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-21T03:41:31.804 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:31.830 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.034) 0:04:48.947 ******* 2021-11-21T03:41:31.838 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-21T03:41:31.840 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:31.862 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.031) 0:04:48.979 ******* 2021-11-21T03:41:31.868 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-21T03:41:31.869 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:31.898 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.032) 0:04:49.011 ******* 2021-11-21T03:41:31.901 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-21T03:41:31.903 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-21T03:41:31.927 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.033) 0:04:49.045 ******* 2021-11-21T03:41:31.944 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-21T03:41:31.946 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:31.970 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.041) 0:04:49.086 ******* 2021-11-21T03:41:31.976 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:31.999 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:31 +0000 (0:00:00.030) 0:04:49.117 ******* 2021-11-21T03:41:32.005 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-21T03:41:32.007 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.038 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:32 +0000 (0:00:00.038) 0:04:49.156 ******* 2021-11-21T03:41:32.068 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-21T03:41:32.069 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.093 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:32 +0000 (0:00:00.055) 0:04:49.211 ******* 2021-11-21T03:41:32.123 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.149 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:32 +0000 (0:00:00.054) 0:04:49.266 ******* 2021-11-21T03:41:32.157 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-21T03:41:32.159 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-21T03:41:32.184 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:32 +0000 (0:00:00.035) 0:04:49.301 ******* 2021-11-21T03:41:32.330 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-21T03:41:32.332 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.003454", "end": "2021-11-21 03:41:32.300105", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-21 03:41:32.296651", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:32.353 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-21T03:41:32.354 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-21T03:41:32.378 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:32 +0000 (0:00:00.193) 0:04:49.495 ******* 2021-11-21T03:41:32.410 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.433 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:32 +0000 (0:00:00.055) 0:04:49.550 ******* 2021-11-21T03:41:32.463 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-21T03:41:32.464 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002022", "end": "2021-11-21 03:41:32.443746", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-21 03:41:32.441724", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:32.476 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-21T03:41:32.477 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.487 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.499 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.500 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.524 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:32 +0000 (0:00:00.091) 0:04:49.641 ******* 2021-11-21T03:41:32.562 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-21T03:41:32.564 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.575 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.576 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.577 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.603 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:32 +0000 (0:00:00.079) 0:04:49.721 ******* 2021-11-21T03:41:32.610 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-21T03:41:32.612 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001820", "end": "2021-11-21 03:41:32.576370", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-21 03:41:32.574550", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:32.633 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.657 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:32 +0000 (0:00:00.054) 0:04:49.775 ******* 2021-11-21T03:41:32.695 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.724 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:32 +0000 (0:00:00.066) 0:04:49.841 ******* 2021-11-21T03:41:32.752 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-21T03:41:32.753 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.785 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:32 +0000 (0:00:00.061) 0:04:49.902 ******* 2021-11-21T03:41:32.794 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-21T03:41:32.795 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.032495", "end": "2021-11-21 03:41:32.740807", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-21 03:41:32.708312", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:32.830 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:32 +0000 (0:00:00.045) 0:04:49.947 ******* 2021-11-21T03:41:32.929 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Sunday 21 November 2021 03:41:32 +0000 (0:00:00.039) 0:04:49.986 ******* TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** Sunday 21 November 2021 03:41:32 +0000 (0:00:00.032) 0:04:50.019 ******* TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.939 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:32 +0000 (0:00:00.037) 0:04:50.057 ******* 2021-11-21T03:41:32.948 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-21T03:41:32.950 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:32.975 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:33.009 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:33 +0000 (0:00:00.069) 0:04:50.126 ******* 2021-11-21T03:41:33.047 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-21T03:41:33.049 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:33.073 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:33 +0000 (0:00:00.063) 0:04:50.190 ******* 2021-11-21T03:41:33.100 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-21T03:41:33.102 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:33.123 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:33 +0000 (0:00:00.050) 0:04:50.240 ******* 2021-11-21T03:41:33.299 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-21T03:41:33.300 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.003374", "end": "2021-11-21 03:41:33.271165", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-21 03:41:33.267791", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:33.435 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002256", "end": "2021-11-21 03:41:33.408928", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-21 03:41:33.406672", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:33.577 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001849", "end": "2021-11-21 03:41:33.547029", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-21 03:41:33.545180", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:33.727 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.028553", "end": "2021-11-21 03:41:33.707239", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-21 03:41:33.678686", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:33.749 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:33 +0000 (0:00:00.626) 0:04:50.867 ******* 2021-11-21T03:41:33.778 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-21T03:41:33.800 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:33 +0000 (0:00:00.050) 0:04:50.918 ******* 2021-11-21T03:41:33.829 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:33.899 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-11-21T03:41:33.918 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:33 +0000 (0:00:00.118) 0:04:51.036 ******* 2021-11-21T03:41:33.939 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:33 +0000 (0:00:00.020) 0:04:51.056 ******* 2021-11-21T03:41:34.494 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba022.front.sepia.ceph.com] 2021-11-21T03:41:34.536 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] 2021-11-21T03:41:34.579 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:34 +0000 (0:00:00.640) 0:04:51.697 ******* 2021-11-21T03:41:34.633 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:34 +0000 (0:00:00.054) 0:04:51.751 ******* 2021-11-21T03:41:34.642 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-21T03:41:34.644 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:34.678 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:34 +0000 (0:00:00.044) 0:04:51.795 ******* 2021-11-21T03:41:34.688 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:34.718 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:34 +0000 (0:00:00.040) 0:04:51.836 ******* 2021-11-21T03:41:34.727 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-21T03:41:34.729 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-11-21T03:41:34.751 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:34 +0000 (0:00:00.032) 0:04:51.868 ******* 2021-11-21T03:41:34.758 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-11-21T03:41:34.794 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:34 +0000 (0:00:00.042) 0:04:51.911 ******* 2021-11-21T03:41:34.803 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-21T03:41:34.805 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-11-21T03:41:34.829 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:34 +0000 (0:00:00.035) 0:04:51.947 ******* 2021-11-21T03:41:34.838 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-11-21T03:41:34.867 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:34 +0000 (0:00:00.037) 0:04:51.984 ******* 2021-11-21T03:41:36.921 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:41:36.944 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:36 +0000 (0:00:02.076) 0:04:54.061 ******* 2021-11-21T03:41:36.952 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:41:36.978 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:36 +0000 (0:00:00.034) 0:04:54.095 ******* 2021-11-21T03:41:36.984 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-21T03:41:36.986 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-11-21T03:41:37.009 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:37 +0000 (0:00:00.031) 0:04:54.126 ******* 2021-11-21T03:41:37.016 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-11-21T03:41:37.038 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:37 +0000 (0:00:00.029) 0:04:54.156 ******* 2021-11-21T03:41:37.044 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-21T03:41:37.046 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:37.070 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:37 +0000 (0:00:00.031) 0:04:54.188 ******* 2021-11-21T03:41:37.077 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:37.103 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:37 +0000 (0:00:00.033) 0:04:54.221 ******* 2021-11-21T03:41:37.260 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [gibba022.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-21T03:41:37.293 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-21T03:41:37.400 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-21T03:41:37.430 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:37 +0000 (0:00:00.326) 0:04:54.547 ******* 2021-11-21T03:41:37.460 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-21T03:41:37.487 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:37 +0000 (0:00:00.057) 0:04:54.605 ******* 2021-11-21T03:41:37.837 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-11-21T03:41:37.839 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-11-21T03:41:37.911 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-11-21T03:41:38.215 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-11-21T03:41:38.241 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:38 +0000 (0:00:00.753) 0:04:55.358 ******* 2021-11-21T03:41:38.243 INFO:teuthology.task.ansible.out: 2021-11-21T03:41:38.310 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-11-21T03:41:38.341 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:38 +0000 (0:00:00.100) 0:04:55.458 ******* 2021-11-21T03:41:40.301 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-11-21T03:41:40.303 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:41:40.331 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:40 +0000 (0:00:01.990) 0:04:57.449 ******* 2021-11-21T03:41:40.393 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-21T03:41:40.417 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:40 +0000 (0:00:00.085) 0:04:57.535 ******* 2021-11-21T03:41:42.434 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-11-21T03:41:42.436 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-9iol8k7f-build\nRequirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-9iol8k7f-build", "Requirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py ins 2021-11-21T03:41:42.437 INFO:teuthology.task.ansible.out:tall for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-21T03:41:42.457 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:42 +0000 (0:00:02.039) 0:04:59.574 ******* 2021-11-21T03:41:42.486 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:42.510 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:42 +0000 (0:00:00.052) 0:04:59.627 ******* 2021-11-21T03:41:42.529 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-11-21T03:41:42.530 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-44e4acxp-build\nRequirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-44e4acxp-build", "Requirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py ins 2021-11-21T03:41:42.532 INFO:teuthology.task.ansible.out:tall for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-21T03:41:42.566 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:42 +0000 (0:00:00.056) 0:04:59.684 ******* 2021-11-21T03:41:42.577 INFO:teuthology.task.ansible.out: 2021-11-21T03:41:42.579 INFO:teuthology.task.ansible.out:TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-11-21T03:41:42.580 INFO:teuthology.task.ansible.out:skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:42.614 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:42 +0000 (0:00:00.047) 0:04:59.731 ******* 2021-11-21T03:41:42.621 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-21T03:41:42.623 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:42.646 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:42 +0000 (0:00:00.032) 0:04:59.764 ******* 2021-11-21T03:41:42.694 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:42.716 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:42 +0000 (0:00:00.069) 0:04:59.834 ******* 2021-11-21T03:41:42.881 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-11-21T03:41:42.883 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.113041", "end": "2021-11-21 03:41:42.867654", "rc": 0, "start": "2021-11-21 03:41:42.754613", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:42.909 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:42 +0000 (0:00:00.192) 0:05:00.026 ******* 2021-11-21T03:41:42.952 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* skipping: [gibba022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:43.009 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-11-21T03:41:43.011 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.124432", "end": "2021-11-21 03:41:42.983767", "rc": 0, "start": "2021-11-21 03:41:42.859335", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-21T03:41:43.031 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:43 +0000 (0:00:00.122) 0:05:00.148 ******* 2021-11-21T03:41:43.069 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-11-21T03:41:43.071 INFO:teuthology.task.ansible.out:skipping: [gibba043.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-21T03:41:43.137 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-11-21T03:41:43.138 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-11-21T03:41:43.140 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-11-21T03:41:43.142 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-21T03:41:43.153 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-11-21T03:41:43.155 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:43 +0000 (0:00:00.122) 0:05:00.271 ******* 2021-11-21T03:41:43.736 INFO:teuthology.task.ansible.out:ok: [gibba022.front.sepia.ceph.com] 2021-11-21T03:41:43.766 INFO:teuthology.task.ansible.out:ok: [gibba043.front.sepia.ceph.com] 2021-11-21T03:41:43.783 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** 2021-11-21T03:41:43.784 INFO:teuthology.task.ansible.out:Sunday 21 November 2021 03:41:43 +0000 (0:00:00.629) 0:05:00.900 ******* 2021-11-21T03:41:43.955 INFO:teuthology.task.ansible.out:changed: [gibba022.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-11-21T03:41:43.968 INFO:teuthology.task.ansible.out:changed: [gibba043.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-11-21T03:41:43.972 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* 2021-11-21T03:41:43.973 INFO:teuthology.task.ansible.out:gibba022.front.sepia.ceph.com : ok=145 changed=43 unreachable=0 failed=0 skipped=174 rescued=0 ignored=4 gibba043.front.sepia.ceph.com : ok=145 changed=43 unreachable=0 failed=0 skipped=174 rescued=0 ignored=4 Sunday 21 November 2021 03:41:43 +0000 (0:00:00.189) 0:05:01.090 ******* =============================================================================== 2021-11-21T03:41:43.975 INFO:teuthology.task.ansible.out:Create all admin users with sudo access. ------------------------------- 28.84s users : Update authorized_keys using the keys repo --------------------- 28.05s testnode : Ensure ceph packages are not present. ----------------------- 27.99s testnode : Install packages -------------------------------------------- 20.86s testnode : Ensure ceph dependency packages are not present. ------------ 20.24s common : Register with subscription-manager. --------------------------- 16.00s Remove revoked users --------------------------------------------------- 14.75s common : nrpe - Load SELinux policy package ----------------------------- 9.59s common : nrpe - Remove SELinux policy package --------------------------- 9.37s common : Install Kerberos Packages (RedHat) ----------------------------- 7.83s testnode : Install epel packages ---------------------------------------- 7.57s testnode : Zap all non-root disks --------------------------------------- 7.13s testnode : Install GPG -------------------------------------------------- 4.54s common : Enable necessary rhsm repos ------------------------------------ 2.69s testnode : Install GPG keys --------------------------------------------- 2.55s testnode : Blow away lingering OSD data and FSIDs ----------------------- 2.15s common : Get list of enabled RHSM repos --------------------------------- 2.08s container-host : Install container packages ----------------------------- 2.08s common : Disable all rhsm repos ----------------------------------------- 2.07s container-host : Install registries-conf-ctl ---------------------------- 2.04s 2021-11-21T03:41:44.415 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba022.front.sepia.ceph.com'), Remote(name='ubuntu@gibba043.front.sepia.ceph.com')] 2021-11-21T03:41:44.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba022.front.sepia.ceph.com' 2021-11-21T03:41:44.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T03:41:44.526 DEBUG:teuthology.orchestra.run.gibba022:> true 2021-11-21T03:41:44.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba043.front.sepia.ceph.com' 2021-11-21T03:41:44.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-21T03:41:44.667 DEBUG:teuthology.orchestra.run.gibba043:> true 2021-11-21T03:41:44.743 INFO:teuthology.run_tasks:Running task clock... 2021-11-21T03:41:44.754 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-11-21T03:41:44.754 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-21T03:41:44.757 DEBUG:teuthology.orchestra.run.gibba022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-21T03:41:44.760 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-21T03:41:44.760 DEBUG:teuthology.orchestra.run.gibba043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-21T03:41:44.781 INFO:teuthology.orchestra.run.gibba022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-11-21T03:41:44.792 INFO:teuthology.orchestra.run.gibba022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-11-21T03:41:44.806 INFO:teuthology.orchestra.run.gibba043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-11-21T03:41:44.817 INFO:teuthology.orchestra.run.gibba043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-11-21T03:41:44.834 INFO:teuthology.orchestra.run.gibba022.stderr:sudo: ntpd: command not found 2021-11-21T03:41:44.841 INFO:teuthology.orchestra.run.gibba022.stdout:506 Cannot talk to daemon 2021-11-21T03:41:44.849 INFO:teuthology.orchestra.run.gibba043.stderr:sudo: ntpd: command not found 2021-11-21T03:41:44.852 INFO:teuthology.orchestra.run.gibba022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-11-21T03:41:44.856 INFO:teuthology.orchestra.run.gibba043.stdout:506 Cannot talk to daemon 2021-11-21T03:41:44.862 INFO:teuthology.orchestra.run.gibba022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-11-21T03:41:44.867 INFO:teuthology.orchestra.run.gibba043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-11-21T03:41:44.876 INFO:teuthology.orchestra.run.gibba043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-11-21T03:41:44.930 INFO:teuthology.orchestra.run.gibba043.stderr:bash: ntpq: command not found 2021-11-21T03:41:44.931 INFO:teuthology.orchestra.run.gibba022.stderr:bash: ntpq: command not found 2021-11-21T03:41:44.933 INFO:teuthology.orchestra.run.gibba043.stdout:210 Number of sources = 4 2021-11-21T03:41:44.934 INFO:teuthology.orchestra.run.gibba043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-11-21T03:41:44.934 INFO:teuthology.orchestra.run.gibba043.stdout:=============================================================================== 2021-11-21T03:41:44.934 INFO:teuthology.orchestra.run.gibba043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-21T03:41:44.934 INFO:teuthology.orchestra.run.gibba043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-21T03:41:44.935 INFO:teuthology.orchestra.run.gibba043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-21T03:41:44.935 INFO:teuthology.orchestra.run.gibba043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-21T03:41:44.936 INFO:teuthology.orchestra.run.gibba022.stdout:210 Number of sources = 4 2021-11-21T03:41:44.936 INFO:teuthology.orchestra.run.gibba022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-11-21T03:41:44.937 INFO:teuthology.orchestra.run.gibba022.stdout:=============================================================================== 2021-11-21T03:41:44.937 INFO:teuthology.orchestra.run.gibba022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-21T03:41:44.937 INFO:teuthology.orchestra.run.gibba022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-21T03:41:44.938 INFO:teuthology.orchestra.run.gibba022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-21T03:41:44.938 INFO:teuthology.orchestra.run.gibba022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-21T03:41:44.938 INFO:teuthology.run_tasks:Running task install... 2021-11-21T03:41:44.947 DEBUG:teuthology.task.install:project ceph 2021-11-21T03:41:44.948 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}} 2021-11-21T03:41:44.948 DEBUG:teuthology.task.install:config {'extra_packages': ['rbd-mirror'], 'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'} 2021-11-21T03:41:44.949 INFO:teuthology.task.install:Using flavor: default 2021-11-21T03:41:44.959 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-11-21T03:41:44.960 INFO:teuthology.task.install:extra packages: ['rbd-mirror'] 2021-11-21T03:41:44.960 DEBUG:teuthology.orchestra.run.gibba022:> sudo lsb_release -is 2021-11-21T03:41:45.004 INFO:teuthology.orchestra.run.gibba022.stdout:RedHatEnterprise 2021-11-21T03:41:45.005 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-11-21T03:41:45.006 DEBUG:teuthology.orchestra.run.gibba043:> sudo lsb_release -is 2021-11-21T03:41:45.006 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-mirror'], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff', 'tag': None, 'wait_for_package': False} 2021-11-21T03:41:45.007 DEBUG:teuthology.orchestra.run.gibba022:> sudo lsb_release -is 2021-11-21T03:41:45.036 INFO:teuthology.orchestra.run.gibba043.stdout:RedHatEnterprise 2021-11-21T03:41:45.038 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-11-21T03:41:45.038 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-mirror'], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff', 'tag': None, 'wait_for_package': False} 2021-11-21T03:41:45.039 DEBUG:teuthology.orchestra.run.gibba043:> sudo lsb_release -is 2021-11-21T03:41:45.073 INFO:teuthology.orchestra.run.gibba022.stdout:RedHatEnterprise 2021-11-21T03:41:45.075 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-11-21T03:41:45.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-21T03:41:45.110 INFO:teuthology.orchestra.run.gibba043.stdout:RedHatEnterprise 2021-11-21T03:41:45.111 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-11-21T03:41:45.111 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-21T03:41:45.305 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/centos/8/flavors/default/ 2021-11-21T03:41:45.306 INFO:teuthology.task.install.rpm:Package version is 15.2.15-32.gb0aaed0f 2021-11-21T03:41:45.317 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/centos/8/flavors/default/ 2021-11-21T03:41:45.317 INFO:teuthology.task.install.rpm:Package version is 15.2.15-32.gb0aaed0f 2021-11-21T03:41:45.501 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-11-21T03:41:45.502 DEBUG:teuthology.orchestra.run.gibba022:> set -ex 2021-11-21T03:41:45.502 DEBUG:teuthology.orchestra.run.gibba022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-11-21T03:41:45.522 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/octopus/b0aaed0fe8cdfe99c82a70b230004934b51091ff/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-11-21T03:41:45.522 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-11-21T03:41:45.523 DEBUG:teuthology.orchestra.run.gibba043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-11-21T03:41:45.525 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-mirror on remote rpm x86_64 2021-11-21T03:41:45.526 DEBUG:teuthology.orchestra.run.gibba022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0aaed0fe8cdfe99c82a70b230004934b51091ff/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-11-21T03:41:45.547 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-mirror on remote rpm x86_64 2021-11-21T03:41:45.547 DEBUG:teuthology.orchestra.run.gibba043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0aaed0fe8cdfe99c82a70b230004934b51091ff/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-11-21T03:41:45.585 DEBUG:teuthology.orchestra.run.gibba022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-11-21T03:41:45.608 DEBUG:teuthology.orchestra.run.gibba043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-11-21T03:41:45.651 DEBUG:teuthology.orchestra.run.gibba022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-11-21T03:41:45.675 DEBUG:teuthology.orchestra.run.gibba043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-11-21T03:41:45.709 INFO:teuthology.orchestra.run.gibba022.stdout:check_obsoletes = 1 2021-11-21T03:41:45.711 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum clean all 2021-11-21T03:41:45.733 INFO:teuthology.orchestra.run.gibba043.stdout:check_obsoletes = 1 2021-11-21T03:41:45.735 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum clean all 2021-11-21T03:41:45.949 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:41:45.976 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:41:46.233 INFO:teuthology.orchestra.run.gibba022.stdout:59 files removed 2021-11-21T03:41:46.254 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install ceph-radosgw 2021-11-21T03:41:46.281 INFO:teuthology.orchestra.run.gibba043.stdout:59 files removed 2021-11-21T03:41:46.302 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install ceph-radosgw 2021-11-21T03:41:46.449 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:41:46.499 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:41:47.172 INFO:teuthology.orchestra.run.gibba022.stdout:ceph packages for x86_64 186 kB/s | 69 kB 00:00 2021-11-21T03:41:47.222 INFO:teuthology.orchestra.run.gibba043.stdout:ceph packages for x86_64 184 kB/s | 69 kB 00:00 2021-11-21T03:41:47.494 INFO:teuthology.orchestra.run.gibba022.stdout:ceph noarch packages 51 kB/s | 15 kB 00:00 2021-11-21T03:41:47.544 INFO:teuthology.orchestra.run.gibba043.stdout:ceph noarch packages 51 kB/s | 15 kB 00:00 2021-11-21T03:41:47.799 INFO:teuthology.orchestra.run.gibba022.stdout:ceph source packages 4.9 kB/s | 1.4 kB 00:00 2021-11-21T03:41:47.849 INFO:teuthology.orchestra.run.gibba043.stdout:ceph source packages 4.9 kB/s | 1.4 kB 00:00 2021-11-21T03:41:49.703 INFO:teuthology.orchestra.run.gibba043.stdout:Copr repo for python3-asyncssh owned by ceph 1.9 kB/s | 3.5 kB 00:01 2021-11-21T03:41:49.704 INFO:teuthology.orchestra.run.gibba022.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2021-11-21T03:41:50.850 INFO:teuthology.orchestra.run.gibba022.stdout:Apache Arrow 163 kB/s | 184 kB 00:01 2021-11-21T03:41:50.907 INFO:teuthology.orchestra.run.gibba043.stdout:Apache Arrow 155 kB/s | 184 kB 00:01 2021-11-21T03:41:51.628 INFO:teuthology.orchestra.run.gibba022.stdout:Extra Packages for Enterprise Linux 15 MB/s | 11 MB 00:00 2021-11-21T03:41:51.687 INFO:teuthology.orchestra.run.gibba043.stdout:Extra Packages for Enterprise Linux 15 MB/s | 11 MB 00:00 2021-11-21T03:41:53.261 INFO:teuthology.orchestra.run.gibba022.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2021-11-21T03:41:53.345 INFO:teuthology.orchestra.run.gibba043.stdout:lab-extras 4.9 MB/s | 24 kB 00:00 2021-11-21T03:41:53.491 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 143 MB/s | 26 MB 00:00 2021-11-21T03:41:53.613 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 133 MB/s | 29 MB 00:00 2021-11-21T03:41:56.578 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 151 MB/s | 29 MB 00:00 2021-11-21T03:41:56.855 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 139 MB/s | 26 MB 00:00 2021-11-21T03:42:01.795 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:42:01.803 INFO:teuthology.orchestra.run.gibba022.stdout:=================================================================================================== 2021-11-21T03:42:01.803 INFO:teuthology.orchestra.run.gibba022.stdout: Package Arch Version Repository Size 2021-11-21T03:42:01.804 INFO:teuthology.orchestra.run.gibba022.stdout:=================================================================================================== 2021-11-21T03:42:01.804 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:42:01.804 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-radosgw x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 10 M 2021-11-21T03:42:01.805 INFO:teuthology.orchestra.run.gibba022.stdout:Upgrading: 2021-11-21T03:42:01.805 INFO:teuthology.orchestra.run.gibba022.stdout: librados2 x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 3.5 M 2021-11-21T03:42:01.805 INFO:teuthology.orchestra.run.gibba022.stdout: librbd1 x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 1.9 M 2021-11-21T03:42:01.805 INFO:teuthology.orchestra.run.gibba022.stdout:Installing dependencies: 2021-11-21T03:42:01.805 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-base x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 5.6 M 2021-11-21T03:42:01.806 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-common x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 21 M 2021-11-21T03:42:01.806 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-selinux x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 26 k 2021-11-21T03:42:01.806 INFO:teuthology.orchestra.run.gibba022.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-11-21T03:42:01.806 INFO:teuthology.orchestra.run.gibba022.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-11-21T03:42:01.807 INFO:teuthology.orchestra.run.gibba022.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-11-21T03:42:01.807 INFO:teuthology.orchestra.run.gibba022.stdout: libcephfs2 x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 509 k 2021-11-21T03:42:01.807 INFO:teuthology.orchestra.run.gibba022.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-11-21T03:42:01.808 INFO:teuthology.orchestra.run.gibba022.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2021-11-21T03:42:01.808 INFO:teuthology.orchestra.run.gibba022.stdout: libradosstriper1 x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 380 k 2021-11-21T03:42:01.808 INFO:teuthology.orchestra.run.gibba022.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2021-11-21T03:42:01.808 INFO:teuthology.orchestra.run.gibba022.stdout: librgw2 x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 3.2 M 2021-11-21T03:42:01.809 INFO:teuthology.orchestra.run.gibba022.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-11-21T03:42:01.809 INFO:teuthology.orchestra.run.gibba022.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2021-11-21T03:42:01.809 INFO:teuthology.orchestra.run.gibba022.stdout: python3-ceph-argparse x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 40 k 2021-11-21T03:42:01.809 INFO:teuthology.orchestra.run.gibba022.stdout: python3-ceph-common x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 77 k 2021-11-21T03:42:01.809 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cephfs x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 164 k 2021-11-21T03:42:01.810 INFO:teuthology.orchestra.run.gibba022.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2021-11-21T03:42:01.810 INFO:teuthology.orchestra.run.gibba022.stdout: python3-rados x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 364 k 2021-11-21T03:42:01.810 INFO:teuthology.orchestra.run.gibba022.stdout: python3-rbd x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 349 k 2021-11-21T03:42:01.810 INFO:teuthology.orchestra.run.gibba022.stdout: python3-rgw x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 113 k 2021-11-21T03:42:01.811 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:42:01.811 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:42:01.811 INFO:teuthology.orchestra.run.gibba022.stdout:=================================================================================================== 2021-11-21T03:42:01.811 INFO:teuthology.orchestra.run.gibba022.stdout:Install 22 Packages 2021-11-21T03:42:01.812 INFO:teuthology.orchestra.run.gibba022.stdout:Upgrade 2 Packages 2021-11-21T03:42:01.812 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:42:01.813 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 48 M 2021-11-21T03:42:01.813 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:42:02.024 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:42:02.039 INFO:teuthology.orchestra.run.gibba043.stdout:=================================================================================================== 2021-11-21T03:42:02.039 INFO:teuthology.orchestra.run.gibba043.stdout: Package Arch Version Repository Size 2021-11-21T03:42:02.040 INFO:teuthology.orchestra.run.gibba043.stdout:=================================================================================================== 2021-11-21T03:42:02.040 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:42:02.041 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-radosgw x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 10 M 2021-11-21T03:42:02.041 INFO:teuthology.orchestra.run.gibba043.stdout:Upgrading: 2021-11-21T03:42:02.042 INFO:teuthology.orchestra.run.gibba043.stdout: librados2 x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 3.5 M 2021-11-21T03:42:02.043 INFO:teuthology.orchestra.run.gibba043.stdout: librbd1 x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 1.9 M 2021-11-21T03:42:02.043 INFO:teuthology.orchestra.run.gibba043.stdout:Installing dependencies: 2021-11-21T03:42:02.043 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-base x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 5.6 M 2021-11-21T03:42:02.044 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-common x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 21 M 2021-11-21T03:42:02.044 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-selinux x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 26 k 2021-11-21T03:42:02.044 INFO:teuthology.orchestra.run.gibba043.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-11-21T03:42:02.044 INFO:teuthology.orchestra.run.gibba043.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-11-21T03:42:02.045 INFO:teuthology.orchestra.run.gibba043.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-11-21T03:42:02.045 INFO:teuthology.orchestra.run.gibba043.stdout: libcephfs2 x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 509 k 2021-11-21T03:42:02.045 INFO:teuthology.orchestra.run.gibba043.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-11-21T03:42:02.045 INFO:teuthology.orchestra.run.gibba043.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2021-11-21T03:42:02.045 INFO:teuthology.orchestra.run.gibba043.stdout: libradosstriper1 x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 380 k 2021-11-21T03:42:02.046 INFO:teuthology.orchestra.run.gibba043.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2021-11-21T03:42:02.046 INFO:teuthology.orchestra.run.gibba043.stdout: librgw2 x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 3.2 M 2021-11-21T03:42:02.046 INFO:teuthology.orchestra.run.gibba043.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-11-21T03:42:02.046 INFO:teuthology.orchestra.run.gibba043.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2021-11-21T03:42:02.046 INFO:teuthology.orchestra.run.gibba043.stdout: python3-ceph-argparse x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 40 k 2021-11-21T03:42:02.047 INFO:teuthology.orchestra.run.gibba043.stdout: python3-ceph-common x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 77 k 2021-11-21T03:42:02.047 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cephfs x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 164 k 2021-11-21T03:42:02.047 INFO:teuthology.orchestra.run.gibba043.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2021-11-21T03:42:02.047 INFO:teuthology.orchestra.run.gibba043.stdout: python3-rados x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 364 k 2021-11-21T03:42:02.048 INFO:teuthology.orchestra.run.gibba043.stdout: python3-rbd x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 349 k 2021-11-21T03:42:02.048 INFO:teuthology.orchestra.run.gibba043.stdout: python3-rgw x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 113 k 2021-11-21T03:42:02.048 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:42:02.048 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:42:02.048 INFO:teuthology.orchestra.run.gibba043.stdout:=================================================================================================== 2021-11-21T03:42:02.049 INFO:teuthology.orchestra.run.gibba043.stdout:Install 22 Packages 2021-11-21T03:42:02.049 INFO:teuthology.orchestra.run.gibba043.stdout:Upgrade 2 Packages 2021-11-21T03:42:02.049 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:42:02.050 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 48 M 2021-11-21T03:42:02.050 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:42:02.536 INFO:teuthology.orchestra.run.gibba022.stdout:(1/24): ceph-base-15.2.15-32.gb0aaed0f.el8.x86_ 7.6 MB/s | 5.6 MB 00:00 2021-11-21T03:42:02.591 INFO:teuthology.orchestra.run.gibba022.stdout:(2/24): ceph-selinux-15.2.15-32.gb0aaed0f.el8.x 465 kB/s | 26 kB 00:00 2021-11-21T03:42:02.669 INFO:teuthology.orchestra.run.gibba022.stdout:(3/24): libcephfs2-15.2.15-32.gb0aaed0f.el8.x86 6.4 MB/s | 509 kB 00:00 2021-11-21T03:42:02.746 INFO:teuthology.orchestra.run.gibba022.stdout:(4/24): libradosstriper1-15.2.15-32.gb0aaed0f.e 4.8 MB/s | 380 kB 00:00 2021-11-21T03:42:03.102 INFO:teuthology.orchestra.run.gibba022.stdout:(5/24): librgw2-15.2.15-32.gb0aaed0f.el8.x86_64 9.0 MB/s | 3.2 MB 00:00 2021-11-21T03:42:03.155 INFO:teuthology.orchestra.run.gibba022.stdout:(6/24): python3-ceph-argparse-15.2.15-32.gb0aae 751 kB/s | 40 kB 00:00 2021-11-21T03:42:03.211 INFO:teuthology.orchestra.run.gibba022.stdout:(7/24): python3-ceph-common-15.2.15-32.gb0aaed0 1.4 MB/s | 77 kB 00:00 2021-11-21T03:42:03.270 INFO:teuthology.orchestra.run.gibba022.stdout:(8/24): python3-cephfs-15.2.15-32.gb0aaed0f.el8 2.7 MB/s | 164 kB 00:00 2021-11-21T03:42:03.339 INFO:teuthology.orchestra.run.gibba022.stdout:(9/24): python3-rados-15.2.15-32.gb0aaed0f.el8. 5.2 MB/s | 364 kB 00:00 2021-11-21T03:42:03.406 INFO:teuthology.orchestra.run.gibba022.stdout:(10/24): python3-rbd-15.2.15-32.gb0aaed0f.el8.x 5.1 MB/s | 349 kB 00:00 2021-11-21T03:42:03.467 INFO:teuthology.orchestra.run.gibba022.stdout:(11/24): python3-rgw-15.2.15-32.gb0aaed0f.el8.x 1.9 MB/s | 113 kB 00:00 2021-11-21T03:42:03.617 INFO:teuthology.orchestra.run.gibba022.stdout:(12/24): ceph-common-15.2.15-32.gb0aaed0f.el8.x 11 MB/s | 21 MB 00:01 2021-11-21T03:42:03.628 INFO:teuthology.orchestra.run.gibba022.stdout:(13/24): fmt-6.2.1-1.el8.x86_64.rpm 720 kB/s | 116 kB 00:00 2021-11-21T03:42:03.699 INFO:teuthology.orchestra.run.gibba022.stdout:(14/24): leveldb-1.22-1.el8.x86_64.rpm 2.5 MB/s | 181 kB 00:00 2021-11-21T03:42:03.738 INFO:teuthology.orchestra.run.gibba022.stdout:(15/24): liboath-2.6.2-3.el8.x86_64.rpm 1.5 MB/s | 59 kB 00:00 2021-11-21T03:42:03.792 INFO:teuthology.orchestra.run.gibba022.stdout:(16/24): libunwind-1.3.1-3.el8.x86_64.rpm 1.4 MB/s | 75 kB 00:00 2021-11-21T03:42:03.823 INFO:teuthology.orchestra.run.gibba022.stdout:(17/24): python3-prettytable-0.7.2-14.el8.noarc 1.4 MB/s | 44 kB 00:00 2021-11-21T03:42:03.843 INFO:teuthology.orchestra.run.gibba022.stdout:(18/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 13 MB/s | 259 kB 00:00 2021-11-21T03:42:03.863 INFO:teuthology.orchestra.run.gibba022.stdout:(19/24): librdkafka-0.11.4-1.el8.x86_64.rpm 17 MB/s | 353 kB 00:00 2021-11-21T03:42:03.876 INFO:teuthology.orchestra.run.gibba022.stdout:(20/24): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2021-11-21T03:42:03.880 INFO:teuthology.orchestra.run.gibba022.stdout:(21/24): librabbitmq-0.9.0-2.el8.x86_64.rpm 2.6 MB/s | 47 kB 00:00 2021-11-21T03:42:04.042 INFO:teuthology.orchestra.run.gibba043.stdout:(1/24): ceph-base-15.2.15-32.gb0aaed0f.el8.x86_ 2.8 MB/s | 5.6 MB 00:02 2021-11-21T03:42:04.096 INFO:teuthology.orchestra.run.gibba022.stdout:(22/24): librbd1-15.2.15-32.gb0aaed0f.el8.x86_6 9.0 MB/s | 1.9 MB 00:00 2021-11-21T03:42:04.101 INFO:teuthology.orchestra.run.gibba043.stdout:(2/24): ceph-selinux-15.2.15-32.gb0aaed0f.el8.x 435 kB/s | 26 kB 00:00 2021-11-21T03:42:04.136 INFO:teuthology.orchestra.run.gibba022.stdout:(23/24): ceph-radosgw-15.2.15-32.gb0aaed0f.el8. 4.3 MB/s | 10 MB 00:02 2021-11-21T03:42:04.182 INFO:teuthology.orchestra.run.gibba022.stdout:(24/24): librados2-15.2.15-32.gb0aaed0f.el8.x86 11 MB/s | 3.5 MB 00:00 2021-11-21T03:42:04.188 INFO:teuthology.orchestra.run.gibba043.stdout:(3/24): libcephfs2-15.2.15-32.gb0aaed0f.el8.x86 5.9 MB/s | 509 kB 00:00 2021-11-21T03:42:04.189 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:42:04.189 INFO:teuthology.orchestra.run.gibba022.stdout:Total 20 MB/s | 48 MB 00:02 2021-11-21T03:42:04.189 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:42:04.224 INFO:teuthology.orchestra.run.gibba043.stdout:(4/24): libradosstriper1-15.2.15-32.gb0aaed0f.e 9.9 MB/s | 380 kB 00:00 2021-11-21T03:42:04.233 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:42:04.233 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:42:04.499 INFO:teuthology.orchestra.run.gibba043.stdout:(5/24): librgw2-15.2.15-32.gb0aaed0f.el8.x86_64 12 MB/s | 3.2 MB 00:00 2021-11-21T03:42:04.533 INFO:teuthology.orchestra.run.gibba043.stdout:(6/24): python3-ceph-argparse-15.2.15-32.gb0aae 1.1 MB/s | 40 kB 00:00 2021-11-21T03:42:04.568 INFO:teuthology.orchestra.run.gibba043.stdout:(7/24): python3-ceph-common-15.2.15-32.gb0aaed0 2.2 MB/s | 77 kB 00:00 2021-11-21T03:42:04.603 INFO:teuthology.orchestra.run.gibba043.stdout:(8/24): python3-cephfs-15.2.15-32.gb0aaed0f.el8 4.6 MB/s | 164 kB 00:00 2021-11-21T03:42:04.640 INFO:teuthology.orchestra.run.gibba043.stdout:(9/24): python3-rados-15.2.15-32.gb0aaed0f.el8. 9.5 MB/s | 364 kB 00:00 2021-11-21T03:42:04.678 INFO:teuthology.orchestra.run.gibba043.stdout:(10/24): python3-rbd-15.2.15-32.gb0aaed0f.el8.x 9.2 MB/s | 349 kB 00:00 2021-11-21T03:42:04.713 INFO:teuthology.orchestra.run.gibba043.stdout:(11/24): python3-rgw-15.2.15-32.gb0aaed0f.el8.x 3.2 MB/s | 113 kB 00:00 2021-11-21T03:42:04.842 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:42:04.845 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:42:04.867 INFO:teuthology.orchestra.run.gibba043.stdout:(12/24): fmt-6.2.1-1.el8.x86_64.rpm 755 kB/s | 116 kB 00:00 2021-11-21T03:42:04.926 INFO:teuthology.orchestra.run.gibba043.stdout:(13/24): gperftools-libs-2.7-9.el8.x86_64.rpm 5.1 MB/s | 306 kB 00:00 2021-11-21T03:42:04.957 INFO:teuthology.orchestra.run.gibba043.stdout:(14/24): leveldb-1.22-1.el8.x86_64.rpm 5.9 MB/s | 181 kB 00:00 2021-11-21T03:42:04.987 INFO:teuthology.orchestra.run.gibba043.stdout:(15/24): liboath-2.6.2-3.el8.x86_64.rpm 2.0 MB/s | 59 kB 00:00 2021-11-21T03:42:05.015 INFO:teuthology.orchestra.run.gibba043.stdout:(16/24): libunwind-1.3.1-3.el8.x86_64.rpm 2.5 MB/s | 75 kB 00:00 2021-11-21T03:42:05.044 INFO:teuthology.orchestra.run.gibba043.stdout:(17/24): librabbitmq-0.9.0-2.el8.x86_64.rpm 1.6 MB/s | 47 kB 00:00 2021-11-21T03:42:05.064 INFO:teuthology.orchestra.run.gibba043.stdout:(18/24): python3-prettytable-0.7.2-14.el8.noarc 2.1 MB/s | 44 kB 00:00 2021-11-21T03:42:05.084 INFO:teuthology.orchestra.run.gibba043.stdout:(19/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 13 MB/s | 259 kB 00:00 2021-11-21T03:42:05.103 INFO:teuthology.orchestra.run.gibba043.stdout:(20/24): librdkafka-0.11.4-1.el8.x86_64.rpm 18 MB/s | 353 kB 00:00 2021-11-21T03:42:05.385 INFO:teuthology.orchestra.run.gibba043.stdout:(21/24): librados2-15.2.15-32.gb0aaed0f.el8.x86 13 MB/s | 3.5 MB 00:00 2021-11-21T03:42:05.525 INFO:teuthology.orchestra.run.gibba043.stdout:(22/24): librbd1-15.2.15-32.gb0aaed0f.el8.x86_6 14 MB/s | 1.9 MB 00:00 2021-11-21T03:42:05.808 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:42:06.108 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2021-11-21T03:42:06.295 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/26 2021-11-21T03:42:06.580 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/26 2021-11-21T03:42:06.853 INFO:teuthology.orchestra.run.gibba022.stdout: Upgrading : librados2-2:15.2.15-32.gb0aaed0f.el8.x86_64 3/26 2021-11-21T03:42:06.933 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: librados2-2:15.2.15-32.gb0aaed0f.el8.x86_64 3/26 2021-11-21T03:42:07.120 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-rados-2:15.2.15-32.gb0aaed0f.el8.x86_64 4/26 2021-11-21T03:42:07.347 INFO:teuthology.orchestra.run.gibba043.stdout:(23/24): ceph-radosgw-15.2.15-32.gb0aaed0f.el8. 1.9 MB/s | 10 MB 00:05 2021-11-21T03:42:07.377 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/26 2021-11-21T03:42:07.578 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : libcephfs2-2:15.2.15-32.gb0aaed0f.el8.x86_64 6/26 2021-11-21T03:42:07.766 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: libcephfs2-2:15.2.15-32.gb0aaed0f.el8.x86_64 6/26 2021-11-21T03:42:08.011 INFO:teuthology.orchestra.run.gibba022.stdout: Upgrading : librbd1-2:15.2.15-32.gb0aaed0f.el8.x86_64 7/26 2021-11-21T03:42:08.073 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: librbd1-2:15.2.15-32.gb0aaed0f.el8.x86_64 7/26 2021-11-21T03:42:08.311 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 8/26 2021-11-21T03:42:08.495 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/26 2021-11-21T03:42:08.544 INFO:teuthology.orchestra.run.gibba043.stdout:(24/24): ceph-common-15.2.15-32.gb0aaed0f.el8.x 3.2 MB/s | 21 MB 00:06 2021-11-21T03:42:08.546 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:42:08.547 INFO:teuthology.orchestra.run.gibba043.stdout:Total 7.4 MB/s | 48 MB 00:06 2021-11-21T03:42:08.552 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:42:08.640 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:42:08.640 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:42:08.789 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/26 2021-11-21T03:42:08.970 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : librgw2-2:15.2.15-32.gb0aaed0f.el8.x86_64 10/26 2021-11-21T03:42:09.053 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: librgw2-2:15.2.15-32.gb0aaed0f.el8.x86_64 10/26 2021-11-21T03:42:09.247 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:42:09.250 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:42:09.259 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2021-11-21T03:42:09.400 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-ceph-argparse-2:15.2.15-32.gb0aaed0f.el8.x 12/26 2021-11-21T03:42:09.613 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-cephfs-2:15.2.15-32.gb0aaed0f.el8.x86_64 13/26 2021-11-21T03:42:09.846 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-rgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 14/26 2021-11-21T03:42:10.079 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-rbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 15/26 2021-11-21T03:42:10.228 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : libradosstriper1-2:15.2.15-32.gb0aaed0f.el8.x86_64 16/26 2021-11-21T03:42:10.259 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:42:10.283 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: libradosstriper1-2:15.2.15-32.gb0aaed0f.el8.x86_64 16/26 2021-11-21T03:42:10.502 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/26 2021-11-21T03:42:10.552 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2021-11-21T03:42:10.719 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 18/26 2021-11-21T03:42:10.766 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/26 2021-11-21T03:42:10.978 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2021-11-21T03:42:11.047 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/26 2021-11-21T03:42:11.195 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86 20/26 2021-11-21T03:42:11.308 INFO:teuthology.orchestra.run.gibba043.stdout: Upgrading : librados2-2:15.2.15-32.gb0aaed0f.el8.x86_64 3/26 2021-11-21T03:42:11.377 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: librados2-2:15.2.15-32.gb0aaed0f.el8.x86_64 3/26 2021-11-21T03:42:11.604 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-rados-2:15.2.15-32.gb0aaed0f.el8.x86_64 4/26 2021-11-21T03:42:11.898 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/26 2021-11-21T03:42:12.133 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : libcephfs2-2:15.2.15-32.gb0aaed0f.el8.x86_64 6/26 2021-11-21T03:42:12.345 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: libcephfs2-2:15.2.15-32.gb0aaed0f.el8.x86_64 6/26 2021-11-21T03:42:12.583 INFO:teuthology.orchestra.run.gibba043.stdout: Upgrading : librbd1-2:15.2.15-32.gb0aaed0f.el8.x86_64 7/26 2021-11-21T03:42:12.657 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: librbd1-2:15.2.15-32.gb0aaed0f.el8.x86_64 7/26 2021-11-21T03:42:12.849 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/26 2021-11-21T03:42:12.904 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/26 2021-11-21T03:42:13.316 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 9/26 2021-11-21T03:42:13.533 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : librgw2-2:15.2.15-32.gb0aaed0f.el8.x86_64 10/26 2021-11-21T03:42:13.588 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: librgw2-2:15.2.15-32.gb0aaed0f.el8.x86_64 10/26 2021-11-21T03:42:13.870 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2021-11-21T03:42:14.039 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-ceph-argparse-2:15.2.15-32.gb0aaed0f.el8.x 12/26 2021-11-21T03:42:14.127 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86_64 21/26 2021-11-21T03:42:14.251 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-cephfs-2:15.2.15-32.gb0aaed0f.el8.x86_64 13/26 2021-11-21T03:42:14.370 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86_64 21/26 2021-11-21T03:42:14.525 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-rgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 14/26 2021-11-21T03:42:14.758 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-rbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 15/26 2021-11-21T03:42:14.865 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86_64 21/26 2021-11-21T03:42:14.946 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : libradosstriper1-2:15.2.15-32.gb0aaed0f.el8.x86_64 16/26 2021-11-21T03:42:15.019 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: libradosstriper1-2:15.2.15-32.gb0aaed0f.el8.x86_64 16/26 2021-11-21T03:42:15.153 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-base-2:15.2.15-32.gb0aaed0f.el8.x86_64 22/26 2021-11-21T03:42:15.220 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-base-2:15.2.15-32.gb0aaed0f.el8.x86_64 22/26 2021-11-21T03:42:15.246 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/26 2021-11-21T03:42:15.362 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-selinux-2:15.2.15-32.gb0aaed0f.el8.x86_64 23/26 2021-11-21T03:42:15.478 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 18/26 2021-11-21T03:42:15.759 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2021-11-21T03:42:15.988 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86 20/26 2021-11-21T03:42:18.987 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86_64 21/26 2021-11-21T03:42:19.184 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86_64 21/26 2021-11-21T03:42:19.700 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86_64 21/26 2021-11-21T03:42:20.008 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-base-2:15.2.15-32.gb0aaed0f.el8.x86_64 22/26 2021-11-21T03:42:20.074 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-base-2:15.2.15-32.gb0aaed0f.el8.x86_64 22/26 2021-11-21T03:42:20.241 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-selinux-2:15.2.15-32.gb0aaed0f.el8.x86_64 23/26 2021-11-21T03:42:25.568 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-selinux-2:15.2.15-32.gb0aaed0f.el8.x86_64 23/26 2021-11-21T03:42:25.568 INFO:teuthology.orchestra.run.gibba022.stdout:skipping the directory /sys 2021-11-21T03:42:25.568 INFO:teuthology.orchestra.run.gibba022.stdout:skipping the directory /proc 2021-11-21T03:42:25.569 INFO:teuthology.orchestra.run.gibba022.stdout:skipping the directory /dev 2021-11-21T03:42:25.569 INFO:teuthology.orchestra.run.gibba022.stdout:skipping the directory /run 2021-11-21T03:42:25.569 INFO:teuthology.orchestra.run.gibba022.stdout:skipping the directory /mnt 2021-11-21T03:42:25.569 INFO:teuthology.orchestra.run.gibba022.stdout:skipping the directory /var/tmp 2021-11-21T03:42:25.569 INFO:teuthology.orchestra.run.gibba022.stdout:skipping the directory /home 2021-11-21T03:42:25.570 INFO:teuthology.orchestra.run.gibba022.stdout:skipping the directory /tmp 2021-11-21T03:42:25.570 INFO:teuthology.orchestra.run.gibba022.stdout:skipping the directory /dev 2021-11-21T03:42:25.571 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:42:26.528 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-radosgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 24/26 2021-11-21T03:42:26.594 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-radosgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 24/26 2021-11-21T03:42:26.595 INFO:teuthology.orchestra.run.gibba022.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-11-21T03:42:26.797 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-11-21T03:42:26.798 INFO:teuthology.orchestra.run.gibba022.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2021-11-21T03:42:27.448 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2021-11-21T03:42:27.448 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-base-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/26 2021-11-21T03:42:27.449 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86_64 2/26 2021-11-21T03:42:27.449 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-radosgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 3/26 2021-11-21T03:42:27.449 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-selinux-2:15.2.15-32.gb0aaed0f.el8.x86_64 4/26 2021-11-21T03:42:27.449 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : libcephfs2-2:15.2.15-32.gb0aaed0f.el8.x86_64 5/26 2021-11-21T03:42:27.450 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : libradosstriper1-2:15.2.15-32.gb0aaed0f.el8.x86_64 6/26 2021-11-21T03:42:27.450 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : librgw2-2:15.2.15-32.gb0aaed0f.el8.x86_64 7/26 2021-11-21T03:42:27.450 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-ceph-argparse-2:15.2.15-32.gb0aaed0f.el8.x 8/26 2021-11-21T03:42:27.450 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86 9/26 2021-11-21T03:42:27.451 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-cephfs-2:15.2.15-32.gb0aaed0f.el8.x86_64 10/26 2021-11-21T03:42:27.451 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-rados-2:15.2.15-32.gb0aaed0f.el8.x86_64 11/26 2021-11-21T03:42:27.451 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-rbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 12/26 2021-11-21T03:42:27.451 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-rgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 13/26 2021-11-21T03:42:27.451 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 14/26 2021-11-21T03:42:27.452 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 15/26 2021-11-21T03:42:27.452 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : leveldb-1.22-1.el8.x86_64 16/26 2021-11-21T03:42:27.452 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 17/26 2021-11-21T03:42:27.453 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 18/26 2021-11-21T03:42:27.453 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 19/26 2021-11-21T03:42:27.453 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 20/26 2021-11-21T03:42:27.453 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 21/26 2021-11-21T03:42:27.454 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 22/26 2021-11-21T03:42:27.454 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : librados2-2:15.2.15-32.gb0aaed0f.el8.x86_64 23/26 2021-11-21T03:42:27.454 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2021-11-21T03:42:27.454 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : librbd1-2:15.2.15-32.gb0aaed0f.el8.x86_64 25/26 2021-11-21T03:42:28.145 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2021-11-21T03:42:28.145 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:42:30.227 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-selinux-2:15.2.15-32.gb0aaed0f.el8.x86_64 23/26 2021-11-21T03:42:30.227 INFO:teuthology.orchestra.run.gibba043.stdout:skipping the directory /sys 2021-11-21T03:42:30.228 INFO:teuthology.orchestra.run.gibba043.stdout:skipping the directory /proc 2021-11-21T03:42:30.228 INFO:teuthology.orchestra.run.gibba043.stdout:skipping the directory /dev 2021-11-21T03:42:30.228 INFO:teuthology.orchestra.run.gibba043.stdout:skipping the directory /run 2021-11-21T03:42:30.229 INFO:teuthology.orchestra.run.gibba043.stdout:skipping the directory /mnt 2021-11-21T03:42:30.229 INFO:teuthology.orchestra.run.gibba043.stdout:skipping the directory /var/tmp 2021-11-21T03:42:30.229 INFO:teuthology.orchestra.run.gibba043.stdout:skipping the directory /home 2021-11-21T03:42:30.229 INFO:teuthology.orchestra.run.gibba043.stdout:skipping the directory /tmp 2021-11-21T03:42:30.230 INFO:teuthology.orchestra.run.gibba043.stdout:skipping the directory /dev 2021-11-21T03:42:30.230 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:42:31.458 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-radosgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 24/26 2021-11-21T03:42:31.530 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-radosgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 24/26 2021-11-21T03:42:31.531 INFO:teuthology.orchestra.run.gibba043.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-11-21T03:42:31.751 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-11-21T03:42:31.752 INFO:teuthology.orchestra.run.gibba043.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2021-11-21T03:42:32.429 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2021-11-21T03:42:32.430 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-base-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/26 2021-11-21T03:42:32.430 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86_64 2/26 2021-11-21T03:42:32.430 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-radosgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 3/26 2021-11-21T03:42:32.431 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-selinux-2:15.2.15-32.gb0aaed0f.el8.x86_64 4/26 2021-11-21T03:42:32.431 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : libcephfs2-2:15.2.15-32.gb0aaed0f.el8.x86_64 5/26 2021-11-21T03:42:32.431 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : libradosstriper1-2:15.2.15-32.gb0aaed0f.el8.x86_64 6/26 2021-11-21T03:42:32.431 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : librgw2-2:15.2.15-32.gb0aaed0f.el8.x86_64 7/26 2021-11-21T03:42:32.432 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-ceph-argparse-2:15.2.15-32.gb0aaed0f.el8.x 8/26 2021-11-21T03:42:32.432 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86 9/26 2021-11-21T03:42:32.432 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-cephfs-2:15.2.15-32.gb0aaed0f.el8.x86_64 10/26 2021-11-21T03:42:32.432 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-rados-2:15.2.15-32.gb0aaed0f.el8.x86_64 11/26 2021-11-21T03:42:32.433 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-rbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 12/26 2021-11-21T03:42:32.433 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-rgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 13/26 2021-11-21T03:42:32.433 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 14/26 2021-11-21T03:42:32.433 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 15/26 2021-11-21T03:42:32.434 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : leveldb-1.22-1.el8.x86_64 16/26 2021-11-21T03:42:32.434 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 17/26 2021-11-21T03:42:32.434 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 18/26 2021-11-21T03:42:32.434 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 19/26 2021-11-21T03:42:32.434 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 20/26 2021-11-21T03:42:32.435 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 21/26 2021-11-21T03:42:32.435 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 22/26 2021-11-21T03:42:32.435 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : librados2-2:15.2.15-32.gb0aaed0f.el8.x86_64 23/26 2021-11-21T03:42:32.436 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2021-11-21T03:42:32.436 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : librbd1-2:15.2.15-32.gb0aaed0f.el8.x86_64 25/26 2021-11-21T03:42:33.207 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2021-11-21T03:42:33.207 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:42:37.674 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:42:33 AM UTC. 2021-11-21T03:42:40.226 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:42:40.227 INFO:teuthology.orchestra.run.gibba022.stdout:Upgraded: 2021-11-21T03:42:40.227 INFO:teuthology.orchestra.run.gibba022.stdout: librados2-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.227 INFO:teuthology.orchestra.run.gibba022.stdout: librbd1-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.228 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:42:40.228 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:42:40.228 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-base-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.228 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.229 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-radosgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.229 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-selinux-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.229 INFO:teuthology.orchestra.run.gibba022.stdout: fmt-6.2.1-1.el8.x86_64 2021-11-21T03:42:40.229 INFO:teuthology.orchestra.run.gibba022.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-11-21T03:42:40.230 INFO:teuthology.orchestra.run.gibba022.stdout: leveldb-1.22-1.el8.x86_64 2021-11-21T03:42:40.231 INFO:teuthology.orchestra.run.gibba022.stdout: libcephfs2-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.231 INFO:teuthology.orchestra.run.gibba022.stdout: liboath-2.6.2-3.el8.x86_64 2021-11-21T03:42:40.232 INFO:teuthology.orchestra.run.gibba022.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-11-21T03:42:40.232 INFO:teuthology.orchestra.run.gibba022.stdout: libradosstriper1-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.233 INFO:teuthology.orchestra.run.gibba022.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-11-21T03:42:40.233 INFO:teuthology.orchestra.run.gibba022.stdout: librgw2-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.234 INFO:teuthology.orchestra.run.gibba022.stdout: libunwind-1.3.1-3.el8.x86_64 2021-11-21T03:42:40.234 INFO:teuthology.orchestra.run.gibba022.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-11-21T03:42:40.234 INFO:teuthology.orchestra.run.gibba022.stdout: python3-ceph-argparse-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.234 INFO:teuthology.orchestra.run.gibba022.stdout: python3-ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.235 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cephfs-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.235 INFO:teuthology.orchestra.run.gibba022.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-11-21T03:42:40.235 INFO:teuthology.orchestra.run.gibba022.stdout: python3-rados-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.235 INFO:teuthology.orchestra.run.gibba022.stdout: python3-rbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.235 INFO:teuthology.orchestra.run.gibba022.stdout: python3-rgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:40.236 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:42:40.236 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:42:40.315 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install ceph-test 2021-11-21T03:42:40.526 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:42:40.976 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 100 kB/s | 2.8 kB 00:00 2021-11-21T03:42:42.772 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:42:38 AM UTC. 2021-11-21T03:42:44.015 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 73 kB/s | 2.4 kB 00:00 2021-11-21T03:42:45.337 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:42:45.337 INFO:teuthology.orchestra.run.gibba043.stdout:Upgraded: 2021-11-21T03:42:45.338 INFO:teuthology.orchestra.run.gibba043.stdout: librados2-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.338 INFO:teuthology.orchestra.run.gibba043.stdout: librbd1-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.338 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:42:45.338 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:42:45.339 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-base-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.339 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.339 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-radosgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.339 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-selinux-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.340 INFO:teuthology.orchestra.run.gibba043.stdout: fmt-6.2.1-1.el8.x86_64 2021-11-21T03:42:45.340 INFO:teuthology.orchestra.run.gibba043.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-11-21T03:42:45.340 INFO:teuthology.orchestra.run.gibba043.stdout: leveldb-1.22-1.el8.x86_64 2021-11-21T03:42:45.340 INFO:teuthology.orchestra.run.gibba043.stdout: libcephfs2-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.341 INFO:teuthology.orchestra.run.gibba043.stdout: liboath-2.6.2-3.el8.x86_64 2021-11-21T03:42:45.341 INFO:teuthology.orchestra.run.gibba043.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-11-21T03:42:45.341 INFO:teuthology.orchestra.run.gibba043.stdout: libradosstriper1-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.341 INFO:teuthology.orchestra.run.gibba043.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-11-21T03:42:45.341 INFO:teuthology.orchestra.run.gibba043.stdout: librgw2-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.342 INFO:teuthology.orchestra.run.gibba043.stdout: libunwind-1.3.1-3.el8.x86_64 2021-11-21T03:42:45.342 INFO:teuthology.orchestra.run.gibba043.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-11-21T03:42:45.342 INFO:teuthology.orchestra.run.gibba043.stdout: python3-ceph-argparse-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.342 INFO:teuthology.orchestra.run.gibba043.stdout: python3-ceph-common-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.343 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cephfs-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.343 INFO:teuthology.orchestra.run.gibba043.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-11-21T03:42:45.343 INFO:teuthology.orchestra.run.gibba043.stdout: python3-rados-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.343 INFO:teuthology.orchestra.run.gibba043.stdout: python3-rbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.344 INFO:teuthology.orchestra.run.gibba043.stdout: python3-rgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:42:45.344 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:42:45.344 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:42:45.446 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install ceph-test 2021-11-21T03:42:45.651 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:42:46.095 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 85 kB/s | 2.4 kB 00:00 2021-11-21T03:42:47.183 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:42:48.819 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:42:48.820 INFO:teuthology.orchestra.run.gibba022.stdout:======================================================================================== 2021-11-21T03:42:48.820 INFO:teuthology.orchestra.run.gibba022.stdout: Package Arch Version Repository Size 2021-11-21T03:42:48.820 INFO:teuthology.orchestra.run.gibba022.stdout:======================================================================================== 2021-11-21T03:42:48.821 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:42:48.821 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-test x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 42 M 2021-11-21T03:42:48.821 INFO:teuthology.orchestra.run.gibba022.stdout:Installing dependencies: 2021-11-21T03:42:48.821 INFO:teuthology.orchestra.run.gibba022.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2021-11-21T03:42:48.822 INFO:teuthology.orchestra.run.gibba022.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2021-11-21T03:42:48.822 INFO:teuthology.orchestra.run.gibba022.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2021-11-21T03:42:48.822 INFO:teuthology.orchestra.run.gibba022.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2021-11-21T03:42:48.822 INFO:teuthology.orchestra.run.gibba022.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-11-21T03:42:48.823 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:42:48.823 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:42:48.823 INFO:teuthology.orchestra.run.gibba022.stdout:======================================================================================== 2021-11-21T03:42:48.823 INFO:teuthology.orchestra.run.gibba022.stdout:Install 6 Packages 2021-11-21T03:42:48.824 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:42:48.824 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 43 M 2021-11-21T03:42:48.824 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 154 M 2021-11-21T03:42:48.825 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:42:48.851 INFO:teuthology.orchestra.run.gibba022.stdout:(1/6): socat-1.7.3.3-2.el8.x86_64.rpm 9.8 MB/s | 302 kB 00:00 2021-11-21T03:42:48.874 INFO:teuthology.orchestra.run.gibba022.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 8.2 MB/s | 187 kB 00:00 2021-11-21T03:42:48.894 INFO:teuthology.orchestra.run.gibba022.stdout:(3/6): jq-1.5-12.el8.x86_64.rpm 7.8 MB/s | 161 kB 00:00 2021-11-21T03:42:48.915 INFO:teuthology.orchestra.run.gibba022.stdout:(4/6): libxslt-1.1.32-5.el8.x86_64.rpm 12 MB/s | 250 kB 00:00 2021-11-21T03:42:48.945 INFO:teuthology.orchestra.run.gibba022.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 554 kB/s | 69 kB 00:00 2021-11-21T03:42:49.261 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 37 kB/s | 2.8 kB 00:00 2021-11-21T03:42:50.964 INFO:teuthology.orchestra.run.gibba022.stdout:(6/6): ceph-test-15.2.15-32.gb0aaed0f.el8.x86_6 20 MB/s | 42 MB 00:02 2021-11-21T03:42:50.964 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:42:50.964 INFO:teuthology.orchestra.run.gibba022.stdout:Total 20 MB/s | 43 MB 00:02 2021-11-21T03:42:50.969 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:42:50.984 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:42:50.984 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:42:51.244 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:42:51.247 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:42:51.636 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:42:51.870 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 1/6 2021-11-21T03:42:52.002 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2021-11-21T03:42:52.445 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2021-11-21T03:42:52.469 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:42:52.522 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2021-11-21T03:42:52.720 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : jq-1.5-12.el8.x86_64 4/6 2021-11-21T03:42:54.125 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:42:54.126 INFO:teuthology.orchestra.run.gibba043.stdout:======================================================================================== 2021-11-21T03:42:54.126 INFO:teuthology.orchestra.run.gibba043.stdout: Package Arch Version Repository Size 2021-11-21T03:42:54.126 INFO:teuthology.orchestra.run.gibba043.stdout:======================================================================================== 2021-11-21T03:42:54.127 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:42:54.127 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-test x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 42 M 2021-11-21T03:42:54.127 INFO:teuthology.orchestra.run.gibba043.stdout:Installing dependencies: 2021-11-21T03:42:54.127 INFO:teuthology.orchestra.run.gibba043.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2021-11-21T03:42:54.128 INFO:teuthology.orchestra.run.gibba043.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2021-11-21T03:42:54.128 INFO:teuthology.orchestra.run.gibba043.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2021-11-21T03:42:54.128 INFO:teuthology.orchestra.run.gibba043.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2021-11-21T03:42:54.128 INFO:teuthology.orchestra.run.gibba043.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-11-21T03:42:54.128 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:42:54.129 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:42:54.129 INFO:teuthology.orchestra.run.gibba043.stdout:======================================================================================== 2021-11-21T03:42:54.129 INFO:teuthology.orchestra.run.gibba043.stdout:Install 6 Packages 2021-11-21T03:42:54.129 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:42:54.130 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 43 M 2021-11-21T03:42:54.130 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 154 M 2021-11-21T03:42:54.131 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:42:54.156 INFO:teuthology.orchestra.run.gibba043.stdout:(1/6): libxslt-1.1.32-5.el8.x86_64.rpm 8.6 MB/s | 250 kB 00:00 2021-11-21T03:42:54.179 INFO:teuthology.orchestra.run.gibba043.stdout:(2/6): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2021-11-21T03:42:54.200 INFO:teuthology.orchestra.run.gibba043.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 9.5 MB/s | 187 kB 00:00 2021-11-21T03:42:54.223 INFO:teuthology.orchestra.run.gibba043.stdout:(4/6): jq-1.5-12.el8.x86_64.rpm 8.4 MB/s | 161 kB 00:00 2021-11-21T03:42:54.239 INFO:teuthology.orchestra.run.gibba043.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 621 kB/s | 69 kB 00:00 2021-11-21T03:42:55.789 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 5/6 2021-11-21T03:42:55.992 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-test-2:15.2.15-32.gb0aaed0f.el8.x86_64 6/6 2021-11-21T03:42:56.162 INFO:teuthology.orchestra.run.gibba043.stdout:(6/6): ceph-test-15.2.15-32.gb0aaed0f.el8.x86_6 21 MB/s | 42 MB 00:02 2021-11-21T03:42:56.163 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:42:56.163 INFO:teuthology.orchestra.run.gibba043.stdout:Total 21 MB/s | 43 MB 00:02 2021-11-21T03:42:56.168 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:42:56.183 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:42:56.183 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:42:56.187 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-test-2:15.2.15-32.gb0aaed0f.el8.x86_64 6/6 2021-11-21T03:42:56.187 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-test-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/6 2021-11-21T03:42:56.188 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2021-11-21T03:42:56.188 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 3/6 2021-11-21T03:42:56.188 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2021-11-21T03:42:56.188 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : jq-1.5-12.el8.x86_64 5/6 2021-11-21T03:42:56.446 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:42:56.453 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:42:56.612 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 6/6 2021-11-21T03:42:56.613 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:42:56.838 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:42:57.025 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 1/6 2021-11-21T03:42:57.099 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 1/6 2021-11-21T03:42:57.313 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : jq-1.5-12.el8.x86_64 2/6 2021-11-21T03:42:57.467 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/6 2021-11-21T03:42:57.708 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 4/6 2021-11-21T03:43:00.773 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 5/6 2021-11-21T03:43:00.996 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-test-2:15.2.15-32.gb0aaed0f.el8.x86_64 6/6 2021-11-21T03:43:01.179 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-test-2:15.2.15-32.gb0aaed0f.el8.x86_64 6/6 2021-11-21T03:43:01.179 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-test-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/6 2021-11-21T03:43:01.180 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2021-11-21T03:43:01.180 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 3/6 2021-11-21T03:43:01.180 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 4/6 2021-11-21T03:43:01.180 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2021-11-21T03:43:01.682 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : jq-1.5-12.el8.x86_64 6/6 2021-11-21T03:43:01.682 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:43:05.623 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:42:33 AM UTC. 2021-11-21T03:43:07.631 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:43:07.632 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:43:07.632 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-test-2:15.2.15-32.gb0aaed0f.el8.x86_64 jq-1.5-12.el8.x86_64 2021-11-21T03:43:07.632 INFO:teuthology.orchestra.run.gibba022.stdout: libxslt-1.1.32-5.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2021-11-21T03:43:07.633 INFO:teuthology.orchestra.run.gibba022.stdout: socat-1.7.3.3-2.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2021-11-21T03:43:07.633 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:43:07.633 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:43:07.708 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install ceph 2021-11-21T03:43:07.909 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:43:08.351 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 kB/s | 2.8 kB 00:00 2021-11-21T03:43:10.843 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:42:38 AM UTC. 2021-11-21T03:43:11.327 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 89 kB/s | 2.4 kB 00:00 2021-11-21T03:43:12.848 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:43:12.849 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:43:12.849 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-test-2:15.2.15-32.gb0aaed0f.el8.x86_64 jq-1.5-12.el8.x86_64 2021-11-21T03:43:12.849 INFO:teuthology.orchestra.run.gibba043.stdout: libxslt-1.1.32-5.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2021-11-21T03:43:12.850 INFO:teuthology.orchestra.run.gibba043.stdout: socat-1.7.3.3-2.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2021-11-21T03:43:12.850 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:43:12.850 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:43:12.969 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install ceph 2021-11-21T03:43:13.169 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:43:13.651 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 72 kB/s | 2.4 kB 00:00 2021-11-21T03:43:14.497 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:43:16.140 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:43:16.143 INFO:teuthology.orchestra.run.gibba022.stdout:====================================================================================================== 2021-11-21T03:43:16.143 INFO:teuthology.orchestra.run.gibba022.stdout: Package Arch Version Repository Size 2021-11-21T03:43:16.143 INFO:teuthology.orchestra.run.gibba022.stdout:====================================================================================================== 2021-11-21T03:43:16.143 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:43:16.144 INFO:teuthology.orchestra.run.gibba022.stdout: ceph x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 6.4 k 2021-11-21T03:43:16.144 INFO:teuthology.orchestra.run.gibba022.stdout:Installing dependencies: 2021-11-21T03:43:16.144 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mds x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 2.0 M 2021-11-21T03:43:16.144 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mgr x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 1.4 M 2021-11-21T03:43:16.144 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mgr-modules-core noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 192 k 2021-11-21T03:43:16.145 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mon x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 4.4 M 2021-11-21T03:43:16.145 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-osd x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 17 M 2021-11-21T03:43:16.145 INFO:teuthology.orchestra.run.gibba022.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2021-11-21T03:43:16.145 INFO:teuthology.orchestra.run.gibba022.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-11-21T03:43:16.146 INFO:teuthology.orchestra.run.gibba022.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-11-21T03:43:16.146 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2021-11-21T03:43:16.146 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-11-21T03:43:16.146 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-11-21T03:43:16.147 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2021-11-21T03:43:16.147 INFO:teuthology.orchestra.run.gibba022.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-11-21T03:43:16.147 INFO:teuthology.orchestra.run.gibba022.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-11-21T03:43:16.147 INFO:teuthology.orchestra.run.gibba022.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-11-21T03:43:16.147 INFO:teuthology.orchestra.run.gibba022.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2021-11-21T03:43:16.148 INFO:teuthology.orchestra.run.gibba022.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2021-11-21T03:43:16.148 INFO:teuthology.orchestra.run.gibba022.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2021-11-21T03:43:16.148 INFO:teuthology.orchestra.run.gibba022.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-11-21T03:43:16.148 INFO:teuthology.orchestra.run.gibba022.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-11-21T03:43:16.149 INFO:teuthology.orchestra.run.gibba022.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-11-21T03:43:16.149 INFO:teuthology.orchestra.run.gibba022.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2021-11-21T03:43:16.149 INFO:teuthology.orchestra.run.gibba022.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2021-11-21T03:43:16.149 INFO:teuthology.orchestra.run.gibba022.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2021-11-21T03:43:16.149 INFO:teuthology.orchestra.run.gibba022.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-11-21T03:43:16.150 INFO:teuthology.orchestra.run.gibba022.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-11-21T03:43:16.150 INFO:teuthology.orchestra.run.gibba022.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-11-21T03:43:16.150 INFO:teuthology.orchestra.run.gibba022.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-11-21T03:43:16.150 INFO:teuthology.orchestra.run.gibba022.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-11-21T03:43:16.151 INFO:teuthology.orchestra.run.gibba022.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-11-21T03:43:16.151 INFO:teuthology.orchestra.run.gibba022.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-11-21T03:43:16.151 INFO:teuthology.orchestra.run.gibba022.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-11-21T03:43:16.151 INFO:teuthology.orchestra.run.gibba022.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2021-11-21T03:43:16.151 INFO:teuthology.orchestra.run.gibba022.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-11-21T03:43:16.152 INFO:teuthology.orchestra.run.gibba022.stdout:Installing weak dependencies: 2021-11-21T03:43:16.152 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-11-21T03:43:16.152 INFO:teuthology.orchestra.run.gibba022.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2021-11-21T03:43:16.152 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:43:16.153 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:43:16.153 INFO:teuthology.orchestra.run.gibba022.stdout:====================================================================================================== 2021-11-21T03:43:16.153 INFO:teuthology.orchestra.run.gibba022.stdout:Install 37 Packages 2021-11-21T03:43:16.153 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:43:16.154 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 30 M 2021-11-21T03:43:16.167 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 98 M 2021-11-21T03:43:16.167 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:43:16.289 INFO:teuthology.orchestra.run.gibba022.stdout:(1/37): ceph-15.2.15-32.gb0aaed0f.el8.x86_64.rp 45 kB/s | 6.4 kB 00:00 2021-11-21T03:43:16.588 INFO:teuthology.orchestra.run.gibba022.stdout:(2/37): ceph-mds-15.2.15-32.gb0aaed0f.el8.x86_6 4.6 MB/s | 2.0 MB 00:00 2021-11-21T03:43:16.685 INFO:teuthology.orchestra.run.gibba022.stdout:(3/37): ceph-mgr-15.2.15-32.gb0aaed0f.el8.x86_6 2.7 MB/s | 1.4 MB 00:00 2021-11-21T03:43:16.780 INFO:teuthology.orchestra.run.gibba022.stdout:(4/37): ceph-mgr-modules-core-15.2.15-32.gb0aae 2.0 MB/s | 192 kB 00:00 2021-11-21T03:43:16.785 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 91 kB/s | 2.8 kB 00:00 2021-11-21T03:43:16.799 INFO:teuthology.orchestra.run.gibba022.stdout:(5/37): ceph-mon-15.2.15-32.gb0aaed0f.el8.x86_6 8.5 MB/s | 4.4 MB 00:00 2021-11-21T03:43:16.911 INFO:teuthology.orchestra.run.gibba022.stdout:(6/37): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 332 kB/s | 44 kB 00:00 2021-11-21T03:43:16.943 INFO:teuthology.orchestra.run.gibba022.stdout:(7/37): python3-beautifulsoup4-4.6.3-2.el8.1.no 1.3 MB/s | 185 kB 00:00 2021-11-21T03:43:17.011 INFO:teuthology.orchestra.run.gibba022.stdout:(8/37): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.7 MB/s | 173 kB 00:00 2021-11-21T03:43:17.036 INFO:teuthology.orchestra.run.gibba022.stdout:(9/37): python3-cssselect-0.9.2-10.el8.noarch.r 1.4 MB/s | 40 kB 00:00 2021-11-21T03:43:17.050 INFO:teuthology.orchestra.run.gibba022.stdout:(10/37): python3-cherrypy-18.4.0-1.el8.noarch.r 3.5 MB/s | 384 kB 00:00 2021-11-21T03:43:17.079 INFO:teuthology.orchestra.run.gibba022.stdout:(11/37): python3-jaraco-6.2-6.el8.noarch.rpm 287 kB/s | 11 kB 00:00 2021-11-21T03:43:17.089 INFO:teuthology.orchestra.run.gibba022.stdout:(12/37): python3-jaraco-functools-2.0-4.el8.noa 454 kB/s | 18 kB 00:00 2021-11-21T03:43:17.120 INFO:teuthology.orchestra.run.gibba022.stdout:(13/37): python3-logutils-0.3.5-11.el8.noarch.r 1.1 MB/s | 49 kB 00:00 2021-11-21T03:43:17.139 INFO:teuthology.orchestra.run.gibba022.stdout:(14/37): python3-more-itertools-7.2.0-3.el8.noa 1.2 MB/s | 59 kB 00:00 2021-11-21T03:43:17.188 INFO:teuthology.orchestra.run.gibba022.stdout:(15/37): python3-portend-2.6-1.el8.noarch.rpm 332 kB/s | 16 kB 00:00 2021-11-21T03:43:17.200 INFO:teuthology.orchestra.run.gibba022.stdout:(16/37): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2021-11-21T03:43:17.233 INFO:teuthology.orchestra.run.gibba022.stdout:(17/37): python3-simplegeneric-0.8.1-17.el8.noa 408 kB/s | 19 kB 00:00 2021-11-21T03:43:17.233 INFO:teuthology.orchestra.run.gibba022.stdout:(18/37): python3-singledispatch-3.4.0.3-18.el8. 634 kB/s | 24 kB 00:00 2021-11-21T03:43:17.262 INFO:teuthology.orchestra.run.gibba022.stdout:(19/37): python3-tempora-1.14.1-5.el8.noarch.rp 1.0 MB/s | 29 kB 00:00 2021-11-21T03:43:17.385 INFO:teuthology.orchestra.run.gibba022.stdout:(20/37): ceph-osd-15.2.15-32.gb0aaed0f.el8.x86_ 21 MB/s | 17 MB 00:00 2021-11-21T03:43:17.386 INFO:teuthology.orchestra.run.gibba022.stdout:(21/37): python3-trustme-0.6.0-4.el8.noarch.rpm 180 kB/s | 27 kB 00:00 2021-11-21T03:43:17.386 INFO:teuthology.orchestra.run.gibba022.stdout:(22/37): python3-waitress-1.2.1-2.el8.1.noarch. 1.9 MB/s | 241 kB 00:00 2021-11-21T03:43:17.430 INFO:teuthology.orchestra.run.gibba022.stdout:(23/37): python3-webtest-2.0.33-1.el8.noarch.rp 1.9 MB/s | 85 kB 00:00 2021-11-21T03:43:17.440 INFO:teuthology.orchestra.run.gibba022.stdout:(24/37): python3-zc-lockfile-2.0-2.el8.noarch.r 432 kB/s | 23 kB 00:00 2021-11-21T03:43:17.473 INFO:teuthology.orchestra.run.gibba022.stdout:(25/37): python3-lxml-4.2.3-1.el8.x86_64.rpm 35 MB/s | 1.5 MB 00:00 2021-11-21T03:43:17.479 INFO:teuthology.orchestra.run.gibba022.stdout:(26/37): python3-webencodings-0.5.1-6.el8.noarc 686 kB/s | 27 kB 00:00 2021-11-21T03:43:17.494 INFO:teuthology.orchestra.run.gibba022.stdout:(27/37): python3-pyOpenSSL-18.0.0-1.el8.noarch. 4.8 MB/s | 103 kB 00:00 2021-11-21T03:43:17.506 INFO:teuthology.orchestra.run.gibba022.stdout:(28/37): python3-werkzeug-0.12.2-4.el8.noarch.r 17 MB/s | 457 kB 00:00 2021-11-21T03:43:17.512 INFO:teuthology.orchestra.run.gibba022.stdout:(29/37): python3-markupsafe-0.23-19.el8.x86_64. 2.1 MB/s | 39 kB 00:00 2021-11-21T03:43:17.528 INFO:teuthology.orchestra.run.gibba022.stdout:(30/37): python3-pytz-2017.2-9.el8.noarch.rpm 2.4 MB/s | 54 kB 00:00 2021-11-21T03:43:17.538 INFO:teuthology.orchestra.run.gibba022.stdout:(31/37): python3-mako-1.0.6-13.el8.noarch.rpm 6.8 MB/s | 157 kB 00:00 2021-11-21T03:43:17.550 INFO:teuthology.orchestra.run.gibba022.stdout:(32/37): python3-html5lib-0.999999999-6.el8.noa 10 MB/s | 214 kB 00:00 2021-11-21T03:43:17.563 INFO:teuthology.orchestra.run.gibba022.stdout:(33/37): python3-pycparser-2.14-14.el8.noarch.r 5.2 MB/s | 109 kB 00:00 2021-11-21T03:43:17.564 INFO:teuthology.orchestra.run.gibba022.stdout:(34/37): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.4 MB/s | 251 kB 00:00 2021-11-21T03:43:17.576 INFO:teuthology.orchestra.run.gibba022.stdout:(35/37): python3-asn1crypto-0.24.0-3.el8.noarch 6.7 MB/s | 181 kB 00:00 2021-11-21T03:43:17.584 INFO:teuthology.orchestra.run.gibba022.stdout:(36/37): python3-cffi-1.11.5-5.el8.x86_64.rpm 8.9 MB/s | 238 kB 00:00 2021-11-21T03:43:17.595 INFO:teuthology.orchestra.run.gibba022.stdout:(37/37): python3-cryptography-2.3-3.el8.x86_64. 14 MB/s | 511 kB 00:00 2021-11-21T03:43:17.596 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:43:17.597 INFO:teuthology.orchestra.run.gibba022.stdout:Total 21 MB/s | 30 MB 00:01 2021-11-21T03:43:17.612 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:43:17.642 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:43:17.642 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:43:17.982 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:43:17.985 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:43:19.249 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:43:19.464 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/37 2021-11-21T03:43:19.731 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/37 2021-11-21T03:43:19.739 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:43:19.909 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 3/37 2021-11-21T03:43:20.138 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 4/37 2021-11-21T03:43:20.425 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 5/37 2021-11-21T03:43:20.635 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 6/37 2021-11-21T03:43:20.818 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 7/37 2021-11-21T03:43:20.971 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 8/37 2021-11-21T03:43:21.190 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 9/37 2021-11-21T03:43:21.378 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:43:21.381 INFO:teuthology.orchestra.run.gibba043.stdout:====================================================================================================== 2021-11-21T03:43:21.381 INFO:teuthology.orchestra.run.gibba043.stdout: Package Arch Version Repository Size 2021-11-21T03:43:21.381 INFO:teuthology.orchestra.run.gibba043.stdout:====================================================================================================== 2021-11-21T03:43:21.382 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:43:21.382 INFO:teuthology.orchestra.run.gibba043.stdout: ceph x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 6.4 k 2021-11-21T03:43:21.382 INFO:teuthology.orchestra.run.gibba043.stdout:Installing dependencies: 2021-11-21T03:43:21.382 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mds x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 2.0 M 2021-11-21T03:43:21.383 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mgr x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 1.4 M 2021-11-21T03:43:21.383 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mgr-modules-core noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 192 k 2021-11-21T03:43:21.383 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mon x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 4.4 M 2021-11-21T03:43:21.383 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-osd x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 17 M 2021-11-21T03:43:21.383 INFO:teuthology.orchestra.run.gibba043.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2021-11-21T03:43:21.384 INFO:teuthology.orchestra.run.gibba043.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-11-21T03:43:21.384 INFO:teuthology.orchestra.run.gibba043.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-11-21T03:43:21.384 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2021-11-21T03:43:21.384 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-11-21T03:43:21.385 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-11-21T03:43:21.385 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2021-11-21T03:43:21.385 INFO:teuthology.orchestra.run.gibba043.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-11-21T03:43:21.385 INFO:teuthology.orchestra.run.gibba043.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-11-21T03:43:21.385 INFO:teuthology.orchestra.run.gibba043.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-11-21T03:43:21.386 INFO:teuthology.orchestra.run.gibba043.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2021-11-21T03:43:21.386 INFO:teuthology.orchestra.run.gibba043.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2021-11-21T03:43:21.386 INFO:teuthology.orchestra.run.gibba043.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2021-11-21T03:43:21.386 INFO:teuthology.orchestra.run.gibba043.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-11-21T03:43:21.386 INFO:teuthology.orchestra.run.gibba043.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-11-21T03:43:21.387 INFO:teuthology.orchestra.run.gibba043.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-11-21T03:43:21.387 INFO:teuthology.orchestra.run.gibba043.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2021-11-21T03:43:21.387 INFO:teuthology.orchestra.run.gibba043.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2021-11-21T03:43:21.392 INFO:teuthology.orchestra.run.gibba043.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2021-11-21T03:43:21.392 INFO:teuthology.orchestra.run.gibba043.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-11-21T03:43:21.393 INFO:teuthology.orchestra.run.gibba043.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-11-21T03:43:21.393 INFO:teuthology.orchestra.run.gibba043.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-11-21T03:43:21.393 INFO:teuthology.orchestra.run.gibba043.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-11-21T03:43:21.394 INFO:teuthology.orchestra.run.gibba043.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-11-21T03:43:21.394 INFO:teuthology.orchestra.run.gibba043.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-11-21T03:43:21.394 INFO:teuthology.orchestra.run.gibba043.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-11-21T03:43:21.395 INFO:teuthology.orchestra.run.gibba043.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-11-21T03:43:21.395 INFO:teuthology.orchestra.run.gibba043.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2021-11-21T03:43:21.395 INFO:teuthology.orchestra.run.gibba043.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-11-21T03:43:21.395 INFO:teuthology.orchestra.run.gibba043.stdout:Installing weak dependencies: 2021-11-21T03:43:21.396 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-11-21T03:43:21.396 INFO:teuthology.orchestra.run.gibba043.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2021-11-21T03:43:21.396 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:43:21.396 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:43:21.397 INFO:teuthology.orchestra.run.gibba043.stdout:====================================================================================================== 2021-11-21T03:43:21.397 INFO:teuthology.orchestra.run.gibba043.stdout:Install 37 Packages 2021-11-21T03:43:21.397 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:43:21.398 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 10/37 2021-11-21T03:43:21.407 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 30 M 2021-11-21T03:43:21.407 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 98 M 2021-11-21T03:43:21.413 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:43:21.544 INFO:teuthology.orchestra.run.gibba043.stdout:(1/37): ceph-15.2.15-32.gb0aaed0f.el8.x86_64.rp 40 kB/s | 6.4 kB 00:00 2021-11-21T03:43:21.609 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 11/37 2021-11-21T03:43:21.776 INFO:teuthology.orchestra.run.gibba043.stdout:(2/37): ceph-mgr-15.2.15-32.gb0aaed0f.el8.x86_6 3.7 MB/s | 1.4 MB 00:00 2021-11-21T03:43:21.807 INFO:teuthology.orchestra.run.gibba043.stdout:(3/37): ceph-mds-15.2.15-32.gb0aaed0f.el8.x86_6 4.8 MB/s | 2.0 MB 00:00 2021-11-21T03:43:21.856 INFO:teuthology.orchestra.run.gibba043.stdout:(4/37): ceph-mgr-modules-core-15.2.15-32.gb0aae 3.7 MB/s | 192 kB 00:00 2021-11-21T03:43:21.883 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 12/37 2021-11-21T03:43:21.966 INFO:teuthology.orchestra.run.gibba043.stdout:(5/37): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 394 kB/s | 44 kB 00:00 2021-11-21T03:43:22.053 INFO:teuthology.orchestra.run.gibba043.stdout:(6/37): python3-beautifulsoup4-4.6.3-2.el8.1.no 2.2 MB/s | 185 kB 00:00 2021-11-21T03:43:22.053 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 13/37 2021-11-21T03:43:22.083 INFO:teuthology.orchestra.run.gibba043.stdout:(7/37): python3-cheroot-8.5.2-1.el8.noarch.rpm 5.7 MB/s | 173 kB 00:00 2021-11-21T03:43:22.136 INFO:teuthology.orchestra.run.gibba043.stdout:(8/37): python3-cherrypy-18.4.0-1.el8.noarch.rp 6.6 MB/s | 384 kB 00:00 2021-11-21T03:43:22.165 INFO:teuthology.orchestra.run.gibba043.stdout:(9/37): python3-cssselect-0.9.2-10.el8.noarch.r 1.4 MB/s | 40 kB 00:00 2021-11-21T03:43:22.184 INFO:teuthology.orchestra.run.gibba043.stdout:(10/37): ceph-mon-15.2.15-32.gb0aaed0f.el8.x86_ 6.8 MB/s | 4.4 MB 00:00 2021-11-21T03:43:22.193 INFO:teuthology.orchestra.run.gibba043.stdout:(11/37): python3-jaraco-6.2-6.el8.noarch.rpm 396 kB/s | 11 kB 00:00 2021-11-21T03:43:22.222 INFO:teuthology.orchestra.run.gibba043.stdout:(12/37): python3-logutils-0.3.5-11.el8.noarch.r 1.7 MB/s | 49 kB 00:00 2021-11-21T03:43:22.249 INFO:teuthology.orchestra.run.gibba043.stdout:(13/37): python3-more-itertools-7.2.0-3.el8.noa 2.0 MB/s | 59 kB 00:00 2021-11-21T03:43:22.265 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 14/37 2021-11-21T03:43:22.266 INFO:teuthology.orchestra.run.gibba043.stdout:(14/37): python3-jaraco-functools-2.0-4.el8.noa 212 kB/s | 18 kB 00:00 2021-11-21T03:43:22.295 INFO:teuthology.orchestra.run.gibba043.stdout:(15/37): python3-portend-2.6-1.el8.noarch.rpm 560 kB/s | 16 kB 00:00 2021-11-21T03:43:22.307 INFO:teuthology.orchestra.run.gibba043.stdout:(16/37): python3-pecan-1.3.2-9.el8.noarch.rpm 5.0 MB/s | 283 kB 00:00 2021-11-21T03:43:22.326 INFO:teuthology.orchestra.run.gibba043.stdout:(17/37): python3-simplegeneric-0.8.1-17.el8.noa 675 kB/s | 19 kB 00:00 2021-11-21T03:43:22.333 INFO:teuthology.orchestra.run.gibba043.stdout:(18/37): python3-singledispatch-3.4.0.3-18.el8. 861 kB/s | 24 kB 00:00 2021-11-21T03:43:22.350 INFO:teuthology.orchestra.run.gibba043.stdout:(19/37): python3-tempora-1.14.1-5.el8.noarch.rp 1.0 MB/s | 29 kB 00:00 2021-11-21T03:43:22.369 INFO:teuthology.orchestra.run.gibba043.stdout:(20/37): python3-trustme-0.6.0-4.el8.noarch.rpm 983 kB/s | 27 kB 00:00 2021-11-21T03:43:22.392 INFO:teuthology.orchestra.run.gibba043.stdout:(21/37): python3-webob-1.8.5-1.el8.1.noarch.rpm 8.0 MB/s | 251 kB 00:00 2021-11-21T03:43:22.420 INFO:teuthology.orchestra.run.gibba043.stdout:(22/37): python3-webtest-2.0.33-1.el8.noarch.rp 2.9 MB/s | 85 kB 00:00 2021-11-21T03:43:22.433 INFO:teuthology.orchestra.run.gibba043.stdout:(23/37): python3-waitress-1.2.1-2.el8.1.noarch. 2.8 MB/s | 241 kB 00:00 2021-11-21T03:43:22.448 INFO:teuthology.orchestra.run.gibba043.stdout:(24/37): python3-zc-lockfile-2.0-2.el8.noarch.r 830 kB/s | 23 kB 00:00 2021-11-21T03:43:22.463 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 15/37 2021-11-21T03:43:22.469 INFO:teuthology.orchestra.run.gibba043.stdout:(25/37): python3-pycparser-2.14-14.el8.noarch.r 3.5 MB/s | 109 kB 00:00 2021-11-21T03:43:22.479 INFO:teuthology.orchestra.run.gibba043.stdout:(26/37): python3-asn1crypto-0.24.0-3.el8.noarch 5.6 MB/s | 181 kB 00:00 2021-11-21T03:43:22.486 INFO:teuthology.orchestra.run.gibba043.stdout:(27/37): python3-cffi-1.11.5-5.el8.x86_64.rpm 11 MB/s | 238 kB 00:00 2021-11-21T03:43:22.505 INFO:teuthology.orchestra.run.gibba043.stdout:(28/37): python3-cryptography-2.3-3.el8.x86_64. 22 MB/s | 511 kB 00:00 2021-11-21T03:43:22.590 INFO:teuthology.orchestra.run.gibba043.stdout:(29/37): ceph-osd-15.2.15-32.gb0aaed0f.el8.x86_ 21 MB/s | 17 MB 00:00 2021-11-21T03:43:22.611 INFO:teuthology.orchestra.run.gibba043.stdout:(30/37): python3-lxml-4.2.3-1.el8.x86_64.rpm 12 MB/s | 1.5 MB 00:00 2021-11-21T03:43:22.612 INFO:teuthology.orchestra.run.gibba043.stdout:(31/37): python3-webencodings-0.5.1-6.el8.noarc 247 kB/s | 27 kB 00:00 2021-11-21T03:43:22.623 INFO:teuthology.orchestra.run.gibba043.stdout:(32/37): python3-pyOpenSSL-18.0.0-1.el8.noarch. 3.1 MB/s | 103 kB 00:00 2021-11-21T03:43:22.639 INFO:teuthology.orchestra.run.gibba043.stdout:(33/37): python3-markupsafe-0.23-19.el8.x86_64. 1.5 MB/s | 39 kB 00:00 2021-11-21T03:43:22.639 INFO:teuthology.orchestra.run.gibba043.stdout:(34/37): python3-werkzeug-0.12.2-4.el8.noarch.r 16 MB/s | 457 kB 00:00 2021-11-21T03:43:22.654 INFO:teuthology.orchestra.run.gibba043.stdout:(35/37): python3-pytz-2017.2-9.el8.noarch.rpm 1.7 MB/s | 54 kB 00:00 2021-11-21T03:43:22.661 INFO:teuthology.orchestra.run.gibba043.stdout:(36/37): python3-mako-1.0.6-13.el8.noarch.rpm 6.4 MB/s | 157 kB 00:00 2021-11-21T03:43:22.672 INFO:teuthology.orchestra.run.gibba043.stdout:(37/37): python3-html5lib-0.999999999-6.el8.noa 9.3 MB/s | 214 kB 00:00 2021-11-21T03:43:22.672 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:43:22.672 INFO:teuthology.orchestra.run.gibba043.stdout:Total 23 MB/s | 30 MB 00:01 2021-11-21T03:43:22.683 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:43:22.684 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 16/37 2021-11-21T03:43:22.712 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:43:22.712 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:43:22.842 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 17/37 2021-11-21T03:43:23.007 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 18/37 2021-11-21T03:43:23.081 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:43:23.084 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:43:23.142 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 19/37 2021-11-21T03:43:23.294 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 20/37 2021-11-21T03:43:23.475 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 21/37 2021-11-21T03:43:23.648 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 22/37 2021-11-21T03:43:23.822 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 23/37 2021-11-21T03:43:24.024 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 24/37 2021-11-21T03:43:24.247 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-portend-2.6-1.el8.noarch 25/37 2021-11-21T03:43:24.438 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:43:24.659 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/37 2021-11-21T03:43:24.877 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/37 2021-11-21T03:43:24.934 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 26/37 2021-11-21T03:43:25.084 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 3/37 2021-11-21T03:43:25.314 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 4/37 2021-11-21T03:43:25.616 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 5/37 2021-11-21T03:43:25.825 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 6/37 2021-11-21T03:43:26.057 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 7/37 2021-11-21T03:43:26.322 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 8/37 2021-11-21T03:43:26.355 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 27/37 2021-11-21T03:43:26.555 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 9/37 2021-11-21T03:43:26.573 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 28/37 2021-11-21T03:43:26.764 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 29/37 2021-11-21T03:43:26.825 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 10/37 2021-11-21T03:43:27.023 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 30/37 2021-11-21T03:43:27.155 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 11/37 2021-11-21T03:43:27.325 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 31/37 2021-11-21T03:43:27.381 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 12/37 2021-11-21T03:43:27.581 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 13/37 2021-11-21T03:43:27.589 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-mgr-modules-core-2:15.2.15-32.gb0aaed0f.el8.n 32/37 2021-11-21T03:43:27.762 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-mgr-2:15.2.15-32.gb0aaed0f.el8.x86_64 33/37 2021-11-21T03:43:27.793 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 14/37 2021-11-21T03:43:28.017 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/37 2021-11-21T03:43:28.220 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 16/37 2021-11-21T03:43:28.447 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 17/37 2021-11-21T03:43:28.636 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 18/37 2021-11-21T03:43:28.835 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-mgr-2:15.2.15-32.gb0aaed0f.el8.x86_64 33/37 2021-11-21T03:43:28.837 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 19/37 2021-11-21T03:43:28.995 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-osd-2:15.2.15-32.gb0aaed0f.el8.x86_64 34/37 2021-11-21T03:43:29.052 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 20/37 2021-11-21T03:43:29.187 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 21/37 2021-11-21T03:43:29.307 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-osd-2:15.2.15-32.gb0aaed0f.el8.x86_64 34/37 2021-11-21T03:43:29.403 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 22/37 2021-11-21T03:43:29.470 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-mon-2:15.2.15-32.gb0aaed0f.el8.x86_64 35/37 2021-11-21T03:43:29.613 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-mon-2:15.2.15-32.gb0aaed0f.el8.x86_64 35/37 2021-11-21T03:43:29.624 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 23/37 2021-11-21T03:43:29.812 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 24/37 2021-11-21T03:43:29.821 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-mds-2:15.2.15-32.gb0aaed0f.el8.x86_64 36/37 2021-11-21T03:43:29.836 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-mds-2:15.2.15-32.gb0aaed0f.el8.x86_64 36/37 2021-11-21T03:43:29.934 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-2:15.2.15-32.gb0aaed0f.el8.x86_64 37/37 2021-11-21T03:43:30.026 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-portend-2.6-1.el8.noarch 25/37 2021-11-21T03:43:30.189 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-2:15.2.15-32.gb0aaed0f.el8.x86_64 37/37 2021-11-21T03:43:30.189 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/37 2021-11-21T03:43:30.189 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-mds-2:15.2.15-32.gb0aaed0f.el8.x86_64 2/37 2021-11-21T03:43:30.189 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-mgr-2:15.2.15-32.gb0aaed0f.el8.x86_64 3/37 2021-11-21T03:43:30.190 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-mon-2:15.2.15-32.gb0aaed0f.el8.x86_64 4/37 2021-11-21T03:43:30.190 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-osd-2:15.2.15-32.gb0aaed0f.el8.x86_64 5/37 2021-11-21T03:43:30.190 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-mgr-modules-core-2:15.2.15-32.gb0aaed0f.el8.n 6/37 2021-11-21T03:43:30.190 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/37 2021-11-21T03:43:30.191 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/37 2021-11-21T03:43:30.191 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/37 2021-11-21T03:43:30.191 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/37 2021-11-21T03:43:30.191 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 11/37 2021-11-21T03:43:30.191 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 12/37 2021-11-21T03:43:30.194 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 13/37 2021-11-21T03:43:30.194 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 14/37 2021-11-21T03:43:30.194 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 15/37 2021-11-21T03:43:30.195 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 16/37 2021-11-21T03:43:30.195 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-portend-2.6-1.el8.noarch 17/37 2021-11-21T03:43:30.195 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 18/37 2021-11-21T03:43:30.195 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 19/37 2021-11-21T03:43:30.196 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 20/37 2021-11-21T03:43:30.196 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 21/37 2021-11-21T03:43:30.196 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 22/37 2021-11-21T03:43:30.196 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 23/37 2021-11-21T03:43:30.196 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 24/37 2021-11-21T03:43:30.197 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 25/37 2021-11-21T03:43:30.197 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 26/37 2021-11-21T03:43:30.197 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 27/37 2021-11-21T03:43:30.197 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 28/37 2021-11-21T03:43:30.197 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 29/37 2021-11-21T03:43:30.198 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 30/37 2021-11-21T03:43:30.198 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 31/37 2021-11-21T03:43:30.198 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 32/37 2021-11-21T03:43:30.198 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 33/37 2021-11-21T03:43:30.199 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 34/37 2021-11-21T03:43:30.199 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 35/37 2021-11-21T03:43:30.199 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 36/37 2021-11-21T03:43:30.233 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 26/37 2021-11-21T03:43:31.027 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 37/37 2021-11-21T03:43:31.027 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:43:31.094 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 27/37 2021-11-21T03:43:32.044 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 28/37 2021-11-21T03:43:32.285 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 29/37 2021-11-21T03:43:32.576 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 30/37 2021-11-21T03:43:32.870 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 31/37 2021-11-21T03:43:33.161 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-mgr-modules-core-2:15.2.15-32.gb0aaed0f.el8.n 32/37 2021-11-21T03:43:33.333 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-mgr-2:15.2.15-32.gb0aaed0f.el8.x86_64 33/37 2021-11-21T03:43:34.411 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-mgr-2:15.2.15-32.gb0aaed0f.el8.x86_64 33/37 2021-11-21T03:43:34.600 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-osd-2:15.2.15-32.gb0aaed0f.el8.x86_64 34/37 2021-11-21T03:43:34.912 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-osd-2:15.2.15-32.gb0aaed0f.el8.x86_64 34/37 2021-11-21T03:43:35.083 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-mon-2:15.2.15-32.gb0aaed0f.el8.x86_64 35/37 2021-11-21T03:43:35.228 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-mon-2:15.2.15-32.gb0aaed0f.el8.x86_64 35/37 2021-11-21T03:43:35.459 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-mds-2:15.2.15-32.gb0aaed0f.el8.x86_64 36/37 2021-11-21T03:43:35.470 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-mds-2:15.2.15-32.gb0aaed0f.el8.x86_64 36/37 2021-11-21T03:43:35.580 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-2:15.2.15-32.gb0aaed0f.el8.x86_64 37/37 2021-11-21T03:43:35.875 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-2:15.2.15-32.gb0aaed0f.el8.x86_64 37/37 2021-11-21T03:43:35.875 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/37 2021-11-21T03:43:35.875 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-mds-2:15.2.15-32.gb0aaed0f.el8.x86_64 2/37 2021-11-21T03:43:35.876 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-mgr-2:15.2.15-32.gb0aaed0f.el8.x86_64 3/37 2021-11-21T03:43:35.876 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-mon-2:15.2.15-32.gb0aaed0f.el8.x86_64 4/37 2021-11-21T03:43:35.877 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-osd-2:15.2.15-32.gb0aaed0f.el8.x86_64 5/37 2021-11-21T03:43:35.877 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-mgr-modules-core-2:15.2.15-32.gb0aaed0f.el8.n 6/37 2021-11-21T03:43:35.877 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/37 2021-11-21T03:43:35.878 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/37 2021-11-21T03:43:35.878 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/37 2021-11-21T03:43:35.883 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/37 2021-11-21T03:43:35.883 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 11/37 2021-11-21T03:43:35.884 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 12/37 2021-11-21T03:43:35.884 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 13/37 2021-11-21T03:43:35.884 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 14/37 2021-11-21T03:43:35.885 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 15/37 2021-11-21T03:43:35.885 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 16/37 2021-11-21T03:43:35.886 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-portend-2.6-1.el8.noarch 17/37 2021-11-21T03:43:35.886 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 18/37 2021-11-21T03:43:35.886 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 19/37 2021-11-21T03:43:35.887 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 20/37 2021-11-21T03:43:35.887 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 21/37 2021-11-21T03:43:35.888 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 22/37 2021-11-21T03:43:35.888 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 23/37 2021-11-21T03:43:35.889 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 24/37 2021-11-21T03:43:35.897 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 25/37 2021-11-21T03:43:35.898 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 26/37 2021-11-21T03:43:35.898 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 27/37 2021-11-21T03:43:35.898 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 28/37 2021-11-21T03:43:35.899 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 29/37 2021-11-21T03:43:35.899 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 30/37 2021-11-21T03:43:35.899 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 31/37 2021-11-21T03:43:35.900 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 32/37 2021-11-21T03:43:35.900 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 33/37 2021-11-21T03:43:35.901 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 34/37 2021-11-21T03:43:35.901 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 35/37 2021-11-21T03:43:35.901 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 36/37 2021-11-21T03:43:36.827 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 37/37 2021-11-21T03:43:36.827 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:43:39.957 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:43:01 AM UTC. 2021-11-21T03:43:41.968 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:43:41.968 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:43:41.968 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:43:41.969 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mds-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:43:41.969 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mgr-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:43:41.969 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mgr-modules-core-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:43:41.969 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mon-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:43:41.970 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-osd-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:43:41.970 INFO:teuthology.orchestra.run.gibba022.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2021-11-21T03:43:41.970 INFO:teuthology.orchestra.run.gibba022.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-11-21T03:43:41.970 INFO:teuthology.orchestra.run.gibba022.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-11-21T03:43:41.971 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-11-21T03:43:41.971 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-11-21T03:43:41.971 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-11-21T03:43:41.971 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cryptography-2.3-3.el8.x86_64 2021-11-21T03:43:41.972 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-11-21T03:43:41.972 INFO:teuthology.orchestra.run.gibba022.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-11-21T03:43:41.972 INFO:teuthology.orchestra.run.gibba022.stdout: python3-jaraco-6.2-6.el8.noarch 2021-11-21T03:43:41.972 INFO:teuthology.orchestra.run.gibba022.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-11-21T03:43:41.973 INFO:teuthology.orchestra.run.gibba022.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-11-21T03:43:41.973 INFO:teuthology.orchestra.run.gibba022.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-11-21T03:43:41.973 INFO:teuthology.orchestra.run.gibba022.stdout: python3-mako-1.0.6-13.el8.noarch 2021-11-21T03:43:41.973 INFO:teuthology.orchestra.run.gibba022.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-11-21T03:43:41.973 INFO:teuthology.orchestra.run.gibba022.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-11-21T03:43:41.974 INFO:teuthology.orchestra.run.gibba022.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-11-21T03:43:41.974 INFO:teuthology.orchestra.run.gibba022.stdout: python3-portend-2.6-1.el8.noarch 2021-11-21T03:43:41.974 INFO:teuthology.orchestra.run.gibba022.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2021-11-21T03:43:41.974 INFO:teuthology.orchestra.run.gibba022.stdout: python3-pycparser-2.14-14.el8.noarch 2021-11-21T03:43:41.975 INFO:teuthology.orchestra.run.gibba022.stdout: python3-pytz-2017.2-9.el8.noarch 2021-11-21T03:43:41.975 INFO:teuthology.orchestra.run.gibba022.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-11-21T03:43:41.975 INFO:teuthology.orchestra.run.gibba022.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-11-21T03:43:41.975 INFO:teuthology.orchestra.run.gibba022.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-11-21T03:43:41.976 INFO:teuthology.orchestra.run.gibba022.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-11-21T03:43:41.976 INFO:teuthology.orchestra.run.gibba022.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-11-21T03:43:41.976 INFO:teuthology.orchestra.run.gibba022.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-11-21T03:43:41.976 INFO:teuthology.orchestra.run.gibba022.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-11-21T03:43:41.976 INFO:teuthology.orchestra.run.gibba022.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-11-21T03:43:41.977 INFO:teuthology.orchestra.run.gibba022.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-11-21T03:43:41.977 INFO:teuthology.orchestra.run.gibba022.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-11-21T03:43:41.977 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:43:41.977 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:43:42.055 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install ceph-base 2021-11-21T03:43:42.265 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:43:42.766 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 kB/s | 2.8 kB 00:00 2021-11-21T03:43:45.739 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 87 kB/s | 2.4 kB 00:00 2021-11-21T03:43:45.812 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:43:06 AM UTC. 2021-11-21T03:43:47.850 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:43:47.851 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:43:47.851 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:43:47.851 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mds-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:43:47.852 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mgr-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:43:47.852 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mgr-modules-core-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:43:47.852 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mon-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:43:47.852 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-osd-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:43:47.853 INFO:teuthology.orchestra.run.gibba043.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2021-11-21T03:43:47.853 INFO:teuthology.orchestra.run.gibba043.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-11-21T03:43:47.854 INFO:teuthology.orchestra.run.gibba043.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-11-21T03:43:47.854 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-11-21T03:43:47.854 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-11-21T03:43:47.855 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-11-21T03:43:47.855 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cryptography-2.3-3.el8.x86_64 2021-11-21T03:43:47.855 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-11-21T03:43:47.855 INFO:teuthology.orchestra.run.gibba043.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-11-21T03:43:47.855 INFO:teuthology.orchestra.run.gibba043.stdout: python3-jaraco-6.2-6.el8.noarch 2021-11-21T03:43:47.856 INFO:teuthology.orchestra.run.gibba043.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-11-21T03:43:47.866 INFO:teuthology.orchestra.run.gibba043.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-11-21T03:43:47.866 INFO:teuthology.orchestra.run.gibba043.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-11-21T03:43:47.867 INFO:teuthology.orchestra.run.gibba043.stdout: python3-mako-1.0.6-13.el8.noarch 2021-11-21T03:43:47.867 INFO:teuthology.orchestra.run.gibba043.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-11-21T03:43:47.868 INFO:teuthology.orchestra.run.gibba043.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-11-21T03:43:47.868 INFO:teuthology.orchestra.run.gibba043.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-11-21T03:43:47.868 INFO:teuthology.orchestra.run.gibba043.stdout: python3-portend-2.6-1.el8.noarch 2021-11-21T03:43:47.868 INFO:teuthology.orchestra.run.gibba043.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2021-11-21T03:43:47.878 INFO:teuthology.orchestra.run.gibba043.stdout: python3-pycparser-2.14-14.el8.noarch 2021-11-21T03:43:47.879 INFO:teuthology.orchestra.run.gibba043.stdout: python3-pytz-2017.2-9.el8.noarch 2021-11-21T03:43:47.879 INFO:teuthology.orchestra.run.gibba043.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-11-21T03:43:47.880 INFO:teuthology.orchestra.run.gibba043.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-11-21T03:43:47.880 INFO:teuthology.orchestra.run.gibba043.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-11-21T03:43:47.880 INFO:teuthology.orchestra.run.gibba043.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-11-21T03:43:47.880 INFO:teuthology.orchestra.run.gibba043.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-11-21T03:43:47.881 INFO:teuthology.orchestra.run.gibba043.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-11-21T03:43:47.882 INFO:teuthology.orchestra.run.gibba043.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-11-21T03:43:47.883 INFO:teuthology.orchestra.run.gibba043.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-11-21T03:43:47.883 INFO:teuthology.orchestra.run.gibba043.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-11-21T03:43:47.883 INFO:teuthology.orchestra.run.gibba043.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-11-21T03:43:47.883 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:43:47.883 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:43:47.988 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install ceph-base 2021-11-21T03:43:48.199 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:43:48.653 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 87 kB/s | 2.4 kB 00:00 2021-11-21T03:43:49.028 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:43:50.361 INFO:teuthology.orchestra.run.gibba022.stdout:Package ceph-base-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:43:50.644 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:43:50.644 INFO:teuthology.orchestra.run.gibba022.stdout:Nothing to do. 2021-11-21T03:43:50.645 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:43:50.701 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install cephadm 2021-11-21T03:43:50.910 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:43:51.416 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 102 kB/s | 2.8 kB 00:00 2021-11-21T03:43:51.522 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 kB/s | 2.4 kB 00:00 2021-11-21T03:43:51.766 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 92 kB/s | 2.8 kB 00:00 2021-11-21T03:43:52.684 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:43:52.685 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:43:52.685 INFO:teuthology.orchestra.run.gibba022.stdout: Package Arch Version Repository Size 2021-11-21T03:43:52.685 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:43:52.685 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:43:52.686 INFO:teuthology.orchestra.run.gibba022.stdout: cephadm noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 59 k 2021-11-21T03:43:52.686 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:43:52.686 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:43:52.686 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:43:52.687 INFO:teuthology.orchestra.run.gibba022.stdout:Install 1 Package 2021-11-21T03:43:52.687 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:43:52.687 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 59 k 2021-11-21T03:43:52.688 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 223 k 2021-11-21T03:43:52.688 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:43:52.895 INFO:teuthology.orchestra.run.gibba022.stdout:cephadm-15.2.15-32.gb0aaed0f.el8.noarch.rpm 280 kB/s | 59 kB 00:00 2021-11-21T03:43:52.895 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:43:52.896 INFO:teuthology.orchestra.run.gibba022.stdout:Total 278 kB/s | 59 kB 00:00 2021-11-21T03:43:52.896 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:43:52.902 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:43:52.902 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:43:52.903 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:43:52.906 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:43:52.946 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:43:54.615 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 1/1 2021-11-21T03:43:54.702 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:43:54.860 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 1/1 2021-11-21T03:43:54.973 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 1/1 2021-11-21T03:43:55.298 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 1/1 2021-11-21T03:43:55.299 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:43:56.047 INFO:teuthology.orchestra.run.gibba043.stdout:Package ceph-base-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:43:56.329 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:43:56.329 INFO:teuthology.orchestra.run.gibba043.stdout:Nothing to do. 2021-11-21T03:43:56.330 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:43:56.406 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install cephadm 2021-11-21T03:43:56.613 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:43:57.069 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 kB/s | 2.4 kB 00:00 2021-11-21T03:43:57.155 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 kB/s | 2.8 kB 00:00 2021-11-21T03:43:58.310 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:43:58.311 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:43:58.311 INFO:teuthology.orchestra.run.gibba043.stdout: Package Arch Version Repository Size 2021-11-21T03:43:58.312 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:43:58.312 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:43:58.312 INFO:teuthology.orchestra.run.gibba043.stdout: cephadm noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 59 k 2021-11-21T03:43:58.312 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:43:58.313 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:43:58.313 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:43:58.313 INFO:teuthology.orchestra.run.gibba043.stdout:Install 1 Package 2021-11-21T03:43:58.313 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:43:58.313 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 59 k 2021-11-21T03:43:58.315 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 223 k 2021-11-21T03:43:58.315 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:43:58.522 INFO:teuthology.orchestra.run.gibba043.stdout:cephadm-15.2.15-32.gb0aaed0f.el8.noarch.rpm 279 kB/s | 59 kB 00:00 2021-11-21T03:43:58.523 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:43:58.523 INFO:teuthology.orchestra.run.gibba043.stdout:Total 277 kB/s | 59 kB 00:00 2021-11-21T03:43:58.523 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:43:58.528 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:43:58.529 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:43:58.530 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:43:58.533 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:43:58.610 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:44:00.259 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 1/1 2021-11-21T03:44:00.495 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 1/1 2021-11-21T03:44:00.616 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 1/1 2021-11-21T03:44:00.957 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 1/1 2021-11-21T03:44:00.957 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:44:04.657 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:43:35 AM UTC. 2021-11-21T03:44:06.666 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:44:06.667 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:44:06.667 INFO:teuthology.orchestra.run.gibba022.stdout: cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:44:06.667 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:44:06.667 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:44:06.757 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install ceph-immutable-object-cache 2021-11-21T03:44:06.976 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:44:07.405 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 103 kB/s | 2.8 kB 00:00 2021-11-21T03:44:10.156 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:43:41 AM UTC. 2021-11-21T03:44:10.372 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 87 kB/s | 2.4 kB 00:00 2021-11-21T03:44:12.143 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:44:12.143 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:44:12.143 INFO:teuthology.orchestra.run.gibba043.stdout: cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:44:12.144 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:44:12.144 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:44:12.230 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install ceph-immutable-object-cache 2021-11-21T03:44:12.456 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:44:12.919 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 90 kB/s | 2.4 kB 00:00 2021-11-21T03:44:13.605 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:44:15.242 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:44:15.243 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:44:15.243 INFO:teuthology.orchestra.run.gibba022.stdout: Package Arch Version Repo Size 2021-11-21T03:44:15.244 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:44:15.244 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:44:15.244 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-immutable-object-cache x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 203 k 2021-11-21T03:44:15.244 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:44:15.244 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:44:15.245 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:44:15.245 INFO:teuthology.orchestra.run.gibba022.stdout:Install 1 Package 2021-11-21T03:44:15.245 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:44:15.245 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 203 k 2021-11-21T03:44:15.246 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 599 k 2021-11-21T03:44:15.246 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:44:15.521 INFO:teuthology.orchestra.run.gibba022.stdout:ceph-immutable-object-cache-15.2.15-32.gb0aaed0 733 kB/s | 203 kB 00:00 2021-11-21T03:44:15.522 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:44:15.523 INFO:teuthology.orchestra.run.gibba022.stdout:Total 729 kB/s | 203 kB 00:00 2021-11-21T03:44:15.523 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:44:15.532 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:44:15.533 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:44:15.570 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:44:15.573 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:44:15.700 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:44:15.879 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-immutable-object-cache-2:15.2.15-32.gb0aaed0f.e 1/1 2021-11-21T03:44:16.072 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 kB/s | 2.8 kB 00:00 2021-11-21T03:44:16.138 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.15-32.gb0aaed0f.e 1/1 2021-11-21T03:44:16.469 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-immutable-object-cache-2:15.2.15-32.gb0aaed0f.e 1/1 2021-11-21T03:44:16.469 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:44:19.041 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:44:20.672 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:44:20.672 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:44:20.673 INFO:teuthology.orchestra.run.gibba043.stdout: Package Arch Version Repo Size 2021-11-21T03:44:20.673 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:44:20.673 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:44:20.673 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-immutable-object-cache x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 203 k 2021-11-21T03:44:20.673 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:44:20.674 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:44:20.674 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:44:20.674 INFO:teuthology.orchestra.run.gibba043.stdout:Install 1 Package 2021-11-21T03:44:20.674 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:44:20.675 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 203 k 2021-11-21T03:44:20.675 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 599 k 2021-11-21T03:44:20.675 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:44:20.947 INFO:teuthology.orchestra.run.gibba043.stdout:ceph-immutable-object-cache-15.2.15-32.gb0aaed0 733 kB/s | 203 kB 00:00 2021-11-21T03:44:20.948 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:44:20.948 INFO:teuthology.orchestra.run.gibba043.stdout:Total 729 kB/s | 203 kB 00:00 2021-11-21T03:44:20.949 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:44:20.958 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:44:20.959 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:44:20.996 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:44:20.999 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:44:21.098 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:44:21.329 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-immutable-object-cache-2:15.2.15-32.gb0aaed0f.e 1/1 2021-11-21T03:44:21.596 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.15-32.gb0aaed0f.e 1/1 2021-11-21T03:44:21.960 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-immutable-object-cache-2:15.2.15-32.gb0aaed0f.e 1/1 2021-11-21T03:44:21.961 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:44:25.440 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:44:00 AM UTC. 2021-11-21T03:44:27.457 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:44:27.457 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:44:27.457 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-immutable-object-cache-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:44:27.458 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:44:27.458 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:44:27.548 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install ceph-mgr 2021-11-21T03:44:27.771 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:44:28.217 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 kB/s | 2.8 kB 00:00 2021-11-21T03:44:31.041 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:44:05 AM UTC. 2021-11-21T03:44:31.179 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 85 kB/s | 2.4 kB 00:00 2021-11-21T03:44:33.137 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:44:33.137 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:44:33.137 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-immutable-object-cache-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:44:33.137 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:44:33.138 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:44:33.245 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install ceph-mgr 2021-11-21T03:44:33.453 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:44:33.896 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 kB/s | 2.4 kB 00:00 2021-11-21T03:44:34.380 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:44:35.745 INFO:teuthology.orchestra.run.gibba022.stdout:Package ceph-mgr-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:44:36.035 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:44:36.036 INFO:teuthology.orchestra.run.gibba022.stdout:Nothing to do. 2021-11-21T03:44:36.036 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:44:36.097 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install ceph-mgr-dashboard 2021-11-21T03:44:36.303 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:44:36.754 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 102 kB/s | 2.8 kB 00:00 2021-11-21T03:44:36.873 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 kB/s | 2.4 kB 00:00 2021-11-21T03:44:37.031 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 105 kB/s | 2.8 kB 00:00 2021-11-21T03:44:38.060 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:44:38.061 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================================== 2021-11-21T03:44:38.061 INFO:teuthology.orchestra.run.gibba022.stdout: Package Arch Version Repository Size 2021-11-21T03:44:38.061 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================================== 2021-11-21T03:44:38.061 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:44:38.062 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mgr-dashboard noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 3.6 M 2021-11-21T03:44:38.062 INFO:teuthology.orchestra.run.gibba022.stdout:Installing dependencies: 2021-11-21T03:44:38.062 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-grafana-dashboards noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 24 k 2021-11-21T03:44:38.062 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-prometheus-alerts noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 9.0 k 2021-11-21T03:44:38.063 INFO:teuthology.orchestra.run.gibba022.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-11-21T03:44:38.063 INFO:teuthology.orchestra.run.gibba022.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-11-21T03:44:38.063 INFO:teuthology.orchestra.run.gibba022.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-11-21T03:44:38.063 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:44:38.063 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:44:38.064 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================================== 2021-11-21T03:44:38.064 INFO:teuthology.orchestra.run.gibba022.stdout:Install 6 Packages 2021-11-21T03:44:38.064 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:44:38.065 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 3.9 M 2021-11-21T03:44:38.066 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 19 M 2021-11-21T03:44:38.066 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:44:38.211 INFO:teuthology.orchestra.run.gibba022.stdout:(1/6): ceph-prometheus-alerts-15.2.15-32.gb0aae 60 kB/s | 9.0 kB 00:00 2021-11-21T03:44:38.241 INFO:teuthology.orchestra.run.gibba022.stdout:(2/6): ceph-grafana-dashboards-15.2.15-32.gb0aa 137 kB/s | 24 kB 00:00 2021-11-21T03:44:38.297 INFO:teuthology.orchestra.run.gibba022.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 393 kB/s | 34 kB 00:00 2021-11-21T03:44:38.326 INFO:teuthology.orchestra.run.gibba022.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2021-11-21T03:44:38.377 INFO:teuthology.orchestra.run.gibba022.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.4 MB/s | 196 kB 00:00 2021-11-21T03:44:38.552 INFO:teuthology.orchestra.run.gibba022.stdout:(6/6): ceph-mgr-dashboard-15.2.15-32.gb0aaed0f. 7.3 MB/s | 3.6 MB 00:00 2021-11-21T03:44:38.553 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:44:38.553 INFO:teuthology.orchestra.run.gibba022.stdout:Total 7.9 MB/s | 3.9 MB 00:00 2021-11-21T03:44:38.555 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:44:38.563 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:44:38.563 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:44:38.727 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:44:38.730 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:44:38.961 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:44:39.154 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2021-11-21T03:44:39.304 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2021-11-21T03:44:39.506 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2021-11-21T03:44:39.618 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-prometheus-alerts-2:15.2.15-32.gb0aaed0f.el8.no 4/6 2021-11-21T03:44:40.014 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:44:40.467 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-grafana-dashboards-2:15.2.15-32.gb0aaed0f.el8.n 5/6 2021-11-21T03:44:40.698 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-mgr-dashboard-2:15.2.15-32.gb0aaed0f.el8.noarch 6/6 2021-11-21T03:44:40.904 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.15-32.gb0aaed0f.el8.noarch 6/6 2021-11-21T03:44:40.904 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-grafana-dashboards-2:15.2.15-32.gb0aaed0f.el8.n 1/6 2021-11-21T03:44:40.904 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-mgr-dashboard-2:15.2.15-32.gb0aaed0f.el8.noarch 2/6 2021-11-21T03:44:40.904 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-prometheus-alerts-2:15.2.15-32.gb0aaed0f.el8.no 3/6 2021-11-21T03:44:40.905 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2021-11-21T03:44:40.905 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2021-11-21T03:44:41.229 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2021-11-21T03:44:41.229 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:44:41.367 INFO:teuthology.orchestra.run.gibba043.stdout:Package ceph-mgr-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:44:41.651 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:44:41.652 INFO:teuthology.orchestra.run.gibba043.stdout:Nothing to do. 2021-11-21T03:44:41.652 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:44:41.715 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install ceph-mgr-dashboard 2021-11-21T03:44:41.931 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:44:42.379 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 91 kB/s | 2.4 kB 00:00 2021-11-21T03:44:42.461 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 kB/s | 2.8 kB 00:00 2021-11-21T03:44:43.618 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:44:43.619 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================================== 2021-11-21T03:44:43.619 INFO:teuthology.orchestra.run.gibba043.stdout: Package Arch Version Repository Size 2021-11-21T03:44:43.620 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================================== 2021-11-21T03:44:43.620 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:44:43.621 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mgr-dashboard noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 3.6 M 2021-11-21T03:44:43.621 INFO:teuthology.orchestra.run.gibba043.stdout:Installing dependencies: 2021-11-21T03:44:43.622 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-grafana-dashboards noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 24 k 2021-11-21T03:44:43.622 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-prometheus-alerts noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 9.0 k 2021-11-21T03:44:43.623 INFO:teuthology.orchestra.run.gibba043.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-11-21T03:44:43.623 INFO:teuthology.orchestra.run.gibba043.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-11-21T03:44:43.624 INFO:teuthology.orchestra.run.gibba043.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-11-21T03:44:43.624 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:44:43.627 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:44:43.627 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================================== 2021-11-21T03:44:43.627 INFO:teuthology.orchestra.run.gibba043.stdout:Install 6 Packages 2021-11-21T03:44:43.627 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:44:43.628 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 3.9 M 2021-11-21T03:44:43.628 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 19 M 2021-11-21T03:44:43.629 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:44:43.771 INFO:teuthology.orchestra.run.gibba043.stdout:(1/6): ceph-prometheus-alerts-15.2.15-32.gb0aae 60 kB/s | 9.0 kB 00:00 2021-11-21T03:44:43.799 INFO:teuthology.orchestra.run.gibba043.stdout:(2/6): ceph-grafana-dashboards-15.2.15-32.gb0aa 136 kB/s | 24 kB 00:00 2021-11-21T03:44:43.860 INFO:teuthology.orchestra.run.gibba043.stdout:(3/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 378 kB/s | 34 kB 00:00 2021-11-21T03:44:43.889 INFO:teuthology.orchestra.run.gibba043.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2021-11-21T03:44:43.939 INFO:teuthology.orchestra.run.gibba043.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.4 MB/s | 196 kB 00:00 2021-11-21T03:44:44.138 INFO:teuthology.orchestra.run.gibba043.stdout:(6/6): ceph-mgr-dashboard-15.2.15-32.gb0aaed0f. 6.9 MB/s | 3.6 MB 00:00 2021-11-21T03:44:44.143 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:44:44.143 INFO:teuthology.orchestra.run.gibba043.stdout:Total 7.5 MB/s | 3.9 MB 00:00 2021-11-21T03:44:44.143 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:44:44.150 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:44:44.150 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:44:44.308 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:44:44.310 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:44:44.575 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:44:44.825 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2021-11-21T03:44:45.033 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2021-11-21T03:44:45.199 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2021-11-21T03:44:45.340 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-prometheus-alerts-2:15.2.15-32.gb0aaed0f.el8.no 4/6 2021-11-21T03:44:46.215 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-grafana-dashboards-2:15.2.15-32.gb0aaed0f.el8.n 5/6 2021-11-21T03:44:46.508 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-mgr-dashboard-2:15.2.15-32.gb0aaed0f.el8.noarch 6/6 2021-11-21T03:44:46.666 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.2.15-32.gb0aaed0f.el8.noarch 6/6 2021-11-21T03:44:46.666 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-grafana-dashboards-2:15.2.15-32.gb0aaed0f.el8.n 1/6 2021-11-21T03:44:46.667 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-mgr-dashboard-2:15.2.15-32.gb0aaed0f.el8.noarch 2/6 2021-11-21T03:44:46.667 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-prometheus-alerts-2:15.2.15-32.gb0aaed0f.el8.no 3/6 2021-11-21T03:44:46.667 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2021-11-21T03:44:46.667 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2021-11-21T03:44:47.032 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2021-11-21T03:44:47.033 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:44:50.154 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:44:21 AM UTC. 2021-11-21T03:44:52.231 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:44:52.232 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:44:52.232 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-grafana-dashboards-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:44:52.233 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mgr-dashboard-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:44:52.233 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-prometheus-alerts-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:44:52.234 INFO:teuthology.orchestra.run.gibba022.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-11-21T03:44:52.245 INFO:teuthology.orchestra.run.gibba022.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-11-21T03:44:52.245 INFO:teuthology.orchestra.run.gibba022.stdout: python3-routes-2.4.1-12.el8.noarch 2021-11-21T03:44:52.246 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:44:52.246 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:44:52.317 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install ceph-mgr-diskprediction-local 2021-11-21T03:44:52.527 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:44:52.962 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 kB/s | 2.8 kB 00:00 2021-11-21T03:44:55.919 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 92 kB/s | 2.4 kB 00:00 2021-11-21T03:44:56.036 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:44:26 AM UTC. 2021-11-21T03:44:57.982 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:44:57.983 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:44:57.983 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-grafana-dashboards-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:44:57.983 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mgr-dashboard-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:44:57.984 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-prometheus-alerts-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:44:57.984 INFO:teuthology.orchestra.run.gibba043.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-11-21T03:44:57.985 INFO:teuthology.orchestra.run.gibba043.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-11-21T03:44:57.985 INFO:teuthology.orchestra.run.gibba043.stdout: python3-routes-2.4.1-12.el8.noarch 2021-11-21T03:44:57.986 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:44:57.991 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:44:58.066 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install ceph-mgr-diskprediction-local 2021-11-21T03:44:58.287 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:44:58.777 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 kB/s | 2.4 kB 00:00 2021-11-21T03:44:59.223 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:45:00.842 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:45:00.842 INFO:teuthology.orchestra.run.gibba022.stdout:====================================================================================================================== 2021-11-21T03:45:00.843 INFO:teuthology.orchestra.run.gibba022.stdout: Package Arch Version Repository Size 2021-11-21T03:45:00.843 INFO:teuthology.orchestra.run.gibba022.stdout:====================================================================================================================== 2021-11-21T03:45:00.843 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:45:00.844 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mgr-diskprediction-local noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 8.6 M 2021-11-21T03:45:00.844 INFO:teuthology.orchestra.run.gibba022.stdout:Installing dependencies: 2021-11-21T03:45:00.844 INFO:teuthology.orchestra.run.gibba022.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2021-11-21T03:45:00.844 INFO:teuthology.orchestra.run.gibba022.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2021-11-21T03:45:00.845 INFO:teuthology.orchestra.run.gibba022.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2021-11-21T03:45:00.845 INFO:teuthology.orchestra.run.gibba022.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2021-11-21T03:45:00.845 INFO:teuthology.orchestra.run.gibba022.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2021-11-21T03:45:00.845 INFO:teuthology.orchestra.run.gibba022.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2021-11-21T03:45:00.846 INFO:teuthology.orchestra.run.gibba022.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2021-11-21T03:45:00.846 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:45:00.846 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:45:00.861 INFO:teuthology.orchestra.run.gibba022.stdout:====================================================================================================================== 2021-11-21T03:45:00.862 INFO:teuthology.orchestra.run.gibba022.stdout:Install 8 Packages 2021-11-21T03:45:00.865 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:45:00.866 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 37 M 2021-11-21T03:45:00.869 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 196 M 2021-11-21T03:45:00.869 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:45:00.917 INFO:teuthology.orchestra.run.gibba022.stdout:(1/8): openblas-threads-0.3.3-5.el8.x86_64.rpm 60 MB/s | 4.4 MB 00:00 2021-11-21T03:45:00.939 INFO:teuthology.orchestra.run.gibba022.stdout:(2/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 10 MB/s | 225 kB 00:00 2021-11-21T03:45:01.076 INFO:teuthology.orchestra.run.gibba022.stdout:(3/8): python3-scipy-1.0.0-20.module+el8.1.0+33 63 MB/s | 15 MB 00:00 2021-11-21T03:45:01.086 INFO:teuthology.orchestra.run.gibba022.stdout:(4/8): openblas-0.3.3-5.el8.x86_64.rpm 29 MB/s | 4.3 MB 00:00 2021-11-21T03:45:01.116 INFO:teuthology.orchestra.run.gibba022.stdout:(5/8): libgfortran-8.3.1-5.1.el8.x86_64.rpm 24 MB/s | 639 kB 00:00 2021-11-21T03:45:01.138 INFO:teuthology.orchestra.run.gibba022.stdout:(6/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 61 MB/s | 3.7 MB 00:00 2021-11-21T03:45:01.144 INFO:teuthology.orchestra.run.gibba022.stdout:(7/8): libquadmath-8.3.1-5.1.el8.x86_64.rpm 6.6 MB/s | 169 kB 00:00 2021-11-21T03:45:01.529 INFO:teuthology.orchestra.run.gibba022.stdout:(8/8): ceph-mgr-diskprediction-local-15.2.15-32 13 MB/s | 8.6 MB 00:00 2021-11-21T03:45:01.531 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:45:01.531 INFO:teuthology.orchestra.run.gibba022.stdout:Total 53 MB/s | 37 MB 00:00 2021-11-21T03:45:01.542 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:45:01.556 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:45:01.556 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:45:01.800 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:45:01.803 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:45:01.911 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 101 kB/s | 2.8 kB 00:00 2021-11-21T03:45:02.312 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:45:02.497 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-11-21T03:45:02.594 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-11-21T03:45:02.746 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-11-21T03:45:03.146 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-11-21T03:45:03.347 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-11-21T03:45:03.735 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-11-21T03:45:03.922 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : openblas-0.3.3-5.el8.x86_64 4/8 2021-11-21T03:45:04.485 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 4/8 2021-11-21T03:45:04.802 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-11-21T03:45:04.859 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:45:05.005 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-11-21T03:45:06.486 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:45:06.487 INFO:teuthology.orchestra.run.gibba043.stdout:====================================================================================================================== 2021-11-21T03:45:06.488 INFO:teuthology.orchestra.run.gibba043.stdout: Package Arch Version Repository Size 2021-11-21T03:45:06.488 INFO:teuthology.orchestra.run.gibba043.stdout:====================================================================================================================== 2021-11-21T03:45:06.489 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:45:06.491 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mgr-diskprediction-local noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 8.6 M 2021-11-21T03:45:06.491 INFO:teuthology.orchestra.run.gibba043.stdout:Installing dependencies: 2021-11-21T03:45:06.492 INFO:teuthology.orchestra.run.gibba043.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2021-11-21T03:45:06.492 INFO:teuthology.orchestra.run.gibba043.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2021-11-21T03:45:06.493 INFO:teuthology.orchestra.run.gibba043.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2021-11-21T03:45:06.493 INFO:teuthology.orchestra.run.gibba043.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2021-11-21T03:45:06.493 INFO:teuthology.orchestra.run.gibba043.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2021-11-21T03:45:06.494 INFO:teuthology.orchestra.run.gibba043.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2021-11-21T03:45:06.494 INFO:teuthology.orchestra.run.gibba043.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2021-11-21T03:45:06.494 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:45:06.495 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:45:06.495 INFO:teuthology.orchestra.run.gibba043.stdout:====================================================================================================================== 2021-11-21T03:45:06.496 INFO:teuthology.orchestra.run.gibba043.stdout:Install 8 Packages 2021-11-21T03:45:06.497 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:45:06.497 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 37 M 2021-11-21T03:45:06.498 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 196 M 2021-11-21T03:45:06.498 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:45:06.531 INFO:teuthology.orchestra.run.gibba043.stdout:(1/8): libgfortran-8.3.1-5.1.el8.x86_64.rpm 16 MB/s | 639 kB 00:00 2021-11-21T03:45:06.534 INFO:teuthology.orchestra.run.gibba043.stdout:(2/8): libquadmath-8.3.1-5.1.el8.x86_64.rpm 3.8 MB/s | 169 kB 00:00 2021-11-21T03:45:06.587 INFO:teuthology.orchestra.run.gibba043.stdout:(3/8): openblas-threads-0.3.3-5.el8.x86_64.rpm 88 MB/s | 4.4 MB 00:00 2021-11-21T03:45:06.602 INFO:teuthology.orchestra.run.gibba043.stdout:(4/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 11 MB/s | 225 kB 00:00 2021-11-21T03:45:06.607 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-11-21T03:45:06.723 INFO:teuthology.orchestra.run.gibba043.stdout:(5/8): python3-scipy-1.0.0-20.module+el8.1.0+33 76 MB/s | 15 MB 00:00 2021-11-21T03:45:06.732 INFO:teuthology.orchestra.run.gibba043.stdout:(6/8): openblas-0.3.3-5.el8.x86_64.rpm 33 MB/s | 4.3 MB 00:00 2021-11-21T03:45:06.769 INFO:teuthology.orchestra.run.gibba043.stdout:(7/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 82 MB/s | 3.7 MB 00:00 2021-11-21T03:45:07.175 INFO:teuthology.orchestra.run.gibba043.stdout:(8/8): ceph-mgr-diskprediction-local-15.2.15-32 13 MB/s | 8.6 MB 00:00 2021-11-21T03:45:07.175 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:45:07.175 INFO:teuthology.orchestra.run.gibba043.stdout:Total 53 MB/s | 37 MB 00:00 2021-11-21T03:45:07.185 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:45:07.203 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:45:07.204 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:45:07.448 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:45:07.449 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:45:07.715 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2021-11-21T03:45:07.897 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.15-32.gb0aaed0f 8/8 2021-11-21T03:45:08.012 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:45:08.075 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-11-21T03:45:08.097 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.15-32.gb0aaed0f 8/8 2021-11-21T03:45:08.097 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.15-32.gb0aaed0f 1/8 2021-11-21T03:45:08.097 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 2/8 2021-11-21T03:45:08.100 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-11-21T03:45:08.100 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 4/8 2021-11-21T03:45:08.100 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 5/8 2021-11-21T03:45:08.100 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 6/8 2021-11-21T03:45:08.101 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 7/8 2021-11-21T03:45:08.210 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-11-21T03:45:08.383 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-11-21T03:45:08.471 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 8/8 2021-11-21T03:45:08.472 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:45:08.789 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-11-21T03:45:08.993 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-11-21T03:45:09.390 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-11-21T03:45:09.624 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : openblas-0.3.3-5.el8.x86_64 4/8 2021-11-21T03:45:10.170 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 4/8 2021-11-21T03:45:10.463 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-11-21T03:45:10.675 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-11-21T03:45:12.234 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-11-21T03:45:13.343 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2021-11-21T03:45:13.525 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-mgr-diskprediction-local-2:15.2.15-32.gb0aaed0f 8/8 2021-11-21T03:45:13.753 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.15-32.gb0aaed0f 8/8 2021-11-21T03:45:13.754 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.2.15-32.gb0aaed0f 1/8 2021-11-21T03:45:13.754 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-11-21T03:45:13.754 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 3/8 2021-11-21T03:45:13.761 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 4/8 2021-11-21T03:45:13.761 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 5/8 2021-11-21T03:45:13.761 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-11-21T03:45:13.761 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 7/8 2021-11-21T03:45:14.154 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 8/8 2021-11-21T03:45:14.154 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:45:17.503 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:44:45 AM UTC. 2021-11-21T03:45:19.477 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:45:19.478 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:45:19.478 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mgr-diskprediction-local-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:45:19.478 INFO:teuthology.orchestra.run.gibba022.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-11-21T03:45:19.478 INFO:teuthology.orchestra.run.gibba022.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-11-21T03:45:19.479 INFO:teuthology.orchestra.run.gibba022.stdout: openblas-0.3.3-5.el8.x86_64 2021-11-21T03:45:19.479 INFO:teuthology.orchestra.run.gibba022.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-11-21T03:45:19.479 INFO:teuthology.orchestra.run.gibba022.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-11-21T03:45:19.480 INFO:teuthology.orchestra.run.gibba022.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-11-21T03:45:19.480 INFO:teuthology.orchestra.run.gibba022.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2021-11-21T03:45:19.480 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:45:19.480 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:45:19.558 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install ceph-mgr-rook 2021-11-21T03:45:19.767 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:45:20.220 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2021-11-21T03:45:23.144 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:44:51 AM UTC. 2021-11-21T03:45:23.270 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 86 kB/s | 2.4 kB 00:00 2021-11-21T03:45:25.104 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:45:25.105 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:45:25.105 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mgr-diskprediction-local-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:45:25.105 INFO:teuthology.orchestra.run.gibba043.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-11-21T03:45:25.106 INFO:teuthology.orchestra.run.gibba043.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-11-21T03:45:25.106 INFO:teuthology.orchestra.run.gibba043.stdout: openblas-0.3.3-5.el8.x86_64 2021-11-21T03:45:25.106 INFO:teuthology.orchestra.run.gibba043.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-11-21T03:45:25.106 INFO:teuthology.orchestra.run.gibba043.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-11-21T03:45:25.107 INFO:teuthology.orchestra.run.gibba043.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-11-21T03:45:25.107 INFO:teuthology.orchestra.run.gibba043.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2021-11-21T03:45:25.107 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:45:25.107 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:45:25.183 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install ceph-mgr-rook 2021-11-21T03:45:25.392 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:45:25.833 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 85 kB/s | 2.4 kB 00:00 2021-11-21T03:45:26.455 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:45:28.067 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:45:28.074 INFO:teuthology.orchestra.run.gibba022.stdout:======================================================================================================= 2021-11-21T03:45:28.074 INFO:teuthology.orchestra.run.gibba022.stdout: Package Arch Version Repository Size 2021-11-21T03:45:28.074 INFO:teuthology.orchestra.run.gibba022.stdout:======================================================================================================= 2021-11-21T03:45:28.075 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:45:28.075 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mgr-rook noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 27 k 2021-11-21T03:45:28.075 INFO:teuthology.orchestra.run.gibba022.stdout:Installing dependencies: 2021-11-21T03:45:28.075 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-11-21T03:45:28.076 INFO:teuthology.orchestra.run.gibba022.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-11-21T03:45:28.076 INFO:teuthology.orchestra.run.gibba022.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-11-21T03:45:28.076 INFO:teuthology.orchestra.run.gibba022.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-11-21T03:45:28.076 INFO:teuthology.orchestra.run.gibba022.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2021-11-21T03:45:28.077 INFO:teuthology.orchestra.run.gibba022.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-11-21T03:45:28.077 INFO:teuthology.orchestra.run.gibba022.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2021-11-21T03:45:28.077 INFO:teuthology.orchestra.run.gibba022.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2021-11-21T03:45:28.077 INFO:teuthology.orchestra.run.gibba022.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2021-11-21T03:45:28.077 INFO:teuthology.orchestra.run.gibba022.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-11-21T03:45:28.078 INFO:teuthology.orchestra.run.gibba022.stdout: python3-rsa noarch 4.7.2-1.el8 epel 61 k 2021-11-21T03:45:28.078 INFO:teuthology.orchestra.run.gibba022.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-11-21T03:45:28.090 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:45:28.090 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:45:28.090 INFO:teuthology.orchestra.run.gibba022.stdout:======================================================================================================= 2021-11-21T03:45:28.091 INFO:teuthology.orchestra.run.gibba022.stdout:Install 13 Packages 2021-11-21T03:45:28.091 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:45:28.091 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 1.9 M 2021-11-21T03:45:28.091 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 24 M 2021-11-21T03:45:28.092 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:45:28.154 INFO:teuthology.orchestra.run.gibba022.stdout:(1/13): python3-cachetools-3.1.1-4.el8.noarch.r 392 kB/s | 33 kB 00:00 2021-11-21T03:45:28.156 INFO:teuthology.orchestra.run.gibba022.stdout:(2/13): python3-certifi-2018.10.15-7.el8.noarch 190 kB/s | 16 kB 00:00 2021-11-21T03:45:28.210 INFO:teuthology.orchestra.run.gibba022.stdout:(3/13): python3-google-auth-1.1.1-10.el8.noarch 1.4 MB/s | 81 kB 00:00 2021-11-21T03:45:28.239 INFO:teuthology.orchestra.run.gibba022.stdout:(4/13): python3-rsa-4.7.2-1.el8.noarch.rpm 2.1 MB/s | 61 kB 00:00 2021-11-21T03:45:28.248 INFO:teuthology.orchestra.run.gibba022.stdout:(5/13): ceph-mgr-rook-15.2.15-32.gb0aaed0f.el8. 152 kB/s | 27 kB 00:00 2021-11-21T03:45:28.274 INFO:teuthology.orchestra.run.gibba022.stdout:(6/13): python3-websocket-client-0.56.0-5.el8.n 2.1 MB/s | 61 kB 00:00 2021-11-21T03:45:28.284 INFO:teuthology.orchestra.run.gibba022.stdout:(7/13): python3-jsonpointer-1.10-11.el8.noarch. 558 kB/s | 20 kB 00:00 2021-11-21T03:45:28.300 INFO:teuthology.orchestra.run.gibba022.stdout:(8/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.8 MB/s | 126 kB 00:00 2021-11-21T03:45:28.308 INFO:teuthology.orchestra.run.gibba022.stdout:(9/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 1.2 MB/s | 27 kB 00:00 2021-11-21T03:45:28.319 INFO:teuthology.orchestra.run.gibba022.stdout:(10/13): python3-pyasn1-modules-0.3.7-6.el8.noa 5.8 MB/s | 110 kB 00:00 2021-11-21T03:45:28.334 INFO:teuthology.orchestra.run.gibba022.stdout:(11/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 5.7 MB/s | 155 kB 00:00 2021-11-21T03:45:28.341 INFO:teuthology.orchestra.run.gibba022.stdout:(12/13): python3-requests-oauthlib-1.0.0-1.el8. 2.0 MB/s | 43 kB 00:00 2021-11-21T03:45:28.385 INFO:teuthology.orchestra.run.gibba022.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 5.1 MB/s | 1.2 MB 00:00 2021-11-21T03:45:28.386 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:45:28.386 INFO:teuthology.orchestra.run.gibba022.stdout:Total 6.0 MB/s | 1.9 MB 00:00 2021-11-21T03:45:28.393 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:45:28.403 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:45:28.404 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:45:28.476 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:45:28.479 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:45:28.908 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:45:29.029 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 107 kB/s | 2.8 kB 00:00 2021-11-21T03:45:29.116 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-11-21T03:45:29.299 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-rsa-4.7.2-1.el8.noarch 2/13 2021-11-21T03:45:29.509 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2021-11-21T03:45:29.696 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/13 2021-11-21T03:45:29.896 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/13 2021-11-21T03:45:30.052 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 6/13 2021-11-21T03:45:30.283 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 7/13 2021-11-21T03:45:30.477 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2021-11-21T03:45:30.682 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-11-21T03:45:30.873 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2021-11-21T03:45:31.744 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2021-11-21T03:45:31.961 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2021-11-21T03:45:32.034 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:45:32.110 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-mgr-rook-2:15.2.15-32.gb0aaed0f.el8.noarch 13/13 2021-11-21T03:45:32.272 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.15-32.gb0aaed0f.el8.noarch 13/13 2021-11-21T03:45:32.272 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-mgr-rook-2:15.2.15-32.gb0aaed0f.el8.noarch 1/13 2021-11-21T03:45:32.272 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2021-11-21T03:45:32.272 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2021-11-21T03:45:32.273 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2021-11-21T03:45:32.273 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2021-11-21T03:45:32.273 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-rsa-4.7.2-1.el8.noarch 6/13 2021-11-21T03:45:32.273 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2021-11-21T03:45:32.274 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 8/13 2021-11-21T03:45:32.274 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 9/13 2021-11-21T03:45:32.274 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 10/13 2021-11-21T03:45:32.278 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 11/13 2021-11-21T03:45:32.279 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 12/13 2021-11-21T03:45:32.703 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 13/13 2021-11-21T03:45:32.704 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:45:33.664 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:45:33.665 INFO:teuthology.orchestra.run.gibba043.stdout:======================================================================================================= 2021-11-21T03:45:33.665 INFO:teuthology.orchestra.run.gibba043.stdout: Package Arch Version Repository Size 2021-11-21T03:45:33.666 INFO:teuthology.orchestra.run.gibba043.stdout:======================================================================================================= 2021-11-21T03:45:33.666 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:45:33.666 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mgr-rook noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 27 k 2021-11-21T03:45:33.666 INFO:teuthology.orchestra.run.gibba043.stdout:Installing dependencies: 2021-11-21T03:45:33.668 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-11-21T03:45:33.668 INFO:teuthology.orchestra.run.gibba043.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-11-21T03:45:33.669 INFO:teuthology.orchestra.run.gibba043.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-11-21T03:45:33.669 INFO:teuthology.orchestra.run.gibba043.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-11-21T03:45:33.670 INFO:teuthology.orchestra.run.gibba043.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2021-11-21T03:45:33.670 INFO:teuthology.orchestra.run.gibba043.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-11-21T03:45:33.670 INFO:teuthology.orchestra.run.gibba043.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2021-11-21T03:45:33.670 INFO:teuthology.orchestra.run.gibba043.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2021-11-21T03:45:33.670 INFO:teuthology.orchestra.run.gibba043.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2021-11-21T03:45:33.671 INFO:teuthology.orchestra.run.gibba043.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-11-21T03:45:33.671 INFO:teuthology.orchestra.run.gibba043.stdout: python3-rsa noarch 4.7.2-1.el8 epel 61 k 2021-11-21T03:45:33.671 INFO:teuthology.orchestra.run.gibba043.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-11-21T03:45:33.671 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:45:33.672 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:45:33.672 INFO:teuthology.orchestra.run.gibba043.stdout:======================================================================================================= 2021-11-21T03:45:33.672 INFO:teuthology.orchestra.run.gibba043.stdout:Install 13 Packages 2021-11-21T03:45:33.672 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:45:33.673 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 1.9 M 2021-11-21T03:45:33.673 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 24 M 2021-11-21T03:45:33.674 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:45:33.751 INFO:teuthology.orchestra.run.gibba043.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 194 kB/s | 16 kB 00:00 2021-11-21T03:45:33.752 INFO:teuthology.orchestra.run.gibba043.stdout:(2/13): python3-cachetools-3.1.1-4.el8.noarch.r 392 kB/s | 33 kB 00:00 2021-11-21T03:45:33.808 INFO:teuthology.orchestra.run.gibba043.stdout:(3/13): python3-google-auth-1.1.1-10.el8.noarch 1.4 MB/s | 81 kB 00:00 2021-11-21T03:45:33.836 INFO:teuthology.orchestra.run.gibba043.stdout:(4/13): python3-rsa-4.7.2-1.el8.noarch.rpm 2.1 MB/s | 61 kB 00:00 2021-11-21T03:45:33.844 INFO:teuthology.orchestra.run.gibba043.stdout:(5/13): ceph-mgr-rook-15.2.15-32.gb0aaed0f.el8. 155 kB/s | 27 kB 00:00 2021-11-21T03:45:33.865 INFO:teuthology.orchestra.run.gibba043.stdout:(6/13): python3-websocket-client-0.56.0-5.el8.n 2.1 MB/s | 61 kB 00:00 2021-11-21T03:45:33.872 INFO:teuthology.orchestra.run.gibba043.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 5.3 MB/s | 155 kB 00:00 2021-11-21T03:45:33.892 INFO:teuthology.orchestra.run.gibba043.stdout:(8/13): python3-requests-oauthlib-1.0.0-1.el8.n 1.5 MB/s | 43 kB 00:00 2021-11-21T03:45:33.897 INFO:teuthology.orchestra.run.gibba043.stdout:(9/13): python3-jsonpointer-1.10-11.el8.noarch. 780 kB/s | 20 kB 00:00 2021-11-21T03:45:33.914 INFO:teuthology.orchestra.run.gibba043.stdout:(10/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.7 MB/s | 126 kB 00:00 2021-11-21T03:45:33.921 INFO:teuthology.orchestra.run.gibba043.stdout:(11/13): python3-jsonpatch-1.21-2.el8.noarch.rp 1.1 MB/s | 27 kB 00:00 2021-11-21T03:45:33.934 INFO:teuthology.orchestra.run.gibba043.stdout:(12/13): python3-pyasn1-modules-0.3.7-6.el8.noa 5.3 MB/s | 110 kB 00:00 2021-11-21T03:45:34.001 INFO:teuthology.orchestra.run.gibba043.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.7 MB/s | 1.2 MB 00:00 2021-11-21T03:45:34.002 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:45:34.002 INFO:teuthology.orchestra.run.gibba043.stdout:Total 5.7 MB/s | 1.9 MB 00:00 2021-11-21T03:45:34.009 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:45:34.020 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:45:34.021 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:45:34.076 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:45:34.079 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:45:34.590 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:45:34.837 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-11-21T03:45:35.086 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-rsa-4.7.2-1.el8.noarch 2/13 2021-11-21T03:45:35.297 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2021-11-21T03:45:35.464 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 4/13 2021-11-21T03:45:35.732 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 5/13 2021-11-21T03:45:35.975 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-11-21T03:45:36.198 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-11-21T03:45:36.422 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2021-11-21T03:45:36.619 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-11-21T03:45:36.861 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2021-11-21T03:45:37.728 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2021-11-21T03:45:37.992 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2021-11-21T03:45:38.158 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-mgr-rook-2:15.2.15-32.gb0aaed0f.el8.noarch 13/13 2021-11-21T03:45:38.332 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-mgr-rook-2:15.2.15-32.gb0aaed0f.el8.noarch 13/13 2021-11-21T03:45:38.333 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-mgr-rook-2:15.2.15-32.gb0aaed0f.el8.noarch 1/13 2021-11-21T03:45:38.333 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2021-11-21T03:45:38.333 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2021-11-21T03:45:38.333 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2021-11-21T03:45:38.334 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2021-11-21T03:45:38.334 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-rsa-4.7.2-1.el8.noarch 6/13 2021-11-21T03:45:38.334 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2021-11-21T03:45:38.334 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-11-21T03:45:38.335 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-11-21T03:45:38.335 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 10/13 2021-11-21T03:45:38.335 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 11/13 2021-11-21T03:45:38.335 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-11-21T03:45:38.737 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 13/13 2021-11-21T03:45:38.737 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:45:41.685 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:45:13 AM UTC. 2021-11-21T03:45:43.643 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:45:43.644 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:45:43.644 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mgr-rook-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:45:43.644 INFO:teuthology.orchestra.run.gibba022.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-11-21T03:45:43.644 INFO:teuthology.orchestra.run.gibba022.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-11-21T03:45:43.645 INFO:teuthology.orchestra.run.gibba022.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-11-21T03:45:43.645 INFO:teuthology.orchestra.run.gibba022.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-11-21T03:45:43.645 INFO:teuthology.orchestra.run.gibba022.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-11-21T03:45:43.645 INFO:teuthology.orchestra.run.gibba022.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-11-21T03:45:43.646 INFO:teuthology.orchestra.run.gibba022.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-11-21T03:45:43.646 INFO:teuthology.orchestra.run.gibba022.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-11-21T03:45:43.646 INFO:teuthology.orchestra.run.gibba022.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-11-21T03:45:43.646 INFO:teuthology.orchestra.run.gibba022.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-11-21T03:45:43.646 INFO:teuthology.orchestra.run.gibba022.stdout: python3-rsa-4.7.2-1.el8.noarch 2021-11-21T03:45:43.647 INFO:teuthology.orchestra.run.gibba022.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-11-21T03:45:43.648 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:45:43.648 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:45:43.759 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install ceph-mgr-cephadm 2021-11-21T03:45:43.972 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:45:44.428 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 102 kB/s | 2.8 kB 00:00 2021-11-21T03:45:47.418 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 82 kB/s | 2.4 kB 00:00 2021-11-21T03:45:47.878 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:45:18 AM UTC. 2021-11-21T03:45:49.856 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:45:49.856 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:45:49.857 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mgr-rook-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:45:49.857 INFO:teuthology.orchestra.run.gibba043.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-11-21T03:45:49.857 INFO:teuthology.orchestra.run.gibba043.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-11-21T03:45:49.857 INFO:teuthology.orchestra.run.gibba043.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-11-21T03:45:49.857 INFO:teuthology.orchestra.run.gibba043.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-11-21T03:45:49.858 INFO:teuthology.orchestra.run.gibba043.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-11-21T03:45:49.858 INFO:teuthology.orchestra.run.gibba043.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-11-21T03:45:49.858 INFO:teuthology.orchestra.run.gibba043.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-11-21T03:45:49.859 INFO:teuthology.orchestra.run.gibba043.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-11-21T03:45:49.859 INFO:teuthology.orchestra.run.gibba043.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-11-21T03:45:49.859 INFO:teuthology.orchestra.run.gibba043.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-11-21T03:45:49.859 INFO:teuthology.orchestra.run.gibba043.stdout: python3-rsa-4.7.2-1.el8.noarch 2021-11-21T03:45:49.859 INFO:teuthology.orchestra.run.gibba043.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-11-21T03:45:49.860 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:45:49.860 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:45:49.933 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install ceph-mgr-cephadm 2021-11-21T03:45:50.146 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:45:50.563 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:45:50.630 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 73 kB/s | 2.4 kB 00:00 2021-11-21T03:45:52.203 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:45:52.205 INFO:teuthology.orchestra.run.gibba022.stdout:============================================================================================== 2021-11-21T03:45:52.205 INFO:teuthology.orchestra.run.gibba022.stdout: Package Arch Version Repository Size 2021-11-21T03:45:52.205 INFO:teuthology.orchestra.run.gibba022.stdout:============================================================================================== 2021-11-21T03:45:52.206 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:45:52.206 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mgr-cephadm noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 68 k 2021-11-21T03:45:52.207 INFO:teuthology.orchestra.run.gibba022.stdout:Installing dependencies: 2021-11-21T03:45:52.207 INFO:teuthology.orchestra.run.gibba022.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-11-21T03:45:52.208 INFO:teuthology.orchestra.run.gibba022.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2021-11-21T03:45:52.208 INFO:teuthology.orchestra.run.gibba022.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-11-21T03:45:52.208 INFO:teuthology.orchestra.run.gibba022.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2021-11-21T03:45:52.209 INFO:teuthology.orchestra.run.gibba022.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2021-11-21T03:45:52.209 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:45:52.210 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:45:52.211 INFO:teuthology.orchestra.run.gibba022.stdout:============================================================================================== 2021-11-21T03:45:52.211 INFO:teuthology.orchestra.run.gibba022.stdout:Install 6 Packages 2021-11-21T03:45:52.211 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:45:52.212 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 5.8 M 2021-11-21T03:45:52.212 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 24 M 2021-11-21T03:45:52.213 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:45:52.287 INFO:teuthology.orchestra.run.gibba022.stdout:(1/6): python3-apipkg-1.5-6.el8.noarch.rpm 258 kB/s | 21 kB 00:00 2021-11-21T03:45:52.342 INFO:teuthology.orchestra.run.gibba022.stdout:(2/6): python3-remoto-1.2.1-1.el8.noarch.rpm 888 kB/s | 49 kB 00:00 2021-11-21T03:45:52.376 INFO:teuthology.orchestra.run.gibba022.stdout:(3/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 16 MB/s | 538 kB 00:00 2021-11-21T03:45:52.382 INFO:teuthology.orchestra.run.gibba022.stdout:(4/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.0 MB/s | 355 kB 00:00 2021-11-21T03:45:52.420 INFO:teuthology.orchestra.run.gibba022.stdout:(5/6): python3-babel-2.5.1-5.el8.noarch.rpm 107 MB/s | 4.8 MB 00:00 2021-11-21T03:45:52.435 INFO:teuthology.orchestra.run.gibba022.stdout:(6/6): ceph-mgr-cephadm-15.2.15-32.gb0aaed0f.el 296 kB/s | 68 kB 00:00 2021-11-21T03:45:52.436 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:45:52.436 INFO:teuthology.orchestra.run.gibba022.stdout:Total 25 MB/s | 5.8 MB 00:00 2021-11-21T03:45:52.439 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:45:52.447 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:45:52.447 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:45:52.512 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:45:52.519 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:45:53.296 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:45:53.592 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/6 2021-11-21T03:45:53.731 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 102 kB/s | 2.8 kB 00:00 2021-11-21T03:45:53.822 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/6 2021-11-21T03:45:54.040 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 3/6 2021-11-21T03:45:54.275 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 4/6 2021-11-21T03:45:54.493 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 5/6 2021-11-21T03:45:54.671 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-mgr-cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 6/6 2021-11-21T03:45:54.844 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 6/6 2021-11-21T03:45:54.846 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-mgr-cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 1/6 2021-11-21T03:45:54.847 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 2/6 2021-11-21T03:45:54.847 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 3/6 2021-11-21T03:45:54.847 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 4/6 2021-11-21T03:45:54.847 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-11-21T03:45:55.207 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 6/6 2021-11-21T03:45:55.207 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:45:56.642 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:45:58.295 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:45:58.296 INFO:teuthology.orchestra.run.gibba043.stdout:============================================================================================== 2021-11-21T03:45:58.296 INFO:teuthology.orchestra.run.gibba043.stdout: Package Arch Version Repository Size 2021-11-21T03:45:58.296 INFO:teuthology.orchestra.run.gibba043.stdout:============================================================================================== 2021-11-21T03:45:58.297 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:45:58.297 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mgr-cephadm noarch 2:15.2.15-32.gb0aaed0f.el8 ceph-noarch 68 k 2021-11-21T03:45:58.297 INFO:teuthology.orchestra.run.gibba043.stdout:Installing dependencies: 2021-11-21T03:45:58.297 INFO:teuthology.orchestra.run.gibba043.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-11-21T03:45:58.298 INFO:teuthology.orchestra.run.gibba043.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2021-11-21T03:45:58.298 INFO:teuthology.orchestra.run.gibba043.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-11-21T03:45:58.298 INFO:teuthology.orchestra.run.gibba043.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2021-11-21T03:45:58.298 INFO:teuthology.orchestra.run.gibba043.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2021-11-21T03:45:58.299 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:45:58.299 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:45:58.299 INFO:teuthology.orchestra.run.gibba043.stdout:============================================================================================== 2021-11-21T03:45:58.299 INFO:teuthology.orchestra.run.gibba043.stdout:Install 6 Packages 2021-11-21T03:45:58.300 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:45:58.300 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 5.8 M 2021-11-21T03:45:58.300 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 24 M 2021-11-21T03:45:58.301 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:45:58.382 INFO:teuthology.orchestra.run.gibba043.stdout:(1/6): python3-apipkg-1.5-6.el8.noarch.rpm 250 kB/s | 21 kB 00:00 2021-11-21T03:45:58.439 INFO:teuthology.orchestra.run.gibba043.stdout:(2/6): python3-remoto-1.2.1-1.el8.noarch.rpm 874 kB/s | 49 kB 00:00 2021-11-21T03:45:58.469 INFO:teuthology.orchestra.run.gibba043.stdout:(3/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.0 MB/s | 355 kB 00:00 2021-11-21T03:45:58.470 INFO:teuthology.orchestra.run.gibba043.stdout:(4/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 17 MB/s | 538 kB 00:00 2021-11-21T03:45:58.505 INFO:teuthology.orchestra.run.gibba043.stdout:(5/6): ceph-mgr-cephadm-15.2.15-32.gb0aaed0f.el 328 kB/s | 68 kB 00:00 2021-11-21T03:45:58.516 INFO:teuthology.orchestra.run.gibba043.stdout:(6/6): python3-babel-2.5.1-5.el8.noarch.rpm 98 MB/s | 4.8 MB 00:00 2021-11-21T03:45:58.517 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:45:58.518 INFO:teuthology.orchestra.run.gibba043.stdout:Total 26 MB/s | 5.8 MB 00:00 2021-11-21T03:45:58.525 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:45:58.529 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:45:58.530 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:45:58.596 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:45:58.599 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:45:59.413 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:45:59.711 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/6 2021-11-21T03:45:59.946 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/6 2021-11-21T03:46:00.228 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 3/6 2021-11-21T03:46:00.520 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 4/6 2021-11-21T03:46:00.755 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 5/6 2021-11-21T03:46:00.933 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-mgr-cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 6/6 2021-11-21T03:46:01.095 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 6/6 2021-11-21T03:46:01.095 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-mgr-cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 1/6 2021-11-21T03:46:01.095 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 2/6 2021-11-21T03:46:01.096 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 3/6 2021-11-21T03:46:01.096 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 4/6 2021-11-21T03:46:01.096 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-11-21T03:46:01.457 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 6/6 2021-11-21T03:46:01.457 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:46:04.283 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:45:37 AM UTC. 2021-11-21T03:46:06.272 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:46:06.273 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:46:06.273 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-mgr-cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:46:06.273 INFO:teuthology.orchestra.run.gibba022.stdout: python3-apipkg-1.5-6.el8.noarch 2021-11-21T03:46:06.273 INFO:teuthology.orchestra.run.gibba022.stdout: python3-babel-2.5.1-5.el8.noarch 2021-11-21T03:46:06.274 INFO:teuthology.orchestra.run.gibba022.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-11-21T03:46:06.274 INFO:teuthology.orchestra.run.gibba022.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-11-21T03:46:06.274 INFO:teuthology.orchestra.run.gibba022.stdout: python3-remoto-1.2.1-1.el8.noarch 2021-11-21T03:46:06.274 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:46:06.275 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:46:06.354 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install ceph-fuse 2021-11-21T03:46:06.567 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:46:07.007 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 102 kB/s | 2.8 kB 00:00 2021-11-21T03:46:09.953 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 kB/s | 2.4 kB 00:00 2021-11-21T03:46:10.462 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:45:43 AM UTC. 2021-11-21T03:46:12.440 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:46:12.440 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:46:12.440 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-mgr-cephadm-2:15.2.15-32.gb0aaed0f.el8.noarch 2021-11-21T03:46:12.440 INFO:teuthology.orchestra.run.gibba043.stdout: python3-apipkg-1.5-6.el8.noarch 2021-11-21T03:46:12.441 INFO:teuthology.orchestra.run.gibba043.stdout: python3-babel-2.5.1-5.el8.noarch 2021-11-21T03:46:12.441 INFO:teuthology.orchestra.run.gibba043.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-11-21T03:46:12.441 INFO:teuthology.orchestra.run.gibba043.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-11-21T03:46:12.441 INFO:teuthology.orchestra.run.gibba043.stdout: python3-remoto-1.2.1-1.el8.noarch 2021-11-21T03:46:12.442 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:46:12.442 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:46:12.522 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install ceph-fuse 2021-11-21T03:46:12.743 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:46:13.129 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:02 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:46:13.212 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 85 kB/s | 2.4 kB 00:00 2021-11-21T03:46:14.766 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:46:14.767 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:46:14.767 INFO:teuthology.orchestra.run.gibba022.stdout: Package Arch Version Repository Size 2021-11-21T03:46:14.767 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:46:14.767 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:46:14.768 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-fuse 2021-11-21T03:46:14.768 INFO:teuthology.orchestra.run.gibba022.stdout: x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 574 k 2021-11-21T03:46:14.768 INFO:teuthology.orchestra.run.gibba022.stdout:Installing dependencies: 2021-11-21T03:46:14.768 INFO:teuthology.orchestra.run.gibba022.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2021-11-21T03:46:14.769 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:46:14.774 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:46:14.775 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:46:14.775 INFO:teuthology.orchestra.run.gibba022.stdout:Install 2 Packages 2021-11-21T03:46:14.775 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:46:14.775 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 656 k 2021-11-21T03:46:14.776 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 1.8 M 2021-11-21T03:46:14.776 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:46:14.805 INFO:teuthology.orchestra.run.gibba022.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 2.5 MB/s | 83 kB 00:00 2021-11-21T03:46:15.080 INFO:teuthology.orchestra.run.gibba022.stdout:(2/2): ceph-fuse-15.2.15-32.gb0aaed0f.el8.x86_6 1.8 MB/s | 574 kB 00:00 2021-11-21T03:46:15.082 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:46:15.082 INFO:teuthology.orchestra.run.gibba022.stdout:Total 2.0 MB/s | 656 kB 00:00 2021-11-21T03:46:15.083 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:46:15.098 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:46:15.099 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:46:15.151 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:46:15.323 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:46:15.323 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:46:15.517 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-11-21T03:46:15.744 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : ceph-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 2/2 2021-11-21T03:46:15.995 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: ceph-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 2/2 2021-11-21T03:46:15.995 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : ceph-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/2 2021-11-21T03:46:16.393 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-11-21T03:46:16.393 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:46:16.412 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 82 kB/s | 2.8 kB 00:00 2021-11-21T03:46:19.408 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:46:21.038 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:46:21.040 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:46:21.040 INFO:teuthology.orchestra.run.gibba043.stdout: Package Arch Version Repository Size 2021-11-21T03:46:21.040 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:46:21.041 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:46:21.041 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-fuse 2021-11-21T03:46:21.041 INFO:teuthology.orchestra.run.gibba043.stdout: x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 574 k 2021-11-21T03:46:21.041 INFO:teuthology.orchestra.run.gibba043.stdout:Installing dependencies: 2021-11-21T03:46:21.042 INFO:teuthology.orchestra.run.gibba043.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2021-11-21T03:46:21.043 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:46:21.043 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:46:21.043 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:46:21.044 INFO:teuthology.orchestra.run.gibba043.stdout:Install 2 Packages 2021-11-21T03:46:21.044 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:46:21.044 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 656 k 2021-11-21T03:46:21.045 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 1.8 M 2021-11-21T03:46:21.045 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:46:21.071 INFO:teuthology.orchestra.run.gibba043.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 2.7 MB/s | 83 kB 00:00 2021-11-21T03:46:21.353 INFO:teuthology.orchestra.run.gibba043.stdout:(2/2): ceph-fuse-15.2.15-32.gb0aaed0f.el8.x86_6 1.8 MB/s | 574 kB 00:00 2021-11-21T03:46:21.354 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:46:21.354 INFO:teuthology.orchestra.run.gibba043.stdout:Total 2.0 MB/s | 656 kB 00:00 2021-11-21T03:46:21.368 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:46:21.373 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:46:21.373 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:46:21.423 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:46:21.426 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:46:21.578 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:46:21.878 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-11-21T03:46:22.047 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : ceph-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 2/2 2021-11-21T03:46:22.330 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: ceph-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 2/2 2021-11-21T03:46:22.331 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : ceph-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/2 2021-11-21T03:46:22.760 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-11-21T03:46:22.761 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:46:25.491 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:45:59 AM UTC. 2021-11-21T03:46:27.570 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:46:27.571 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:46:27.571 INFO:teuthology.orchestra.run.gibba022.stdout: ceph-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-11-21T03:46:27.571 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:46:27.571 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:46:27.668 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install librados-devel 2021-11-21T03:46:27.911 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:46:28.380 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 106 kB/s | 2.8 kB 00:00 2021-11-21T03:46:31.414 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 77 kB/s | 2.4 kB 00:00 2021-11-21T03:46:31.705 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:46:06 AM UTC. 2021-11-21T03:46:33.724 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:46:33.724 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:46:33.724 INFO:teuthology.orchestra.run.gibba043.stdout: ceph-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-11-21T03:46:33.725 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:46:33.725 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:46:33.860 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install librados-devel 2021-11-21T03:46:34.075 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:46:34.527 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 93 kB/s | 2.4 kB 00:00 2021-11-21T03:46:34.592 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:46:36.221 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:46:36.222 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:46:36.223 INFO:teuthology.orchestra.run.gibba022.stdout: Package Arch Version Repo Size 2021-11-21T03:46:36.223 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:46:36.223 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:46:36.223 INFO:teuthology.orchestra.run.gibba022.stdout: librados-devel x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 141 k 2021-11-21T03:46:36.224 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:46:36.224 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:46:36.224 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:46:36.225 INFO:teuthology.orchestra.run.gibba022.stdout:Install 1 Package 2021-11-21T03:46:36.225 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:46:36.225 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 141 k 2021-11-21T03:46:36.225 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 479 k 2021-11-21T03:46:36.225 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:46:36.466 INFO:teuthology.orchestra.run.gibba022.stdout:librados-devel-15.2.15-32.gb0aaed0f.el8.x86_64. 579 kB/s | 141 kB 00:00 2021-11-21T03:46:36.467 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:46:36.468 INFO:teuthology.orchestra.run.gibba022.stdout:Total 575 kB/s | 141 kB 00:00 2021-11-21T03:46:36.468 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:46:36.473 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:46:36.473 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:46:36.514 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:46:36.517 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:46:36.610 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:46:36.793 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : librados-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:46:36.960 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: librados-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:46:37.318 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : librados-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:46:37.319 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:46:37.644 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 102 kB/s | 2.8 kB 00:00 2021-11-21T03:46:40.651 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:46:42.290 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:46:42.290 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:46:42.290 INFO:teuthology.orchestra.run.gibba043.stdout: Package Arch Version Repo Size 2021-11-21T03:46:42.291 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:46:42.291 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:46:42.291 INFO:teuthology.orchestra.run.gibba043.stdout: librados-devel x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 141 k 2021-11-21T03:46:42.291 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:46:42.292 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:46:42.292 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:46:42.292 INFO:teuthology.orchestra.run.gibba043.stdout:Install 1 Package 2021-11-21T03:46:42.292 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:46:42.292 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 141 k 2021-11-21T03:46:42.293 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 479 k 2021-11-21T03:46:42.293 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:46:42.559 INFO:teuthology.orchestra.run.gibba043.stdout:librados-devel-15.2.15-32.gb0aaed0f.el8.x86_64. 519 kB/s | 141 kB 00:00 2021-11-21T03:46:42.560 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:46:42.560 INFO:teuthology.orchestra.run.gibba043.stdout:Total 516 kB/s | 141 kB 00:00 2021-11-21T03:46:42.561 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:46:42.566 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:46:42.566 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:46:42.607 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:46:42.609 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:46:42.707 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:46:42.937 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : librados-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:46:43.107 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: librados-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:46:43.457 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : librados-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:46:43.457 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:46:46.493 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:46:21 AM UTC. 2021-11-21T03:46:48.452 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:46:48.453 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:46:48.453 INFO:teuthology.orchestra.run.gibba022.stdout: librados-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:46:48.453 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:46:48.453 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:46:48.540 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install libcephfs2 2021-11-21T03:46:48.756 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:46:49.201 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 kB/s | 2.8 kB 00:00 2021-11-21T03:46:52.269 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 87 kB/s | 2.4 kB 00:00 2021-11-21T03:46:52.551 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:46:27 AM UTC. 2021-11-21T03:46:54.509 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:46:54.510 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:46:54.510 INFO:teuthology.orchestra.run.gibba043.stdout: librados-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:46:54.510 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:46:54.510 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:46:54.592 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install libcephfs2 2021-11-21T03:46:54.806 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:46:55.297 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 89 kB/s | 2.4 kB 00:00 2021-11-21T03:46:55.506 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:46:56.871 INFO:teuthology.orchestra.run.gibba022.stdout:Package libcephfs2-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:46:57.158 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:46:57.158 INFO:teuthology.orchestra.run.gibba022.stdout:Nothing to do. 2021-11-21T03:46:57.158 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:46:57.215 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install libcephfs-devel 2021-11-21T03:46:57.433 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:46:57.899 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 103 kB/s | 2.8 kB 00:00 2021-11-21T03:46:58.005 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 87 kB/s | 2.4 kB 00:00 2021-11-21T03:46:58.431 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 102 kB/s | 2.8 kB 00:00 2021-11-21T03:46:59.145 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:46:59.146 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:46:59.146 INFO:teuthology.orchestra.run.gibba022.stdout: Package Arch Version Repo Size 2021-11-21T03:46:59.146 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:46:59.147 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:46:59.147 INFO:teuthology.orchestra.run.gibba022.stdout: libcephfs-devel x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 22 k 2021-11-21T03:46:59.147 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:46:59.148 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:46:59.148 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:46:59.148 INFO:teuthology.orchestra.run.gibba022.stdout:Install 1 Package 2021-11-21T03:46:59.148 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:46:59.149 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 22 k 2021-11-21T03:46:59.149 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 78 k 2021-11-21T03:46:59.149 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:46:59.338 INFO:teuthology.orchestra.run.gibba022.stdout:libcephfs-devel-15.2.15-32.gb0aaed0f.el8.x86_64 114 kB/s | 22 kB 00:00 2021-11-21T03:46:59.339 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:46:59.339 INFO:teuthology.orchestra.run.gibba022.stdout:Total 113 kB/s | 22 kB 00:00 2021-11-21T03:46:59.340 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:46:59.347 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:46:59.347 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:46:59.347 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:46:59.348 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:46:59.427 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:46:59.602 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : libcephfs-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:46:59.755 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: libcephfs-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:00.079 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : libcephfs-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:00.079 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:47:01.484 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:47:02.825 INFO:teuthology.orchestra.run.gibba043.stdout:Package libcephfs2-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:47:03.110 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:47:03.111 INFO:teuthology.orchestra.run.gibba043.stdout:Nothing to do. 2021-11-21T03:47:03.112 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:47:03.197 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install libcephfs-devel 2021-11-21T03:47:03.408 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:03.876 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 86 kB/s | 2.4 kB 00:00 2021-11-21T03:47:03.960 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2021-11-21T03:47:05.106 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:47:05.107 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:47:05.107 INFO:teuthology.orchestra.run.gibba043.stdout: Package Arch Version Repo Size 2021-11-21T03:47:05.107 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:47:05.107 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:47:05.108 INFO:teuthology.orchestra.run.gibba043.stdout: libcephfs-devel x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 22 k 2021-11-21T03:47:05.108 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:47:05.108 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:47:05.108 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:47:05.108 INFO:teuthology.orchestra.run.gibba043.stdout:Install 1 Package 2021-11-21T03:47:05.109 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:47:05.109 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 22 k 2021-11-21T03:47:05.109 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 78 k 2021-11-21T03:47:05.109 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:47:05.368 INFO:teuthology.orchestra.run.gibba043.stdout:libcephfs-devel-15.2.15-32.gb0aaed0f.el8.x86_64 83 kB/s | 22 kB 00:00 2021-11-21T03:47:05.369 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:47:05.369 INFO:teuthology.orchestra.run.gibba043.stdout:Total 83 kB/s | 22 kB 00:00 2021-11-21T03:47:05.370 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:47:05.373 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:47:05.374 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:47:05.374 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:47:05.378 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:47:05.424 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:47:05.589 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : libcephfs-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:05.777 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: libcephfs-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:06.102 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : libcephfs-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:06.103 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:47:09.011 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:46:41 AM UTC. 2021-11-21T03:47:11.011 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:47:11.011 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:47:11.011 INFO:teuthology.orchestra.run.gibba022.stdout: libcephfs-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:47:11.012 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:47:11.012 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:47:11.134 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install librados2 2021-11-21T03:47:11.350 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:11.806 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 100 kB/s | 2.8 kB 00:00 2021-11-21T03:47:14.816 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 86 kB/s | 2.4 kB 00:00 2021-11-21T03:47:15.031 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:46:48 AM UTC. 2021-11-21T03:47:17.018 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:47:17.018 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:47:17.019 INFO:teuthology.orchestra.run.gibba043.stdout: libcephfs-devel-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:47:17.019 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:47:17.019 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:47:17.139 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install librados2 2021-11-21T03:47:17.356 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:17.817 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 91 kB/s | 2.4 kB 00:00 2021-11-21T03:47:17.974 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:47:19.313 INFO:teuthology.orchestra.run.gibba022.stdout:Package librados2-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:47:19.594 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:47:19.595 INFO:teuthology.orchestra.run.gibba022.stdout:Nothing to do. 2021-11-21T03:47:19.595 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:47:19.657 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install librbd1 2021-11-21T03:47:19.872 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:20.311 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 109 kB/s | 2.8 kB 00:00 2021-11-21T03:47:20.417 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2021-11-21T03:47:20.917 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 103 kB/s | 2.8 kB 00:00 2021-11-21T03:47:21.279 INFO:teuthology.orchestra.run.gibba022.stdout:Package librbd1-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:47:21.561 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:47:21.562 INFO:teuthology.orchestra.run.gibba022.stdout:Nothing to do. 2021-11-21T03:47:21.563 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:47:21.624 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install python3-rados 2021-11-21T03:47:21.843 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:22.308 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 101 kB/s | 2.8 kB 00:00 2021-11-21T03:47:22.412 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 91 kB/s | 2.4 kB 00:00 2021-11-21T03:47:23.329 INFO:teuthology.orchestra.run.gibba022.stdout:Package python3-rados-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:47:23.609 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:47:23.610 INFO:teuthology.orchestra.run.gibba022.stdout:Nothing to do. 2021-11-21T03:47:23.610 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:47:23.673 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install python3-rgw 2021-11-21T03:47:23.844 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:47:23.890 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:24.345 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 103 kB/s | 2.8 kB 00:00 2021-11-21T03:47:24.450 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 93 kB/s | 2.4 kB 00:00 2021-11-21T03:47:25.164 INFO:teuthology.orchestra.run.gibba043.stdout:Package librados2-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:47:25.329 INFO:teuthology.orchestra.run.gibba022.stdout:Package python3-rgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:47:25.452 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:47:25.452 INFO:teuthology.orchestra.run.gibba043.stdout:Nothing to do. 2021-11-21T03:47:25.452 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:47:25.506 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install librbd1 2021-11-21T03:47:25.610 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:47:25.611 INFO:teuthology.orchestra.run.gibba022.stdout:Nothing to do. 2021-11-21T03:47:25.611 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:47:25.675 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install python3-cephfs 2021-11-21T03:47:25.720 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:25.894 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:26.205 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 89 kB/s | 2.4 kB 00:00 2021-11-21T03:47:26.288 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 103 kB/s | 2.8 kB 00:00 2021-11-21T03:47:26.331 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 103 kB/s | 2.8 kB 00:00 2021-11-21T03:47:26.436 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 91 kB/s | 2.4 kB 00:00 2021-11-21T03:47:27.164 INFO:teuthology.orchestra.run.gibba043.stdout:Package librbd1-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:47:27.330 INFO:teuthology.orchestra.run.gibba022.stdout:Package python3-cephfs-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:47:27.448 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:47:27.449 INFO:teuthology.orchestra.run.gibba043.stdout:Nothing to do. 2021-11-21T03:47:27.450 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:47:27.514 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install python3-rados 2021-11-21T03:47:27.612 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:47:27.612 INFO:teuthology.orchestra.run.gibba022.stdout:Nothing to do. 2021-11-21T03:47:27.613 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:47:27.677 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install python3-rbd 2021-11-21T03:47:27.734 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:27.894 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:28.213 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 85 kB/s | 2.4 kB 00:00 2021-11-21T03:47:28.297 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 101 kB/s | 2.8 kB 00:00 2021-11-21T03:47:28.344 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 95 kB/s | 2.8 kB 00:00 2021-11-21T03:47:28.448 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 91 kB/s | 2.4 kB 00:00 2021-11-21T03:47:29.148 INFO:teuthology.orchestra.run.gibba043.stdout:Package python3-rados-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:47:29.296 INFO:teuthology.orchestra.run.gibba022.stdout:Package python3-rbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:47:29.427 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:47:29.428 INFO:teuthology.orchestra.run.gibba043.stdout:Nothing to do. 2021-11-21T03:47:29.428 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:47:29.579 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:47:29.580 INFO:teuthology.orchestra.run.gibba022.stdout:Nothing to do. 2021-11-21T03:47:29.580 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:47:29.634 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install python3-rgw 2021-11-21T03:47:29.651 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install rbd-fuse 2021-11-21T03:47:29.848 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:29.866 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:30.312 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 75 kB/s | 2.4 kB 00:00 2021-11-21T03:47:30.317 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 108 kB/s | 2.8 kB 00:00 2021-11-21T03:47:30.393 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 kB/s | 2.8 kB 00:00 2021-11-21T03:47:30.563 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 85 kB/s | 2.4 kB 00:00 2021-11-21T03:47:31.256 INFO:teuthology.orchestra.run.gibba043.stdout:Package python3-rgw-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:47:31.539 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:47:31.540 INFO:teuthology.orchestra.run.gibba043.stdout:Nothing to do. 2021-11-21T03:47:31.540 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:47:31.584 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:47:31.585 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:47:31.585 INFO:teuthology.orchestra.run.gibba022.stdout: Package Architecture Version Repository Size 2021-11-21T03:47:31.585 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:47:31.585 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:47:31.585 INFO:teuthology.orchestra.run.gibba022.stdout: rbd-fuse x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 72 k 2021-11-21T03:47:31.586 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:47:31.586 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:47:31.586 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:47:31.586 INFO:teuthology.orchestra.run.gibba022.stdout:Install 1 Package 2021-11-21T03:47:31.587 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:47:31.587 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 72 k 2021-11-21T03:47:31.588 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 184 k 2021-11-21T03:47:31.588 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:47:31.630 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install python3-cephfs 2021-11-21T03:47:31.790 INFO:teuthology.orchestra.run.gibba022.stdout:rbd-fuse-15.2.15-32.gb0aaed0f.el8.x86_64.rpm 345 kB/s | 72 kB 00:00 2021-11-21T03:47:31.791 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:47:31.792 INFO:teuthology.orchestra.run.gibba022.stdout:Total 342 kB/s | 72 kB 00:00 2021-11-21T03:47:31.792 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:47:31.801 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:47:31.801 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:47:31.840 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:47:31.843 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:47:31.847 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:31.929 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:47:32.077 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : rbd-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:32.257 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: rbd-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:32.324 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 87 kB/s | 2.4 kB 00:00 2021-11-21T03:47:32.406 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 105 kB/s | 2.8 kB 00:00 2021-11-21T03:47:32.596 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : rbd-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:32.596 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:47:33.281 INFO:teuthology.orchestra.run.gibba043.stdout:Package python3-cephfs-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:47:33.569 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:47:33.570 INFO:teuthology.orchestra.run.gibba043.stdout:Nothing to do. 2021-11-21T03:47:33.571 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:47:33.639 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install python3-rbd 2021-11-21T03:47:33.859 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:34.322 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 86 kB/s | 2.4 kB 00:00 2021-11-21T03:47:34.405 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 105 kB/s | 2.8 kB 00:00 2021-11-21T03:47:35.289 INFO:teuthology.orchestra.run.gibba043.stdout:Package python3-rbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:47:35.574 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:47:35.576 INFO:teuthology.orchestra.run.gibba043.stdout:Nothing to do. 2021-11-21T03:47:35.576 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:47:35.649 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install rbd-fuse 2021-11-21T03:47:35.899 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:36.529 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 kB/s | 2.4 kB 00:00 2021-11-21T03:47:36.619 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 86 kB/s | 2.8 kB 00:00 2021-11-21T03:47:37.789 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:47:37.789 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:47:37.789 INFO:teuthology.orchestra.run.gibba043.stdout: Package Architecture Version Repository Size 2021-11-21T03:47:37.790 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:47:37.790 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:47:37.790 INFO:teuthology.orchestra.run.gibba043.stdout: rbd-fuse x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 72 k 2021-11-21T03:47:37.790 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:47:37.791 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:47:37.791 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:47:37.791 INFO:teuthology.orchestra.run.gibba043.stdout:Install 1 Package 2021-11-21T03:47:37.791 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:47:37.791 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 72 k 2021-11-21T03:47:37.792 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 184 k 2021-11-21T03:47:37.792 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:47:38.000 INFO:teuthology.orchestra.run.gibba043.stdout:rbd-fuse-15.2.15-32.gb0aaed0f.el8.x86_64.rpm 345 kB/s | 72 kB 00:00 2021-11-21T03:47:38.001 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:47:38.001 INFO:teuthology.orchestra.run.gibba043.stdout:Total 342 kB/s | 72 kB 00:00 2021-11-21T03:47:38.001 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:47:38.012 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:47:38.012 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:47:38.050 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:47:38.053 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:47:38.153 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:47:38.323 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : rbd-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:38.500 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: rbd-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:38.901 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : rbd-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:38.901 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:47:41.590 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:47:04 AM UTC. 2021-11-21T03:47:43.566 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:47:43.566 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:47:43.567 INFO:teuthology.orchestra.run.gibba022.stdout: rbd-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:47:43.567 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:47:43.567 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:47:43.666 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install rbd-mirror 2021-11-21T03:47:43.879 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:44.373 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 kB/s | 2.8 kB 00:00 2021-11-21T03:47:47.358 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2021-11-21T03:47:48.020 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:47:10 AM UTC. 2021-11-21T03:47:50.083 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:47:50.084 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:47:50.084 INFO:teuthology.orchestra.run.gibba043.stdout: rbd-fuse-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:47:50.084 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:47:50.084 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:47:50.165 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install rbd-mirror 2021-11-21T03:47:50.383 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:47:50.598 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:47:50.887 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 89 kB/s | 2.4 kB 00:00 2021-11-21T03:47:52.243 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:47:52.244 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:47:52.244 INFO:teuthology.orchestra.run.gibba022.stdout: Package Arch Version Repo Size 2021-11-21T03:47:52.245 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:47:52.245 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:47:52.245 INFO:teuthology.orchestra.run.gibba022.stdout: rbd-mirror x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 2.7 M 2021-11-21T03:47:52.245 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:47:52.246 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:47:52.246 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:47:52.246 INFO:teuthology.orchestra.run.gibba022.stdout:Install 1 Package 2021-11-21T03:47:52.247 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:47:52.247 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 2.7 M 2021-11-21T03:47:52.247 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 9.8 M 2021-11-21T03:47:52.247 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:47:52.946 INFO:teuthology.orchestra.run.gibba022.stdout:rbd-mirror-15.2.15-32.gb0aaed0f.el8.x86_64.rpm 3.9 MB/s | 2.7 MB 00:00 2021-11-21T03:47:52.947 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:47:52.947 INFO:teuthology.orchestra.run.gibba022.stdout:Total 3.9 MB/s | 2.7 MB 00:00 2021-11-21T03:47:52.947 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:47:52.957 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:47:52.957 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:47:53.003 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:47:53.008 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:47:53.279 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:47:53.448 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : rbd-mirror-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:53.739 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: rbd-mirror-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:53.997 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 104 kB/s | 2.8 kB 00:00 2021-11-21T03:47:54.136 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : rbd-mirror-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:47:54.136 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:47:57.055 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:47:58.699 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:47:58.700 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:47:58.701 INFO:teuthology.orchestra.run.gibba043.stdout: Package Arch Version Repo Size 2021-11-21T03:47:58.701 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:47:58.701 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:47:58.701 INFO:teuthology.orchestra.run.gibba043.stdout: rbd-mirror x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 2.7 M 2021-11-21T03:47:58.702 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:47:58.702 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:47:58.702 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:47:58.702 INFO:teuthology.orchestra.run.gibba043.stdout:Install 1 Package 2021-11-21T03:47:58.703 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:47:58.703 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 2.7 M 2021-11-21T03:47:58.703 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 9.8 M 2021-11-21T03:47:58.703 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:48:00.123 INFO:teuthology.orchestra.run.gibba043.stdout:rbd-mirror-15.2.15-32.gb0aaed0f.el8.x86_64.rpm 1.9 MB/s | 2.7 MB 00:01 2021-11-21T03:48:00.123 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:48:00.124 INFO:teuthology.orchestra.run.gibba043.stdout:Total 1.9 MB/s | 2.7 MB 00:01 2021-11-21T03:48:00.124 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:48:00.134 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:48:00.134 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:48:00.181 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:48:00.184 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:48:00.486 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:48:00.666 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : rbd-mirror-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:48:00.968 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: rbd-mirror-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:48:01.413 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : rbd-mirror-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:48:01.467 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:48:03.122 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:47:37 AM UTC. 2021-11-21T03:48:05.185 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:05.186 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:48:05.186 INFO:teuthology.orchestra.run.gibba022.stdout: rbd-mirror-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:48:05.186 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:05.186 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:48:05.293 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install rbd-nbd 2021-11-21T03:48:05.516 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:48:05.960 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 105 kB/s | 2.8 kB 00:00 2021-11-21T03:48:09.042 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 87 kB/s | 2.4 kB 00:00 2021-11-21T03:48:10.594 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:47:43 AM UTC. 2021-11-21T03:48:12.223 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:48:12.581 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:12.582 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:48:12.582 INFO:teuthology.orchestra.run.gibba043.stdout: rbd-mirror-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:48:12.582 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:12.582 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:48:12.662 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install rbd-nbd 2021-11-21T03:48:12.884 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:48:13.344 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 89 kB/s | 2.4 kB 00:00 2021-11-21T03:48:13.871 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:48:13.872 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:48:13.873 INFO:teuthology.orchestra.run.gibba022.stdout: Package Architecture Version Repository Size 2021-11-21T03:48:13.873 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:48:13.873 INFO:teuthology.orchestra.run.gibba022.stdout:Installing: 2021-11-21T03:48:13.873 INFO:teuthology.orchestra.run.gibba022.stdout: rbd-nbd x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 140 k 2021-11-21T03:48:13.874 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:13.874 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction Summary 2021-11-21T03:48:13.874 INFO:teuthology.orchestra.run.gibba022.stdout:================================================================================ 2021-11-21T03:48:13.874 INFO:teuthology.orchestra.run.gibba022.stdout:Install 1 Package 2021-11-21T03:48:13.874 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:13.875 INFO:teuthology.orchestra.run.gibba022.stdout:Total download size: 140 k 2021-11-21T03:48:13.875 INFO:teuthology.orchestra.run.gibba022.stdout:Installed size: 418 k 2021-11-21T03:48:13.875 INFO:teuthology.orchestra.run.gibba022.stdout:Downloading Packages: 2021-11-21T03:48:14.187 INFO:teuthology.orchestra.run.gibba022.stdout:rbd-nbd-15.2.15-32.gb0aaed0f.el8.x86_64.rpm 446 kB/s | 140 kB 00:00 2021-11-21T03:48:14.188 INFO:teuthology.orchestra.run.gibba022.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:48:14.189 INFO:teuthology.orchestra.run.gibba022.stdout:Total 444 kB/s | 140 kB 00:00 2021-11-21T03:48:14.189 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction check 2021-11-21T03:48:14.198 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction check succeeded. 2021-11-21T03:48:14.198 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction test 2021-11-21T03:48:14.237 INFO:teuthology.orchestra.run.gibba022.stdout:Transaction test succeeded. 2021-11-21T03:48:14.240 INFO:teuthology.orchestra.run.gibba022.stdout:Running transaction 2021-11-21T03:48:14.366 INFO:teuthology.orchestra.run.gibba022.stdout: Preparing : 1/1 2021-11-21T03:48:14.545 INFO:teuthology.orchestra.run.gibba022.stdout: Installing : rbd-nbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:48:14.717 INFO:teuthology.orchestra.run.gibba022.stdout: Running scriptlet: rbd-nbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:48:15.086 INFO:teuthology.orchestra.run.gibba022.stdout: Verifying : rbd-nbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:48:15.087 INFO:teuthology.orchestra.run.gibba022.stdout:Installed products updated. 2021-11-21T03:48:16.503 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 103 kB/s | 2.8 kB 00:00 2021-11-21T03:48:19.449 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:48:21.076 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:48:21.077 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:48:21.077 INFO:teuthology.orchestra.run.gibba043.stdout: Package Architecture Version Repository Size 2021-11-21T03:48:21.078 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:48:21.078 INFO:teuthology.orchestra.run.gibba043.stdout:Installing: 2021-11-21T03:48:21.078 INFO:teuthology.orchestra.run.gibba043.stdout: rbd-nbd x86_64 2:15.2.15-32.gb0aaed0f.el8 ceph 140 k 2021-11-21T03:48:21.078 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:21.079 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction Summary 2021-11-21T03:48:21.079 INFO:teuthology.orchestra.run.gibba043.stdout:================================================================================ 2021-11-21T03:48:21.079 INFO:teuthology.orchestra.run.gibba043.stdout:Install 1 Package 2021-11-21T03:48:21.083 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:21.084 INFO:teuthology.orchestra.run.gibba043.stdout:Total download size: 140 k 2021-11-21T03:48:21.084 INFO:teuthology.orchestra.run.gibba043.stdout:Installed size: 418 k 2021-11-21T03:48:21.084 INFO:teuthology.orchestra.run.gibba043.stdout:Downloading Packages: 2021-11-21T03:48:21.320 INFO:teuthology.orchestra.run.gibba043.stdout:rbd-nbd-15.2.15-32.gb0aaed0f.el8.x86_64.rpm 579 kB/s | 140 kB 00:00 2021-11-21T03:48:21.321 INFO:teuthology.orchestra.run.gibba043.stdout:-------------------------------------------------------------------------------- 2021-11-21T03:48:21.322 INFO:teuthology.orchestra.run.gibba043.stdout:Total 575 kB/s | 140 kB 00:00 2021-11-21T03:48:21.322 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction check 2021-11-21T03:48:21.331 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction check succeeded. 2021-11-21T03:48:21.331 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction test 2021-11-21T03:48:21.371 INFO:teuthology.orchestra.run.gibba043.stdout:Transaction test succeeded. 2021-11-21T03:48:21.374 INFO:teuthology.orchestra.run.gibba043.stdout:Running transaction 2021-11-21T03:48:21.508 INFO:teuthology.orchestra.run.gibba043.stdout: Preparing : 1/1 2021-11-21T03:48:21.706 INFO:teuthology.orchestra.run.gibba043.stdout: Installing : rbd-nbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:48:21.882 INFO:teuthology.orchestra.run.gibba043.stdout: Running scriptlet: rbd-nbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:48:22.270 INFO:teuthology.orchestra.run.gibba043.stdout: Verifying : rbd-nbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 1/1 2021-11-21T03:48:22.271 INFO:teuthology.orchestra.run.gibba043.stdout:Installed products updated. 2021-11-21T03:48:24.078 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:47:58 AM UTC. 2021-11-21T03:48:26.082 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:26.083 INFO:teuthology.orchestra.run.gibba022.stdout:Installed: 2021-11-21T03:48:26.083 INFO:teuthology.orchestra.run.gibba022.stdout: rbd-nbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:48:26.083 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:26.083 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:48:26.165 DEBUG:teuthology.orchestra.run.gibba022:> sudo yum -y install rbd-mirror 2021-11-21T03:48:26.379 INFO:teuthology.orchestra.run.gibba022.stdout:Updating Subscription Management repositories. 2021-11-21T03:48:26.800 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 107 kB/s | 2.8 kB 00:00 2021-11-21T03:48:29.747 INFO:teuthology.orchestra.run.gibba022.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 kB/s | 2.4 kB 00:00 2021-11-21T03:48:31.508 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:04 ago on Sun 21 Nov 2021 03:48:06 AM UTC. 2021-11-21T03:48:32.938 INFO:teuthology.orchestra.run.gibba022.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:48:33.490 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:33.491 INFO:teuthology.orchestra.run.gibba043.stdout:Installed: 2021-11-21T03:48:33.491 INFO:teuthology.orchestra.run.gibba043.stdout: rbd-nbd-2:15.2.15-32.gb0aaed0f.el8.x86_64 2021-11-21T03:48:33.492 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:33.492 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:48:33.570 DEBUG:teuthology.orchestra.run.gibba043:> sudo yum -y install rbd-mirror 2021-11-21T03:48:33.791 INFO:teuthology.orchestra.run.gibba043.stdout:Updating Subscription Management repositories. 2021-11-21T03:48:34.259 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 kB/s | 2.4 kB 00:00 2021-11-21T03:48:34.288 INFO:teuthology.orchestra.run.gibba022.stdout:Package rbd-mirror-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:48:34.575 INFO:teuthology.orchestra.run.gibba022.stdout:Dependencies resolved. 2021-11-21T03:48:34.576 INFO:teuthology.orchestra.run.gibba022.stdout:Nothing to do. 2021-11-21T03:48:34.576 INFO:teuthology.orchestra.run.gibba022.stdout:Complete! 2021-11-21T03:48:34.629 DEBUG:teuthology.parallel:result is None 2021-11-21T03:48:37.424 INFO:teuthology.orchestra.run.gibba043.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 105 kB/s | 2.8 kB 00:00 2021-11-21T03:48:40.432 INFO:teuthology.orchestra.run.gibba043.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Nov 2021 03:41:53 AM UTC. 2021-11-21T03:48:41.765 INFO:teuthology.orchestra.run.gibba043.stdout:Package rbd-mirror-2:15.2.15-32.gb0aaed0f.el8.x86_64 is already installed. 2021-11-21T03:48:42.048 INFO:teuthology.orchestra.run.gibba043.stdout:Dependencies resolved. 2021-11-21T03:48:42.049 INFO:teuthology.orchestra.run.gibba043.stdout:Nothing to do. 2021-11-21T03:48:42.049 INFO:teuthology.orchestra.run.gibba043.stdout:Complete! 2021-11-21T03:48:42.143 DEBUG:teuthology.parallel:result is None 2021-11-21T03:48:42.144 DEBUG:teuthology.orchestra.run.gibba022:> sudo lsb_release -is 2021-11-21T03:48:42.180 INFO:teuthology.orchestra.run.gibba022.stdout:RedHatEnterprise 2021-11-21T03:48:42.180 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-11-21T03:48:42.181 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-21T03:48:42.405 DEBUG:teuthology.orchestra.run.gibba022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-11-21T03:48:42.421 INFO:teuthology.orchestra.run.gibba022.stdout:15.2.15-32.gb0aaed0f.el8 2021-11-21T03:48:42.422 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-32.gb0aaed0f.el8 2021-11-21T03:48:42.423 INFO:teuthology.task.install:The correct ceph version 15.2.15-32.gb0aaed0f is installed. 2021-11-21T03:48:42.423 DEBUG:teuthology.orchestra.run.gibba043:> sudo lsb_release -is 2021-11-21T03:48:42.454 INFO:teuthology.orchestra.run.gibba043.stdout:RedHatEnterprise 2021-11-21T03:48:42.455 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-11-21T03:48:42.455 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-21T03:48:42.690 DEBUG:teuthology.orchestra.run.gibba043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-11-21T03:48:42.707 INFO:teuthology.orchestra.run.gibba043.stdout:15.2.15-32.gb0aaed0f.el8 2021-11-21T03:48:42.707 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-32.gb0aaed0f.el8 2021-11-21T03:48:42.708 INFO:teuthology.task.install:The correct ceph version 15.2.15-32.gb0aaed0f is installed. 2021-11-21T03:48:42.708 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-11-21T03:48:42.709 DEBUG:teuthology.orchestra.run.gibba022:> set -ex 2021-11-21T03:48:42.709 DEBUG:teuthology.orchestra.run.gibba022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-21T03:48:42.729 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-11-21T03:48:42.730 DEBUG:teuthology.orchestra.run.gibba043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-21T03:48:42.766 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-11-21T03:48:42.767 DEBUG:teuthology.orchestra.run.gibba022:> set -ex 2021-11-21T03:48:42.767 DEBUG:teuthology.orchestra.run.gibba022:> sudo dd of=/usr/bin/daemon-helper 2021-11-21T03:48:42.789 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-21T03:48:42.849 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-11-21T03:48:42.849 DEBUG:teuthology.orchestra.run.gibba043:> sudo dd of=/usr/bin/daemon-helper 2021-11-21T03:48:42.869 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-21T03:48:42.930 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-11-21T03:48:42.931 DEBUG:teuthology.orchestra.run.gibba022:> set -ex 2021-11-21T03:48:42.932 DEBUG:teuthology.orchestra.run.gibba022:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-21T03:48:42.952 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-21T03:48:43.011 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-11-21T03:48:43.012 DEBUG:teuthology.orchestra.run.gibba043:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-21T03:48:43.032 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-21T03:48:43.090 INFO:teuthology.run_tasks:Running task ceph... 2021-11-21T03:48:43.174 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-11-21T03:48:43.175 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod 777 /var/log/ceph 2021-11-21T03:48:43.179 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod 777 /var/log/ceph 2021-11-21T03:48:43.198 INFO:tasks.ceph:Disabling ceph logrotate... 2021-11-21T03:48:43.199 DEBUG:teuthology.orchestra.run.gibba022:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-21T03:48:43.238 DEBUG:teuthology.orchestra.run.gibba043:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-21T03:48:43.258 INFO:tasks.ceph:Creating extra log directories... 2021-11-21T03:48:43.258 DEBUG:teuthology.orchestra.run.gibba022:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-21T03:48:43.299 DEBUG:teuthology.orchestra.run.gibba043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-21T03:48:43.318 INFO:tasks.ceph:Creating ceph cluster cluster1... 2021-11-21T03:48:43.319 INFO:tasks.ceph:config {'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'cluster1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-11-21T03:48:43.319 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2021-11-18_06:00:03-rbd-octopus-distro-default-gibba/6511531', 'branch': 'octopus', 'description': 'rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6511531', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'gibba', 'meta': [{'desc': 'run two ceph clusters and install rbd-mirror'}, {'desc': 'configure the permissions for client.mirror'}, {'desc': '2 ceph clusters with 1 mon and 3 osds each'}, {'desc': 'run four rbd-mirror daemons per cluster'}, {'desc': 'run the rbd_mirror_stress.sh workunit to test the rbd-mirror daemon'}], 'name': 'teuthology-2021-11-18_06:00:03-rbd-octopus-distro-default-gibba', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'rhel', 'os_version': '8.3', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'octopus', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 1000, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'], ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6']], 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff', 'sleep_before_teardown': 0, 'suite': 'rbd', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff', 'targets': {'gibba022.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLxAEXjLpD4E/WZb3tl42Si4cfiZB0BFCFCmCGVeIAF9GDbeP8FPjEtUrzn4M+di0rRmJS82YtXSKHs52CYQFwNV5w+uWHMABbKMbUxNtXGYyBD9jdHijuz+z3An32XaLcWJZCbDaeaZLRjYBQkC/MqoL3vkwSNXxgOMNwYqai3gY6N5YlU+wof4cCRgDkOs+klbWKiJEedG8uTnOm9BbMDANtdtGfjVNvJt9fip+D5G7twr+wJhChpv9nshnIbRPh1eRGbgxIbQlVxrQQ2CedzX9PL8NFK59QHFHyhYqdOD859asCIGNgDWcIEXaC9euxMaEtQ2cl1Keh98k6Q1KlR4a7V6uCLiOid43XBex6GPl1BOuQ80Id3cDY3pr++lj4+FLZx03zU2kPmLWv7oAABAh1Q34iTMBd1eh2YxO5v/P/2t6uLivVzECiJ4MAMEK4d7hnbhLqpYRSd1LOCWKj4w2weOVFSU05XvB8kAW4W0BK8A+KHOt2y0iBEAuY70M=', 'gibba043.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZDWVZORVVcSG+wo1CCePocvjDxjTuvXsEfdDaPZ5saRH05achLVWhJHlKGIFhcg00SY9mg76RVwGOVNTbXBnaJe1WwsYFodmHpHksR+Ol0bVQyAcKP7XwmO17mwJnJ7PSp4yK16Wbh8T63Rtr+1ebkUbp++VYTKj5jmb6WNF9ieIthDFA8aSdL/w/VLZK96rKMnuHI/Pah3dIDHv1cbctxTzNvYOpbpAXpq8Fa+TozEuKlcUAIjnuuXZyvwiEL8LlSdU8uKJFzrDrN7uuMgyoGHqXiPIabRP8JPy+w9Az+M7gq2AAmAUlLoTV7ewVRTO5bH+6HrqNpsdnm5Ng3egM1TqDVf4YskxwncriLWu3ACqrGZQIcXbBV2ZmCIU1Wqtl47dTvYKGKt5AuLy7Hf18BH2qb2YDFyfIYmWJu/xUAoYlvMh4xM0LRDT7BNzHy8VM3rixQypwpxXzxT8IQWJ5BB2ZuMpBT+2aoMksfo2mNB24KUyJh47AY77wdCv1Y9M='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': ['rbd-mirror'], 'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, {'ceph': {'cluster': 'cluster1', 'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, {'ceph': {'cluster': 'cluster2'}}, {'exec': {'cluster1.client.mirror.0': ["sudo ceph --cluster cluster1 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'"]}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.0', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.1', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.2', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.3', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.0', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.1', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.2', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.3', 'thrash': True}}, {'rbd-mirror-thrash': {'cluster': 'cluster1'}}, {'rbd-mirror-thrash': {'cluster': 'cluster2'}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/rbd_mirror_stress.sh']}, 'env': {'CEPH_ARGS': '', 'MIRROR_IMAGE_MODE': 'snapshot', 'MIRROR_POOL_MODE': 'image', 'RBD_IMAGE_FEATURES': 'layering,exclusive-lock,object-map,fast-diff', 'RBD_MIRROR_INSTANCES': '4', 'RBD_MIRROR_USE_EXISTING_CLUSTER': '1', 'RBD_MIRROR_USE_RBD_MIRROR': '1'}, 'timeout': '6h'}}], 'teuthology_branch': 'master', 'teuthology_sha1': '6cfddd5e1c7d5ede1367cf3087c21af44eb88356', 'timestamp': '2021-11-18_06:00:03', 'tube': 'gibba', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.gibba.19943'} 2021-11-21T03:48:43.320 DEBUG:teuthology.orchestra.run.gibba022:> install -d -m0755 -- /home/ubuntu/cephtest/cluster1.data 2021-11-21T03:48:43.359 DEBUG:teuthology.orchestra.run.gibba043:> install -d -m0755 -- /home/ubuntu/cephtest/cluster1.data 2021-11-21T03:48:43.372 DEBUG:teuthology.orchestra.run.gibba022:> sudo install -d -m0777 -- /var/run/ceph 2021-11-21T03:48:43.411 DEBUG:teuthology.orchestra.run.gibba043:> sudo install -d -m0777 -- /var/run/ceph 2021-11-21T03:48:43.431 DEBUG:teuthology.orchestra.run.gibba022:> set -ex 2021-11-21T03:48:43.431 DEBUG:teuthology.orchestra.run.gibba022:> dd if=/scratch_devs of=/dev/stdout 2021-11-21T03:48:43.481 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-11-21T03:48:43.482 DEBUG:teuthology.orchestra.run.gibba022:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-11-21T03:48:43.533 INFO:teuthology.orchestra.run.gibba022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-11-21T03:48:43.534 INFO:teuthology.orchestra.run.gibba022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-21T03:48:43.534 INFO:teuthology.orchestra.run.gibba022.stdout:Device: 6h/6d Inode: 107061 Links: 1 2021-11-21T03:48:43.534 INFO:teuthology.orchestra.run.gibba022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-21T03:48:43.535 INFO:teuthology.orchestra.run.gibba022.stdout:Context: system_u:object_r:device_t:s0 2021-11-21T03:48:43.535 INFO:teuthology.orchestra.run.gibba022.stdout:Access: 2021-11-21 03:47:53.609342609 +0000 2021-11-21T03:48:43.535 INFO:teuthology.orchestra.run.gibba022.stdout:Modify: 2021-11-21 03:41:23.472295966 +0000 2021-11-21T03:48:43.535 INFO:teuthology.orchestra.run.gibba022.stdout:Change: 2021-11-21 03:41:23.472295966 +0000 2021-11-21T03:48:43.536 INFO:teuthology.orchestra.run.gibba022.stdout: Birth: - 2021-11-21T03:48:43.541 INFO:teuthology.orchestra.run.gibba022.stderr:1+0 records in 2021-11-21T03:48:43.542 INFO:teuthology.orchestra.run.gibba022.stderr:1+0 records out 2021-11-21T03:48:43.542 INFO:teuthology.orchestra.run.gibba022.stderr:512 bytes copied, 0.000199593 s, 2.6 MB/s 2021-11-21T03:48:43.544 DEBUG:teuthology.orchestra.run.gibba022:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-11-21T03:48:43.596 INFO:teuthology.orchestra.run.gibba022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-11-21T03:48:43.596 INFO:teuthology.orchestra.run.gibba022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-21T03:48:43.596 INFO:teuthology.orchestra.run.gibba022.stdout:Device: 6h/6d Inode: 109282 Links: 1 2021-11-21T03:48:43.597 INFO:teuthology.orchestra.run.gibba022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-21T03:48:43.597 INFO:teuthology.orchestra.run.gibba022.stdout:Context: system_u:object_r:device_t:s0 2021-11-21T03:48:43.597 INFO:teuthology.orchestra.run.gibba022.stdout:Access: 2021-11-21 03:47:53.609342609 +0000 2021-11-21T03:48:43.598 INFO:teuthology.orchestra.run.gibba022.stdout:Modify: 2021-11-21 03:41:23.781294347 +0000 2021-11-21T03:48:43.598 INFO:teuthology.orchestra.run.gibba022.stdout:Change: 2021-11-21 03:41:23.781294347 +0000 2021-11-21T03:48:43.598 INFO:teuthology.orchestra.run.gibba022.stdout: Birth: - 2021-11-21T03:48:43.603 INFO:teuthology.orchestra.run.gibba022.stderr:1+0 records in 2021-11-21T03:48:43.603 INFO:teuthology.orchestra.run.gibba022.stderr:1+0 records out 2021-11-21T03:48:43.603 INFO:teuthology.orchestra.run.gibba022.stderr:512 bytes copied, 0.000201374 s, 2.5 MB/s 2021-11-21T03:48:43.606 DEBUG:teuthology.orchestra.run.gibba022:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-11-21T03:48:43.657 INFO:teuthology.orchestra.run.gibba022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-11-21T03:48:43.658 INFO:teuthology.orchestra.run.gibba022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-21T03:48:43.658 INFO:teuthology.orchestra.run.gibba022.stdout:Device: 6h/6d Inode: 104328 Links: 1 2021-11-21T03:48:43.658 INFO:teuthology.orchestra.run.gibba022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-21T03:48:43.659 INFO:teuthology.orchestra.run.gibba022.stdout:Context: system_u:object_r:device_t:s0 2021-11-21T03:48:43.659 INFO:teuthology.orchestra.run.gibba022.stdout:Access: 2021-11-21 03:47:53.610342605 +0000 2021-11-21T03:48:43.659 INFO:teuthology.orchestra.run.gibba022.stdout:Modify: 2021-11-21 03:41:24.099292682 +0000 2021-11-21T03:48:43.659 INFO:teuthology.orchestra.run.gibba022.stdout:Change: 2021-11-21 03:41:24.099292682 +0000 2021-11-21T03:48:43.660 INFO:teuthology.orchestra.run.gibba022.stdout: Birth: - 2021-11-21T03:48:43.665 INFO:teuthology.orchestra.run.gibba022.stderr:1+0 records in 2021-11-21T03:48:43.665 INFO:teuthology.orchestra.run.gibba022.stderr:1+0 records out 2021-11-21T03:48:43.665 INFO:teuthology.orchestra.run.gibba022.stderr:512 bytes copied, 0.000123382 s, 4.1 MB/s 2021-11-21T03:48:43.667 DEBUG:teuthology.orchestra.run.gibba022:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-11-21T03:48:43.717 INFO:teuthology.orchestra.run.gibba022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-11-21T03:48:43.718 INFO:teuthology.orchestra.run.gibba022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-21T03:48:43.718 INFO:teuthology.orchestra.run.gibba022.stdout:Device: 6h/6d Inode: 116064 Links: 1 2021-11-21T03:48:43.718 INFO:teuthology.orchestra.run.gibba022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-21T03:48:43.718 INFO:teuthology.orchestra.run.gibba022.stdout:Context: system_u:object_r:device_t:s0 2021-11-21T03:48:43.719 INFO:teuthology.orchestra.run.gibba022.stdout:Access: 2021-11-21 03:47:53.610342605 +0000 2021-11-21T03:48:43.719 INFO:teuthology.orchestra.run.gibba022.stdout:Modify: 2021-11-21 03:41:24.442290885 +0000 2021-11-21T03:48:43.719 INFO:teuthology.orchestra.run.gibba022.stdout:Change: 2021-11-21 03:41:24.442290885 +0000 2021-11-21T03:48:43.719 INFO:teuthology.orchestra.run.gibba022.stdout: Birth: - 2021-11-21T03:48:43.729 INFO:teuthology.orchestra.run.gibba022.stderr:1+0 records in 2021-11-21T03:48:43.729 INFO:teuthology.orchestra.run.gibba022.stderr:1+0 records out 2021-11-21T03:48:43.729 INFO:teuthology.orchestra.run.gibba022.stderr:512 bytes copied, 0.0001779 s, 2.9 MB/s 2021-11-21T03:48:43.730 INFO:tasks.ceph:osd dev map: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-21T03:48:43.730 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@gibba022.front.sepia.ceph.com'): {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-11-21T03:48:43.730 INFO:tasks.ceph:Generating config... 2021-11-21T03:48:43.732 INFO:tasks.ceph:[client] debug rbd = 20 2021-11-21T03:48:43.732 INFO:tasks.ceph:[client] debug rbd_mirror = 15 2021-11-21T03:48:43.732 INFO:tasks.ceph:[client] log to stderr = False 2021-11-21T03:48:43.733 INFO:tasks.ceph:[client] rbd default features = 125 2021-11-21T03:48:43.733 INFO:tasks.ceph:[client] rbd mirror image policy type = simple 2021-11-21T03:48:43.733 INFO:tasks.ceph:[client.mirror.0] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:48:43.734 INFO:tasks.ceph:[client.mirror.0] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:48:43.734 INFO:tasks.ceph:[client.mirror.1] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:48:43.734 INFO:tasks.ceph:[client.mirror.1] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:48:43.735 INFO:tasks.ceph:[client.mirror.2] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:48:43.735 INFO:tasks.ceph:[client.mirror.2] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:48:43.735 INFO:tasks.ceph:[client.mirror.3] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:48:43.735 INFO:tasks.ceph:[client.mirror.3] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:48:43.736 INFO:tasks.ceph:[global] mon client directed command retry = 5 2021-11-21T03:48:43.736 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2021-11-21T03:48:43.736 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-11-21T03:48:43.737 INFO:tasks.ceph:[mgr] debug ms = 1 2021-11-21T03:48:43.737 INFO:tasks.ceph:[mon] debug mon = 20 2021-11-21T03:48:43.737 INFO:tasks.ceph:[mon] debug ms = 1 2021-11-21T03:48:43.738 INFO:tasks.ceph:[mon] debug paxos = 20 2021-11-21T03:48:43.738 INFO:tasks.ceph:[osd] bdev async discard = True 2021-11-21T03:48:43.738 INFO:tasks.ceph:[osd] bdev enable discard = True 2021-11-21T03:48:43.739 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2021-11-21T03:48:43.739 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-11-21T03:48:43.739 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-11-21T03:48:43.740 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-11-21T03:48:43.740 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-11-21T03:48:43.740 INFO:tasks.ceph:[osd] debug ms = 1 2021-11-21T03:48:43.741 INFO:tasks.ceph:[osd] debug osd = 20 2021-11-21T03:48:43.741 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-11-21T03:48:43.741 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-11-21T03:48:43.742 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-11-21T03:48:43.742 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-11-21T03:48:43.743 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-11-21T03:48:43.743 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-11-21T03:48:43.743 INFO:tasks.ceph:Setting up cluster1.mon.a... 2021-11-21T03:48:43.744 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/cluster1.keyring 2021-11-21T03:48:43.805 INFO:teuthology.orchestra.run.gibba022.stdout:creating /etc/ceph/cluster1.keyring 2021-11-21T03:48:43.806 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/cluster1.keyring 2021-11-21T03:48:43.875 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod 0644 /etc/ceph/cluster1.keyring 2021-11-21T03:48:43.935 DEBUG:tasks.ceph:Ceph mon addresses: [('cluster1.mon.a', '172.21.2.122')] 2021-11-21T03:48:43.936 DEBUG:teuthology.orchestra.run.gibba022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.2.122 --print /home/ubuntu/cephtest/cluster1.monmap 2021-11-21T03:48:43.999 INFO:teuthology.orchestra.run.gibba022.stdout:monmaptool: monmap file /home/ubuntu/cephtest/cluster1.monmap 2021-11-21T03:48:43.999 INFO:teuthology.orchestra.run.gibba022.stdout:monmaptool: generated fsid 84f78865-ca38-49d0-bbfb-e8f9679d6c9c 2021-11-21T03:48:43.999 INFO:teuthology.orchestra.run.gibba022.stdout:epoch 0 2021-11-21T03:48:43.999 INFO:teuthology.orchestra.run.gibba022.stdout:fsid 84f78865-ca38-49d0-bbfb-e8f9679d6c9c 2021-11-21T03:48:44.000 INFO:teuthology.orchestra.run.gibba022.stdout:last_changed 2021-11-21T03:48:44.001968+0000 2021-11-21T03:48:44.000 INFO:teuthology.orchestra.run.gibba022.stdout:created 2021-11-21T03:48:44.001968+0000 2021-11-21T03:48:44.000 INFO:teuthology.orchestra.run.gibba022.stdout:min_mon_release 0 (unknown) 2021-11-21T03:48:44.000 INFO:teuthology.orchestra.run.gibba022.stdout:0: [v2:172.21.2.122:3300/0,v1:172.21.2.122:6789/0] mon.a 2021-11-21T03:48:44.000 INFO:teuthology.orchestra.run.gibba022.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/cluster1.monmap (1 monitors) 2021-11-21T03:48:44.003 INFO:tasks.ceph:Writing /etc/ceph/cluster1.conf for FSID 84f78865-ca38-49d0-bbfb-e8f9679d6c9c... 2021-11-21T03:48:44.004 DEBUG:teuthology.orchestra.run.gibba022:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster1.conf && sudo chmod 0644 /etc/ceph/cluster1.conf > /dev/null 2021-11-21T03:48:44.045 DEBUG:teuthology.orchestra.run.gibba043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster1.conf && sudo chmod 0644 /etc/ceph/cluster1.conf > /dev/null 2021-11-21T03:48:44.075 INFO:teuthology.orchestra.run.gibba022.stdout:[global] 2021-11-21T03:48:44.075 INFO:teuthology.orchestra.run.gibba022.stdout: chdir = "" 2021-11-21T03:48:44.076 INFO:teuthology.orchestra.run.gibba022.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-21T03:48:44.076 INFO:teuthology.orchestra.run.gibba022.stdout: auth supported = cephx 2021-11-21T03:48:44.076 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.077 INFO:teuthology.orchestra.run.gibba022.stdout: filestore xattr use omap = true 2021-11-21T03:48:44.077 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.077 INFO:teuthology.orchestra.run.gibba022.stdout: mon clock drift allowed = 1.000 2021-11-21T03:48:44.077 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.078 INFO:teuthology.orchestra.run.gibba022.stdout: osd crush chooseleaf type = 0 2021-11-21T03:48:44.078 INFO:teuthology.orchestra.run.gibba022.stdout: auth debug = true 2021-11-21T03:48:44.078 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.078 INFO:teuthology.orchestra.run.gibba022.stdout: ms die on old message = true 2021-11-21T03:48:44.079 INFO:teuthology.orchestra.run.gibba022.stdout: ms die on bug = true 2021-11-21T03:48:44.079 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.079 INFO:teuthology.orchestra.run.gibba022.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-21T03:48:44.079 INFO:teuthology.orchestra.run.gibba022.stdout: mon pg warn max object skew = 0 2021-11-21T03:48:44.081 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.081 INFO:teuthology.orchestra.run.gibba022.stdout: # disable pg_autoscaler by default for new pools 2021-11-21T03:48:44.081 INFO:teuthology.orchestra.run.gibba022.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-21T03:48:44.082 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.082 INFO:teuthology.orchestra.run.gibba022.stdout: osd pool default size = 2 2021-11-21T03:48:44.083 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.083 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd allow primary affinity = true 2021-11-21T03:48:44.083 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd allow pg remap = true 2021-11-21T03:48:44.084 INFO:teuthology.orchestra.run.gibba022.stdout: mon warn on legacy crush tunables = false 2021-11-21T03:48:44.084 INFO:teuthology.orchestra.run.gibba022.stdout: mon warn on crush straw calc version zero = false 2021-11-21T03:48:44.084 INFO:teuthology.orchestra.run.gibba022.stdout: mon warn on no sortbitwise = false 2021-11-21T03:48:44.085 INFO:teuthology.orchestra.run.gibba022.stdout: mon warn on osd down out interval zero = false 2021-11-21T03:48:44.085 INFO:teuthology.orchestra.run.gibba022.stdout: mon warn on too few osds = false 2021-11-21T03:48:44.086 INFO:teuthology.orchestra.run.gibba022.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-21T03:48:44.086 INFO:teuthology.orchestra.run.gibba022.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-21T03:48:44.086 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.086 INFO:teuthology.orchestra.run.gibba022.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-21T03:48:44.087 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.087 INFO:teuthology.orchestra.run.gibba022.stdout: osd default data pool replay window = 5 2021-11-21T03:48:44.087 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.087 INFO:teuthology.orchestra.run.gibba022.stdout: mon allow pool delete = true 2021-11-21T03:48:44.088 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.088 INFO:teuthology.orchestra.run.gibba022.stdout: mon cluster log file level = debug 2021-11-21T03:48:44.088 INFO:teuthology.orchestra.run.gibba022.stdout: debug asserts on shutdown = true 2021-11-21T03:48:44.088 INFO:teuthology.orchestra.run.gibba022.stdout: mon health detail to clog = false 2021-11-21T03:48:44.089 INFO:teuthology.orchestra.run.gibba022.stdout: mon host = 172.21.2.122 2021-11-21T03:48:44.089 INFO:teuthology.orchestra.run.gibba022.stdout: mon client directed command retry = 5 2021-11-21T03:48:44.089 INFO:teuthology.orchestra.run.gibba022.stdout: ms inject socket failures = 5000 2021-11-21T03:48:44.091 INFO:teuthology.orchestra.run.gibba022.stdout: fsid = 84f78865-ca38-49d0-bbfb-e8f9679d6c9c 2021-11-21T03:48:44.091 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.091 INFO:teuthology.orchestra.run.gibba022.stdout:[osd] 2021-11-21T03:48:44.092 INFO:teuthology.orchestra.run.gibba022.stdout: osd journal size = 100 2021-11-21T03:48:44.092 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.093 INFO:teuthology.orchestra.run.gibba022.stdout: osd scrub load threshold = 5.0 2021-11-21T03:48:44.093 INFO:teuthology.orchestra.run.gibba022.stdout: osd scrub max interval = 600 2021-11-21T03:48:44.093 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.093 INFO:teuthology.orchestra.run.gibba022.stdout: osd recover clone overlap = true 2021-11-21T03:48:44.094 INFO:teuthology.orchestra.run.gibba022.stdout: osd recovery max chunk = 1048576 2021-11-21T03:48:44.094 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.094 INFO:teuthology.orchestra.run.gibba022.stdout: osd debug shutdown = true 2021-11-21T03:48:44.094 INFO:teuthology.orchestra.run.gibba022.stdout: osd debug op order = true 2021-11-21T03:48:44.095 INFO:teuthology.orchestra.run.gibba022.stdout: osd debug verify stray on activate = true 2021-11-21T03:48:44.096 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.096 INFO:teuthology.orchestra.run.gibba022.stdout: osd open classes on start = true 2021-11-21T03:48:44.096 INFO:teuthology.orchestra.run.gibba022.stdout: osd debug pg log writeout = true 2021-11-21T03:48:44.097 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.097 INFO:teuthology.orchestra.run.gibba022.stdout: osd deep scrub update digest min age = 30 2021-11-21T03:48:44.097 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.097 INFO:teuthology.orchestra.run.gibba022.stdout: osd map max advance = 10 2021-11-21T03:48:44.097 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.098 INFO:teuthology.orchestra.run.gibba022.stdout: journal zero on create = true 2021-11-21T03:48:44.098 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.098 INFO:teuthology.orchestra.run.gibba022.stdout: filestore ondisk finisher threads = 3 2021-11-21T03:48:44.098 INFO:teuthology.orchestra.run.gibba022.stdout: filestore apply finisher threads = 3 2021-11-21T03:48:44.099 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.099 INFO:teuthology.orchestra.run.gibba022.stdout: bdev debug aio = true 2021-11-21T03:48:44.099 INFO:teuthology.orchestra.run.gibba022.stdout: osd debug misdirected ops = true 2021-11-21T03:48:44.099 INFO:teuthology.orchestra.run.gibba022.stdout: bdev async discard = True 2021-11-21T03:48:44.099 INFO:teuthology.orchestra.run.gibba022.stdout: bdev enable discard = True 2021-11-21T03:48:44.100 INFO:teuthology.orchestra.run.gibba022.stdout: bluestore allocator = stupid 2021-11-21T03:48:44.100 INFO:teuthology.orchestra.run.gibba022.stdout: bluestore block size = 96636764160 2021-11-21T03:48:44.100 INFO:teuthology.orchestra.run.gibba022.stdout: bluestore fsck on mount = True 2021-11-21T03:48:44.100 INFO:teuthology.orchestra.run.gibba022.stdout: debug bluefs = 20 2021-11-21T03:48:44.101 INFO:teuthology.orchestra.run.gibba022.stdout: debug bluestore = 20 2021-11-21T03:48:44.101 INFO:teuthology.orchestra.run.gibba022.stdout: debug ms = 1 2021-11-21T03:48:44.101 INFO:teuthology.orchestra.run.gibba022.stdout: debug osd = 20 2021-11-21T03:48:44.101 INFO:teuthology.orchestra.run.gibba022.stdout: debug rocksdb = 10 2021-11-21T03:48:44.101 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd backfillfull_ratio = 0.85 2021-11-21T03:48:44.102 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd full ratio = 0.9 2021-11-21T03:48:44.102 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd nearfull ratio = 0.8 2021-11-21T03:48:44.102 INFO:teuthology.orchestra.run.gibba022.stdout: osd failsafe full ratio = 0.95 2021-11-21T03:48:44.102 INFO:teuthology.orchestra.run.gibba022.stdout: osd objectstore = bluestore 2021-11-21T03:48:44.102 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.103 INFO:teuthology.orchestra.run.gibba022.stdout:[mgr] 2021-11-21T03:48:44.103 INFO:teuthology.orchestra.run.gibba022.stdout: debug ms = 1 2021-11-21T03:48:44.103 INFO:teuthology.orchestra.run.gibba022.stdout: debug mgr = 20 2021-11-21T03:48:44.103 INFO:teuthology.orchestra.run.gibba022.stdout: debug mon = 20 2021-11-21T03:48:44.104 INFO:teuthology.orchestra.run.gibba022.stdout: debug auth = 20 2021-11-21T03:48:44.104 INFO:teuthology.orchestra.run.gibba022.stdout: mon reweight min pgs per osd = 4 2021-11-21T03:48:44.104 INFO:teuthology.orchestra.run.gibba022.stdout: mon reweight min bytes per osd = 10 2021-11-21T03:48:44.104 INFO:teuthology.orchestra.run.gibba022.stdout: mgr/telemetry/nag = false 2021-11-21T03:48:44.104 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.105 INFO:teuthology.orchestra.run.gibba022.stdout:[mon] 2021-11-21T03:48:44.105 INFO:teuthology.orchestra.run.gibba022.stdout: debug ms = 1 2021-11-21T03:48:44.105 INFO:teuthology.orchestra.run.gibba022.stdout: debug mon = 20 2021-11-21T03:48:44.105 INFO:teuthology.orchestra.run.gibba022.stdout: debug paxos = 20 2021-11-21T03:48:44.106 INFO:teuthology.orchestra.run.gibba022.stdout: debug auth = 20 2021-11-21T03:48:44.106 INFO:teuthology.orchestra.run.gibba022.stdout: mon data avail warn = 5 2021-11-21T03:48:44.107 INFO:teuthology.orchestra.run.gibba022.stdout: mon mgr mkfs grace = 240 2021-11-21T03:48:44.107 INFO:teuthology.orchestra.run.gibba022.stdout: mon reweight min pgs per osd = 4 2021-11-21T03:48:44.107 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd reporter subtree level = osd 2021-11-21T03:48:44.107 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd prime pg temp = true 2021-11-21T03:48:44.107 INFO:teuthology.orchestra.run.gibba022.stdout: mon reweight min bytes per osd = 10 2021-11-21T03:48:44.108 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.108 INFO:teuthology.orchestra.run.gibba022.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-21T03:48:44.108 INFO:teuthology.orchestra.run.gibba022.stdout: auth mon ticket ttl = 660 # 11m 2021-11-21T03:48:44.108 INFO:teuthology.orchestra.run.gibba022.stdout: auth service ticket ttl = 240 # 4m 2021-11-21T03:48:44.109 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.109 INFO:teuthology.orchestra.run.gibba022.stdout: # don't complain about insecure global_id in the test suite 2021-11-21T03:48:44.109 INFO:teuthology.orchestra.run.gibba022.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-21T03:48:44.109 INFO:teuthology.orchestra.run.gibba022.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-21T03:48:44.109 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:48:44.110 INFO:teuthology.orchestra.run.gibba022.stdout:[client] 2021-11-21T03:48:44.110 INFO:teuthology.orchestra.run.gibba022.stdout: rgw cache enabled = true 2021-11-21T03:48:44.110 INFO:teuthology.orchestra.run.gibba022.stdout: rgw enable ops log = true 2021-11-21T03:48:44.110 INFO:teuthology.orchestra.run.gibba022.stdout: rgw enable usage log = true 2021-11-21T03:48:44.111 INFO:teuthology.orchestra.run.gibba022.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-21T03:48:44.111 INFO:teuthology.orchestra.run.gibba022.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-21T03:48:44.111 INFO:teuthology.orchestra.run.gibba022.stdout: debug rbd = 20 2021-11-21T03:48:44.111 INFO:teuthology.orchestra.run.gibba022.stdout: debug rbd_mirror = 15 2021-11-21T03:48:44.112 INFO:teuthology.orchestra.run.gibba022.stdout: log to stderr = False 2021-11-21T03:48:44.112 INFO:teuthology.orchestra.run.gibba022.stdout: rbd default features = 125 2021-11-21T03:48:44.112 INFO:teuthology.orchestra.run.gibba022.stdout: rbd mirror image policy type = simple 2021-11-21T03:48:44.112 INFO:teuthology.orchestra.run.gibba022.stdout:[mon.a] 2021-11-21T03:48:44.112 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.0] 2021-11-21T03:48:44.113 INFO:teuthology.orchestra.run.gibba022.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:48:44.113 INFO:teuthology.orchestra.run.gibba022.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:48:44.113 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.1] 2021-11-21T03:48:44.113 INFO:teuthology.orchestra.run.gibba022.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:48:44.113 INFO:teuthology.orchestra.run.gibba022.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:48:44.114 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.2] 2021-11-21T03:48:44.114 INFO:teuthology.orchestra.run.gibba022.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:48:44.114 INFO:teuthology.orchestra.run.gibba022.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:48:44.114 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.3] 2021-11-21T03:48:44.115 INFO:teuthology.orchestra.run.gibba022.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:48:44.115 INFO:teuthology.orchestra.run.gibba022.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:48:44.117 INFO:teuthology.orchestra.run.gibba043.stdout:[global] 2021-11-21T03:48:44.117 INFO:teuthology.orchestra.run.gibba043.stdout: chdir = "" 2021-11-21T03:48:44.118 INFO:teuthology.orchestra.run.gibba043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-21T03:48:44.118 INFO:teuthology.orchestra.run.gibba043.stdout: auth supported = cephx 2021-11-21T03:48:44.118 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.118 INFO:teuthology.orchestra.run.gibba043.stdout: filestore xattr use omap = true 2021-11-21T03:48:44.119 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.119 INFO:teuthology.orchestra.run.gibba043.stdout: mon clock drift allowed = 1.000 2021-11-21T03:48:44.119 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.119 INFO:teuthology.orchestra.run.gibba043.stdout: osd crush chooseleaf type = 0 2021-11-21T03:48:44.119 INFO:teuthology.orchestra.run.gibba043.stdout: auth debug = true 2021-11-21T03:48:44.120 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.120 INFO:teuthology.orchestra.run.gibba043.stdout: ms die on old message = true 2021-11-21T03:48:44.120 INFO:teuthology.orchestra.run.gibba043.stdout: ms die on bug = true 2021-11-21T03:48:44.120 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.121 INFO:teuthology.orchestra.run.gibba043.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-21T03:48:44.121 INFO:teuthology.orchestra.run.gibba043.stdout: mon pg warn max object skew = 0 2021-11-21T03:48:44.121 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.121 INFO:teuthology.orchestra.run.gibba043.stdout: # disable pg_autoscaler by default for new pools 2021-11-21T03:48:44.121 INFO:teuthology.orchestra.run.gibba043.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-21T03:48:44.122 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.122 INFO:teuthology.orchestra.run.gibba043.stdout: osd pool default size = 2 2021-11-21T03:48:44.122 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.122 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd allow primary affinity = true 2021-11-21T03:48:44.122 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd allow pg remap = true 2021-11-21T03:48:44.123 INFO:teuthology.orchestra.run.gibba043.stdout: mon warn on legacy crush tunables = false 2021-11-21T03:48:44.123 INFO:teuthology.orchestra.run.gibba043.stdout: mon warn on crush straw calc version zero = false 2021-11-21T03:48:44.123 INFO:teuthology.orchestra.run.gibba043.stdout: mon warn on no sortbitwise = false 2021-11-21T03:48:44.123 INFO:teuthology.orchestra.run.gibba043.stdout: mon warn on osd down out interval zero = false 2021-11-21T03:48:44.124 INFO:teuthology.orchestra.run.gibba043.stdout: mon warn on too few osds = false 2021-11-21T03:48:44.124 INFO:teuthology.orchestra.run.gibba043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-21T03:48:44.124 INFO:teuthology.orchestra.run.gibba043.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-21T03:48:44.124 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.124 INFO:teuthology.orchestra.run.gibba043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-21T03:48:44.125 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.125 INFO:teuthology.orchestra.run.gibba043.stdout: osd default data pool replay window = 5 2021-11-21T03:48:44.125 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.125 INFO:teuthology.orchestra.run.gibba043.stdout: mon allow pool delete = true 2021-11-21T03:48:44.125 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.126 INFO:teuthology.orchestra.run.gibba043.stdout: mon cluster log file level = debug 2021-11-21T03:48:44.126 INFO:teuthology.orchestra.run.gibba043.stdout: debug asserts on shutdown = true 2021-11-21T03:48:44.126 INFO:teuthology.orchestra.run.gibba043.stdout: mon health detail to clog = false 2021-11-21T03:48:44.126 INFO:teuthology.orchestra.run.gibba043.stdout: mon host = 172.21.2.122 2021-11-21T03:48:44.126 INFO:teuthology.orchestra.run.gibba043.stdout: mon client directed command retry = 5 2021-11-21T03:48:44.127 INFO:teuthology.orchestra.run.gibba043.stdout: ms inject socket failures = 5000 2021-11-21T03:48:44.127 INFO:teuthology.orchestra.run.gibba043.stdout: fsid = 84f78865-ca38-49d0-bbfb-e8f9679d6c9c 2021-11-21T03:48:44.128 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.128 INFO:teuthology.orchestra.run.gibba043.stdout:[osd] 2021-11-21T03:48:44.128 INFO:teuthology.orchestra.run.gibba043.stdout: osd journal size = 100 2021-11-21T03:48:44.128 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.129 INFO:teuthology.orchestra.run.gibba043.stdout: osd scrub load threshold = 5.0 2021-11-21T03:48:44.129 INFO:teuthology.orchestra.run.gibba043.stdout: osd scrub max interval = 600 2021-11-21T03:48:44.129 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.129 INFO:teuthology.orchestra.run.gibba043.stdout: osd recover clone overlap = true 2021-11-21T03:48:44.129 INFO:teuthology.orchestra.run.gibba043.stdout: osd recovery max chunk = 1048576 2021-11-21T03:48:44.130 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.130 INFO:teuthology.orchestra.run.gibba043.stdout: osd debug shutdown = true 2021-11-21T03:48:44.130 INFO:teuthology.orchestra.run.gibba043.stdout: osd debug op order = true 2021-11-21T03:48:44.130 INFO:teuthology.orchestra.run.gibba043.stdout: osd debug verify stray on activate = true 2021-11-21T03:48:44.131 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.131 INFO:teuthology.orchestra.run.gibba043.stdout: osd open classes on start = true 2021-11-21T03:48:44.131 INFO:teuthology.orchestra.run.gibba043.stdout: osd debug pg log writeout = true 2021-11-21T03:48:44.131 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.131 INFO:teuthology.orchestra.run.gibba043.stdout: osd deep scrub update digest min age = 30 2021-11-21T03:48:44.132 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.132 INFO:teuthology.orchestra.run.gibba043.stdout: osd map max advance = 10 2021-11-21T03:48:44.132 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.132 INFO:teuthology.orchestra.run.gibba043.stdout: journal zero on create = true 2021-11-21T03:48:44.133 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.133 INFO:teuthology.orchestra.run.gibba043.stdout: filestore ondisk finisher threads = 3 2021-11-21T03:48:44.133 INFO:teuthology.orchestra.run.gibba043.stdout: filestore apply finisher threads = 3 2021-11-21T03:48:44.133 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.133 INFO:teuthology.orchestra.run.gibba043.stdout: bdev debug aio = true 2021-11-21T03:48:44.134 INFO:teuthology.orchestra.run.gibba043.stdout: osd debug misdirected ops = true 2021-11-21T03:48:44.134 INFO:teuthology.orchestra.run.gibba043.stdout: bdev async discard = True 2021-11-21T03:48:44.134 INFO:teuthology.orchestra.run.gibba043.stdout: bdev enable discard = True 2021-11-21T03:48:44.134 INFO:teuthology.orchestra.run.gibba043.stdout: bluestore allocator = stupid 2021-11-21T03:48:44.135 INFO:teuthology.orchestra.run.gibba043.stdout: bluestore block size = 96636764160 2021-11-21T03:48:44.135 INFO:teuthology.orchestra.run.gibba043.stdout: bluestore fsck on mount = True 2021-11-21T03:48:44.135 INFO:teuthology.orchestra.run.gibba043.stdout: debug bluefs = 20 2021-11-21T03:48:44.135 INFO:teuthology.orchestra.run.gibba043.stdout: debug bluestore = 20 2021-11-21T03:48:44.135 INFO:teuthology.orchestra.run.gibba043.stdout: debug ms = 1 2021-11-21T03:48:44.136 INFO:teuthology.orchestra.run.gibba043.stdout: debug osd = 20 2021-11-21T03:48:44.136 INFO:teuthology.orchestra.run.gibba043.stdout: debug rocksdb = 10 2021-11-21T03:48:44.136 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd backfillfull_ratio = 0.85 2021-11-21T03:48:44.136 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd full ratio = 0.9 2021-11-21T03:48:44.137 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd nearfull ratio = 0.8 2021-11-21T03:48:44.137 INFO:teuthology.orchestra.run.gibba043.stdout: osd failsafe full ratio = 0.95 2021-11-21T03:48:44.137 INFO:teuthology.orchestra.run.gibba043.stdout: osd objectstore = bluestore 2021-11-21T03:48:44.137 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.137 INFO:teuthology.orchestra.run.gibba043.stdout:[mgr] 2021-11-21T03:48:44.138 INFO:teuthology.orchestra.run.gibba043.stdout: debug ms = 1 2021-11-21T03:48:44.139 INFO:teuthology.orchestra.run.gibba043.stdout: debug mgr = 20 2021-11-21T03:48:44.139 INFO:teuthology.orchestra.run.gibba043.stdout: debug mon = 20 2021-11-21T03:48:44.139 INFO:teuthology.orchestra.run.gibba043.stdout: debug auth = 20 2021-11-21T03:48:44.139 INFO:teuthology.orchestra.run.gibba043.stdout: mon reweight min pgs per osd = 4 2021-11-21T03:48:44.139 INFO:teuthology.orchestra.run.gibba043.stdout: mon reweight min bytes per osd = 10 2021-11-21T03:48:44.140 INFO:teuthology.orchestra.run.gibba043.stdout: mgr/telemetry/nag = false 2021-11-21T03:48:44.140 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.140 INFO:teuthology.orchestra.run.gibba043.stdout:[mon] 2021-11-21T03:48:44.140 INFO:teuthology.orchestra.run.gibba043.stdout: debug ms = 1 2021-11-21T03:48:44.141 INFO:teuthology.orchestra.run.gibba043.stdout: debug mon = 20 2021-11-21T03:48:44.141 INFO:teuthology.orchestra.run.gibba043.stdout: debug paxos = 20 2021-11-21T03:48:44.141 INFO:teuthology.orchestra.run.gibba043.stdout: debug auth = 20 2021-11-21T03:48:44.141 INFO:teuthology.orchestra.run.gibba043.stdout: mon data avail warn = 5 2021-11-21T03:48:44.141 INFO:teuthology.orchestra.run.gibba043.stdout: mon mgr mkfs grace = 240 2021-11-21T03:48:44.142 INFO:teuthology.orchestra.run.gibba043.stdout: mon reweight min pgs per osd = 4 2021-11-21T03:48:44.142 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd reporter subtree level = osd 2021-11-21T03:48:44.142 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd prime pg temp = true 2021-11-21T03:48:44.142 INFO:teuthology.orchestra.run.gibba043.stdout: mon reweight min bytes per osd = 10 2021-11-21T03:48:44.142 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.143 INFO:teuthology.orchestra.run.gibba043.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-21T03:48:44.143 INFO:teuthology.orchestra.run.gibba043.stdout: auth mon ticket ttl = 660 # 11m 2021-11-21T03:48:44.143 INFO:teuthology.orchestra.run.gibba043.stdout: auth service ticket ttl = 240 # 4m 2021-11-21T03:48:44.143 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.144 INFO:teuthology.orchestra.run.gibba043.stdout: # don't complain about insecure global_id in the test suite 2021-11-21T03:48:44.144 INFO:teuthology.orchestra.run.gibba043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-21T03:48:44.144 INFO:teuthology.orchestra.run.gibba043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-21T03:48:44.144 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:48:44.145 INFO:teuthology.orchestra.run.gibba043.stdout:[client] 2021-11-21T03:48:44.145 INFO:teuthology.orchestra.run.gibba043.stdout: rgw cache enabled = true 2021-11-21T03:48:44.145 INFO:teuthology.orchestra.run.gibba043.stdout: rgw enable ops log = true 2021-11-21T03:48:44.145 INFO:teuthology.orchestra.run.gibba043.stdout: rgw enable usage log = true 2021-11-21T03:48:44.145 INFO:teuthology.orchestra.run.gibba043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-21T03:48:44.146 INFO:teuthology.orchestra.run.gibba043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-21T03:48:44.146 INFO:teuthology.orchestra.run.gibba043.stdout: debug rbd = 20 2021-11-21T03:48:44.146 INFO:teuthology.orchestra.run.gibba043.stdout: debug rbd_mirror = 15 2021-11-21T03:48:44.146 INFO:teuthology.orchestra.run.gibba043.stdout: log to stderr = False 2021-11-21T03:48:44.147 INFO:teuthology.orchestra.run.gibba043.stdout: rbd default features = 125 2021-11-21T03:48:44.147 INFO:teuthology.orchestra.run.gibba043.stdout: rbd mirror image policy type = simple 2021-11-21T03:48:44.147 INFO:teuthology.orchestra.run.gibba043.stdout:[mon.a] 2021-11-21T03:48:44.147 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.0] 2021-11-21T03:48:44.147 INFO:teuthology.orchestra.run.gibba043.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:48:44.148 INFO:teuthology.orchestra.run.gibba043.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:48:44.148 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.1] 2021-11-21T03:48:44.149 INFO:teuthology.orchestra.run.gibba043.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:48:44.149 INFO:teuthology.orchestra.run.gibba043.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:48:44.149 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.2] 2021-11-21T03:48:44.149 INFO:teuthology.orchestra.run.gibba043.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:48:44.150 INFO:teuthology.orchestra.run.gibba043.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:48:44.150 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.3] 2021-11-21T03:48:44.150 INFO:teuthology.orchestra.run.gibba043.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:48:44.150 INFO:teuthology.orchestra.run.gibba043.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:48:44.151 INFO:tasks.ceph:Creating admin key on cluster1.mon.a... 2021-11-21T03:48:44.151 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/cluster1.keyring 2021-11-21T03:48:44.195 INFO:tasks.ceph:Copying monmap to all nodes... 2021-11-21T03:48:44.250 DEBUG:teuthology.orchestra.remote:gibba022:/etc/ceph/cluster1.keyring is 206B 2021-11-21T03:48:44.350 DEBUG:teuthology.orchestra.remote:gibba022:/home/ubuntu/cephtest/cluster1.monmap is 179B 2021-11-21T03:48:44.402 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba022.front.sepia.ceph.com 2021-11-21T03:48:44.403 DEBUG:teuthology.orchestra.run.gibba022:> set -ex 2021-11-21T03:48:44.403 DEBUG:teuthology.orchestra.run.gibba022:> sudo dd of=/etc/ceph/cluster1.keyring 2021-11-21T03:48:44.404 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod 0644 /etc/ceph/cluster1.keyring 2021-11-21T03:48:44.430 DEBUG:teuthology.orchestra.run.gibba022:> set -ex 2021-11-21T03:48:44.430 DEBUG:teuthology.orchestra.run.gibba022:> dd of=/home/ubuntu/cephtest/cluster1.monmap 2021-11-21T03:48:44.483 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba043.front.sepia.ceph.com 2021-11-21T03:48:44.484 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-11-21T03:48:44.485 DEBUG:teuthology.orchestra.run.gibba043:> sudo dd of=/etc/ceph/cluster1.keyring 2021-11-21T03:48:44.486 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod 0644 /etc/ceph/cluster1.keyring 2021-11-21T03:48:44.516 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-11-21T03:48:44.517 DEBUG:teuthology.orchestra.run.gibba043:> dd of=/home/ubuntu/cephtest/cluster1.monmap 2021-11-21T03:48:44.567 INFO:tasks.ceph:Setting up mon nodes... 2021-11-21T03:48:44.568 INFO:tasks.ceph:Setting up mgr nodes... 2021-11-21T03:48:44.568 DEBUG:teuthology.orchestra.run.gibba022:> sudo mkdir -p /var/lib/ceph/mgr/cluster1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/cluster1-x/keyring 2021-11-21T03:48:44.604 INFO:teuthology.orchestra.run.gibba022.stdout:creating /var/lib/ceph/mgr/cluster1-x/keyring 2021-11-21T03:48:44.606 INFO:tasks.ceph:Setting up mds nodes... 2021-11-21T03:48:44.606 INFO:tasks.ceph_client:Setting up client nodes... 2021-11-21T03:48:44.607 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/cluster1.client.0.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.0.keyring 2021-11-21T03:48:44.674 INFO:teuthology.orchestra.run.gibba022.stdout:creating /etc/ceph/cluster1.client.0.keyring 2021-11-21T03:48:44.683 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror /etc/ceph/cluster1.client.mirror.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.keyring 2021-11-21T03:48:44.725 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster1.client.mirror.keyring 2021-11-21T03:48:44.739 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.0 /etc/ceph/cluster1.client.mirror.0.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.0.keyring 2021-11-21T03:48:44.808 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster1.client.mirror.0.keyring 2021-11-21T03:48:44.818 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.1 /etc/ceph/cluster1.client.mirror.1.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.1.keyring 2021-11-21T03:48:44.886 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster1.client.mirror.1.keyring 2021-11-21T03:48:44.895 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.2 /etc/ceph/cluster1.client.mirror.2.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.2.keyring 2021-11-21T03:48:44.964 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster1.client.mirror.2.keyring 2021-11-21T03:48:44.976 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.3 /etc/ceph/cluster1.client.mirror.3.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.3.keyring 2021-11-21T03:48:45.044 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster1.client.mirror.3.keyring 2021-11-21T03:48:45.054 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.4 /etc/ceph/cluster1.client.mirror.4.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.4.keyring 2021-11-21T03:48:45.121 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster1.client.mirror.4.keyring 2021-11-21T03:48:45.130 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.5 /etc/ceph/cluster1.client.mirror.5.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.5.keyring 2021-11-21T03:48:45.198 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster1.client.mirror.5.keyring 2021-11-21T03:48:45.207 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.6 /etc/ceph/cluster1.client.mirror.6.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.6.keyring 2021-11-21T03:48:45.273 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster1.client.mirror.6.keyring 2021-11-21T03:48:45.283 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-11-21T03:48:45.283 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@gibba022.front.sepia.ceph.com'): {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-11-21T03:48:45.284 DEBUG:teuthology.orchestra.run.gibba022:> sudo mkdir -p /var/lib/ceph/osd/cluster1-0 2021-11-21T03:48:45.304 INFO:tasks.ceph:roles_to_devs: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-21T03:48:45.305 INFO:tasks.ceph:role: cluster1.osd.0 2021-11-21T03:48:45.305 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba022.front.sepia.ceph.com 2021-11-21T03:48:45.306 DEBUG:teuthology.orchestra.run.gibba022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-11-21T03:48:45.368 INFO:teuthology.orchestra.run.gibba022.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-11-21T03:48:45.369 INFO:teuthology.orchestra.run.gibba022.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-21T03:48:45.369 INFO:teuthology.orchestra.run.gibba022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-21T03:48:45.369 INFO:teuthology.orchestra.run.gibba022.stdout: = reflink=1 2021-11-21T03:48:45.370 INFO:teuthology.orchestra.run.gibba022.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-21T03:48:45.370 INFO:teuthology.orchestra.run.gibba022.stdout: = sunit=0 swidth=0 blks 2021-11-21T03:48:45.370 INFO:teuthology.orchestra.run.gibba022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-21T03:48:45.370 INFO:teuthology.orchestra.run.gibba022.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-21T03:48:45.371 INFO:teuthology.orchestra.run.gibba022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-21T03:48:45.371 INFO:teuthology.orchestra.run.gibba022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-21T03:48:45.388 INFO:teuthology.orchestra.run.gibba022.stdout:Discarding blocks...Done. 2021-11-21T03:48:45.390 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba022.front.sepia.ceph.com -o noatime 2021-11-21T03:48:45.390 DEBUG:teuthology.orchestra.run.gibba022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/cluster1-0 2021-11-21T03:48:45.466 DEBUG:teuthology.orchestra.run.gibba022:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-0 2021-11-21T03:48:45.672 DEBUG:teuthology.orchestra.run.gibba022:> sudo mkdir -p /var/lib/ceph/osd/cluster1-1 2021-11-21T03:48:45.739 INFO:tasks.ceph:roles_to_devs: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-21T03:48:45.740 INFO:tasks.ceph:role: cluster1.osd.1 2021-11-21T03:48:45.740 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba022.front.sepia.ceph.com 2021-11-21T03:48:45.740 DEBUG:teuthology.orchestra.run.gibba022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-11-21T03:48:45.800 INFO:teuthology.orchestra.run.gibba022.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-11-21T03:48:45.800 INFO:teuthology.orchestra.run.gibba022.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-21T03:48:45.801 INFO:teuthology.orchestra.run.gibba022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-21T03:48:45.802 INFO:teuthology.orchestra.run.gibba022.stdout: = reflink=1 2021-11-21T03:48:45.802 INFO:teuthology.orchestra.run.gibba022.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-21T03:48:45.803 INFO:teuthology.orchestra.run.gibba022.stdout: = sunit=0 swidth=0 blks 2021-11-21T03:48:45.803 INFO:teuthology.orchestra.run.gibba022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-21T03:48:45.803 INFO:teuthology.orchestra.run.gibba022.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-21T03:48:45.804 INFO:teuthology.orchestra.run.gibba022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-21T03:48:45.804 INFO:teuthology.orchestra.run.gibba022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-21T03:48:45.822 INFO:teuthology.orchestra.run.gibba022.stdout:Discarding blocks...Done. 2021-11-21T03:48:45.823 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba022.front.sepia.ceph.com -o noatime 2021-11-21T03:48:45.824 DEBUG:teuthology.orchestra.run.gibba022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/cluster1-1 2021-11-21T03:48:45.896 DEBUG:teuthology.orchestra.run.gibba022:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-1 2021-11-21T03:48:45.958 DEBUG:teuthology.orchestra.run.gibba022:> sudo mkdir -p /var/lib/ceph/osd/cluster1-2 2021-11-21T03:48:46.017 INFO:tasks.ceph:roles_to_devs: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-21T03:48:46.018 INFO:tasks.ceph:role: cluster1.osd.2 2021-11-21T03:48:46.018 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba022.front.sepia.ceph.com 2021-11-21T03:48:46.019 DEBUG:teuthology.orchestra.run.gibba022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-11-21T03:48:46.076 INFO:teuthology.orchestra.run.gibba022.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-11-21T03:48:46.077 INFO:teuthology.orchestra.run.gibba022.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-21T03:48:46.077 INFO:teuthology.orchestra.run.gibba022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-21T03:48:46.077 INFO:teuthology.orchestra.run.gibba022.stdout: = reflink=1 2021-11-21T03:48:46.077 INFO:teuthology.orchestra.run.gibba022.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-21T03:48:46.078 INFO:teuthology.orchestra.run.gibba022.stdout: = sunit=0 swidth=0 blks 2021-11-21T03:48:46.078 INFO:teuthology.orchestra.run.gibba022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-21T03:48:46.078 INFO:teuthology.orchestra.run.gibba022.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-21T03:48:46.079 INFO:teuthology.orchestra.run.gibba022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-21T03:48:46.079 INFO:teuthology.orchestra.run.gibba022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-21T03:48:46.100 INFO:teuthology.orchestra.run.gibba022.stdout:Discarding blocks...Done. 2021-11-21T03:48:46.102 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba022.front.sepia.ceph.com -o noatime 2021-11-21T03:48:46.102 DEBUG:teuthology.orchestra.run.gibba022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/cluster1-2 2021-11-21T03:48:46.174 DEBUG:teuthology.orchestra.run.gibba022:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-2 2021-11-21T03:48:46.236 DEBUG:teuthology.orchestra.run.gibba022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/cluster1.monmap 2021-11-21T03:48:46.307 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:46.309+0000 7f6c8f188f00 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-0/keyring: can't open /var/lib/ceph/osd/cluster1-0/keyring: (2) No such file or directory 2021-11-21T03:48:46.308 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:46.309+0000 7f6c8f188f00 -1 created new key in keyring /var/lib/ceph/osd/cluster1-0/keyring 2021-11-21T03:48:46.308 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:46.309+0000 7f6c8f188f00 -1 bluestore(/var/lib/ceph/osd/cluster1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-0/block: (2) No such file or directory 2021-11-21T03:48:46.308 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:46.309+0000 7f6c8f188f00 -1 bluestore(/var/lib/ceph/osd/cluster1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-0/block: (2) No such file or directory 2021-11-21T03:48:46.309 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:46.309+0000 7f6c8f188f00 -1 bluestore(/var/lib/ceph/osd/cluster1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-0/block: (2) No such file or directory 2021-11-21T03:48:46.309 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:46.309+0000 7f6c8f188f00 -1 bluestore(/var/lib/ceph/osd/cluster1-0) _read_fsid unparsable uuid 2021-11-21T03:48:46.318 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:46.315+0000 7f6c8f188f00 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-21T03:48:48.668 DEBUG:teuthology.orchestra.run.gibba022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-0 2021-11-21T03:48:48.730 DEBUG:teuthology.orchestra.run.gibba022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/cluster1.monmap 2021-11-21T03:48:48.801 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:48.803+0000 7ffaee7f1f00 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-1/keyring: can't open /var/lib/ceph/osd/cluster1-1/keyring: (2) No such file or directory 2021-11-21T03:48:48.802 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:48.803+0000 7ffaee7f1f00 -1 created new key in keyring /var/lib/ceph/osd/cluster1-1/keyring 2021-11-21T03:48:48.802 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:48.803+0000 7ffaee7f1f00 -1 bluestore(/var/lib/ceph/osd/cluster1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-1/block: (2) No such file or directory 2021-11-21T03:48:48.802 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:48.803+0000 7ffaee7f1f00 -1 bluestore(/var/lib/ceph/osd/cluster1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-1/block: (2) No such file or directory 2021-11-21T03:48:48.802 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:48.803+0000 7ffaee7f1f00 -1 bluestore(/var/lib/ceph/osd/cluster1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-1/block: (2) No such file or directory 2021-11-21T03:48:48.803 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:48.804+0000 7ffaee7f1f00 -1 bluestore(/var/lib/ceph/osd/cluster1-1) _read_fsid unparsable uuid 2021-11-21T03:48:48.806 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:48.808+0000 7ffaee7f1f00 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-21T03:48:51.155 DEBUG:teuthology.orchestra.run.gibba022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-1 2021-11-21T03:48:51.217 DEBUG:teuthology.orchestra.run.gibba022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/cluster1.monmap 2021-11-21T03:48:51.289 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:51.290+0000 7f1f3f856f00 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-2/keyring: can't open /var/lib/ceph/osd/cluster1-2/keyring: (2) No such file or directory 2021-11-21T03:48:51.290 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:51.290+0000 7f1f3f856f00 -1 created new key in keyring /var/lib/ceph/osd/cluster1-2/keyring 2021-11-21T03:48:51.290 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:51.290+0000 7f1f3f856f00 -1 bluestore(/var/lib/ceph/osd/cluster1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-2/block: (2) No such file or directory 2021-11-21T03:48:51.290 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:51.290+0000 7f1f3f856f00 -1 bluestore(/var/lib/ceph/osd/cluster1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-2/block: (2) No such file or directory 2021-11-21T03:48:51.291 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:51.290+0000 7f1f3f856f00 -1 bluestore(/var/lib/ceph/osd/cluster1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-2/block: (2) No such file or directory 2021-11-21T03:48:51.291 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:51.291+0000 7f1f3f856f00 -1 bluestore(/var/lib/ceph/osd/cluster1-2) _read_fsid unparsable uuid 2021-11-21T03:48:51.294 INFO:teuthology.orchestra.run.gibba022.stderr:2021-11-21T03:48:51.296+0000 7f1f3f856f00 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-21T03:48:53.641 DEBUG:teuthology.orchestra.run.gibba022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-2 2021-11-21T03:48:53.701 INFO:tasks.ceph:Reading keys from all nodes... 2021-11-21T03:48:53.702 DEBUG:teuthology.orchestra.run.gibba022:> mktemp 2021-11-21T03:48:53.755 INFO:teuthology.orchestra.run.gibba022.stdout:/tmp/tmp.iCvL0sC9vJ 2021-11-21T03:48:53.756 DEBUG:teuthology.orchestra.run.gibba022:> sudo cp /var/lib/ceph/mgr/cluster1-x/keyring /tmp/tmp.iCvL0sC9vJ 2021-11-21T03:48:53.819 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod 0666 /tmp/tmp.iCvL0sC9vJ 2021-11-21T03:48:53.937 DEBUG:teuthology.orchestra.remote:gibba022:/tmp/tmp.iCvL0sC9vJ is 56B 2021-11-21T03:48:53.990 DEBUG:teuthology.orchestra.run.gibba022:> rm -fr /tmp/tmp.iCvL0sC9vJ 2021-11-21T03:48:54.005 DEBUG:teuthology.orchestra.run.gibba022:> mktemp 2021-11-21T03:48:54.056 INFO:teuthology.orchestra.run.gibba022.stdout:/tmp/tmp.d8dlWhnP2q 2021-11-21T03:48:54.057 DEBUG:teuthology.orchestra.run.gibba022:> sudo cp /var/lib/ceph/osd/cluster1-0/keyring /tmp/tmp.d8dlWhnP2q 2021-11-21T03:48:54.117 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod 0666 /tmp/tmp.d8dlWhnP2q 2021-11-21T03:48:54.233 DEBUG:teuthology.orchestra.remote:gibba022:/tmp/tmp.d8dlWhnP2q is 56B 2021-11-21T03:48:54.293 DEBUG:teuthology.orchestra.run.gibba022:> rm -fr /tmp/tmp.d8dlWhnP2q 2021-11-21T03:48:54.305 DEBUG:teuthology.orchestra.run.gibba022:> mktemp 2021-11-21T03:48:54.360 INFO:teuthology.orchestra.run.gibba022.stdout:/tmp/tmp.NhzCSoLLM8 2021-11-21T03:48:54.360 DEBUG:teuthology.orchestra.run.gibba022:> sudo cp /var/lib/ceph/osd/cluster1-1/keyring /tmp/tmp.NhzCSoLLM8 2021-11-21T03:48:54.420 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod 0666 /tmp/tmp.NhzCSoLLM8 2021-11-21T03:48:54.536 DEBUG:teuthology.orchestra.remote:gibba022:/tmp/tmp.NhzCSoLLM8 is 56B 2021-11-21T03:48:54.587 DEBUG:teuthology.orchestra.run.gibba022:> rm -fr /tmp/tmp.NhzCSoLLM8 2021-11-21T03:48:54.600 DEBUG:teuthology.orchestra.run.gibba022:> mktemp 2021-11-21T03:48:54.652 INFO:teuthology.orchestra.run.gibba022.stdout:/tmp/tmp.YTX0e4nLS3 2021-11-21T03:48:54.653 DEBUG:teuthology.orchestra.run.gibba022:> sudo cp /var/lib/ceph/osd/cluster1-2/keyring /tmp/tmp.YTX0e4nLS3 2021-11-21T03:48:54.711 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod 0666 /tmp/tmp.YTX0e4nLS3 2021-11-21T03:48:54.828 DEBUG:teuthology.orchestra.remote:gibba022:/tmp/tmp.YTX0e4nLS3 is 56B 2021-11-21T03:48:54.886 DEBUG:teuthology.orchestra.run.gibba022:> rm -fr /tmp/tmp.YTX0e4nLS3 2021-11-21T03:48:54.956 DEBUG:teuthology.orchestra.remote:gibba022:/etc/ceph/cluster1.client.0.keyring is 59B 2021-11-21T03:48:55.023 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster1.client.mirror.keyring is 64B 2021-11-21T03:48:55.123 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster1.client.mirror.0.keyring is 66B 2021-11-21T03:48:55.227 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster1.client.mirror.1.keyring is 66B 2021-11-21T03:48:55.335 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster1.client.mirror.2.keyring is 66B 2021-11-21T03:48:55.434 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster1.client.mirror.3.keyring is 66B 2021-11-21T03:48:55.540 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster1.client.mirror.4.keyring is 66B 2021-11-21T03:48:55.643 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster1.client.mirror.5.keyring is 66B 2021-11-21T03:48:55.754 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster1.client.mirror.6.keyring is 66B 2021-11-21T03:48:55.805 INFO:tasks.ceph:Adding keys to all mons... 2021-11-21T03:48:55.806 DEBUG:teuthology.orchestra.run.gibba022:> sudo tee -a /etc/ceph/cluster1.keyring 2021-11-21T03:48:55.855 INFO:teuthology.orchestra.run.gibba022.stdout:[mgr.x] 2021-11-21T03:48:55.855 INFO:teuthology.orchestra.run.gibba022.stdout: key = AQCcwZlh+bU1JBAA3pLwH6Ki6J2wmC8m2YAWhw== 2021-11-21T03:48:55.856 INFO:teuthology.orchestra.run.gibba022.stdout:[osd.0] 2021-11-21T03:48:55.856 INFO:teuthology.orchestra.run.gibba022.stdout: key = AQCewZlhpYd/EhAAiAkPrmhy/TCLLJ/njyqdvQ== 2021-11-21T03:48:55.856 INFO:teuthology.orchestra.run.gibba022.stdout:[osd.1] 2021-11-21T03:48:55.856 INFO:teuthology.orchestra.run.gibba022.stdout: key = AQCgwZlh+8T0LxAAotaWDlEZvZwfabFDrbk94Q== 2021-11-21T03:48:55.857 INFO:teuthology.orchestra.run.gibba022.stdout:[osd.2] 2021-11-21T03:48:55.857 INFO:teuthology.orchestra.run.gibba022.stdout: key = AQCjwZlh2uVkERAALhIGF6rWFb7dh5gyx6+5tg== 2021-11-21T03:48:55.857 INFO:teuthology.orchestra.run.gibba022.stdout:[client.0] 2021-11-21T03:48:55.857 INFO:teuthology.orchestra.run.gibba022.stdout: key = AQCcwZlhTa9bKBAA70zvn9H8ugTcGachkbckFQ== 2021-11-21T03:48:55.858 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror] 2021-11-21T03:48:55.858 INFO:teuthology.orchestra.run.gibba022.stdout: key = AQCcwZlhZOVwKxAAA1EyXmifkQLLeaysk4f4fA== 2021-11-21T03:48:55.858 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.0] 2021-11-21T03:48:55.858 INFO:teuthology.orchestra.run.gibba022.stdout: key = AQCcwZlh3xZeMBAAI1nkDwzvj1hCbb6cVUPBrQ== 2021-11-21T03:48:55.858 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.1] 2021-11-21T03:48:55.859 INFO:teuthology.orchestra.run.gibba022.stdout: key = AQCcwZlh6lIBNRAAkXpGBG0KmK5K+fWva+HXGQ== 2021-11-21T03:48:55.859 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.2] 2021-11-21T03:48:55.859 INFO:teuthology.orchestra.run.gibba022.stdout: key = AQCcwZlhoyyqORAAizrkI5pw6n3N6QO6I9daNA== 2021-11-21T03:48:55.859 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.3] 2021-11-21T03:48:55.860 INFO:teuthology.orchestra.run.gibba022.stdout: key = AQCdwZlhIS/YAhAAHKn7OCdveh7+ZY2u5i+uXA== 2021-11-21T03:48:55.860 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.4] 2021-11-21T03:48:55.860 INFO:teuthology.orchestra.run.gibba022.stdout: key = AQCdwZlhFqNlBxAA4CuPx4NG46xItzIekg1BdQ== 2021-11-21T03:48:55.860 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.5] 2021-11-21T03:48:55.861 INFO:teuthology.orchestra.run.gibba022.stdout: key = AQCdwZlheuD8CxAAyQrMlxM/bonhbV21mAhong== 2021-11-21T03:48:55.861 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.6] 2021-11-21T03:48:55.861 INFO:teuthology.orchestra.run.gibba022.stdout: key = AQCdwZlh1hSDEBAASFrJcMuFLgFTPnDft0uf2Q== 2021-11-21T03:48:55.862 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-21T03:48:55.944 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-21T03:48:56.029 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-21T03:48:56.104 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-21T03:48:56.180 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:48:56.257 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:48:56.334 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:48:56.410 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:48:56.489 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:48:56.567 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:48:56.645 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.4 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:48:56.722 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.5 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:48:56.800 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.6 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:48:56.880 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-11-21T03:48:56.881 DEBUG:teuthology.orchestra.run.gibba022:> sudo mkdir -p /var/lib/ceph/mon/cluster1-a 2021-11-21T03:48:56.940 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster cluster1 --mkfs -i a --monmap /home/ubuntu/cephtest/cluster1.monmap --keyring /etc/ceph/cluster1.keyring 2021-11-21T03:48:57.021 DEBUG:teuthology.orchestra.run.gibba022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/cluster1-a 2021-11-21T03:48:57.081 DEBUG:teuthology.orchestra.run.gibba022:> rm -- /home/ubuntu/cephtest/cluster1.monmap 2021-11-21T03:48:57.134 INFO:tasks.ceph:Starting mon daemons in cluster cluster1... 2021-11-21T03:48:57.134 INFO:tasks.ceph.cluster1.mon.a:Restarting daemon 2021-11-21T03:48:57.135 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster cluster1 -i a 2021-11-21T03:48:57.177 INFO:tasks.ceph.cluster1.mon.a:Started 2021-11-21T03:48:57.177 INFO:tasks.ceph:Starting mgr daemons in cluster cluster1... 2021-11-21T03:48:57.178 INFO:tasks.ceph.cluster1.mgr.x:Restarting daemon 2021-11-21T03:48:57.178 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster cluster1 -i x 2021-11-21T03:48:57.188 INFO:tasks.ceph.cluster1.mgr.x:Started 2021-11-21T03:48:57.189 INFO:tasks.ceph:Setting crush tunables to default 2021-11-21T03:48:57.189 DEBUG:teuthology.orchestra.run.gibba022:> sudo ceph --cluster cluster1 osd crush tunables default 2021-11-21T03:48:57.328 INFO:teuthology.orchestra.run.gibba022.stderr:adjusted tunables profile to default 2021-11-21T03:48:57.333 INFO:tasks.ceph:Starting osd daemons in cluster cluster1... 2021-11-21T03:48:57.334 DEBUG:teuthology.orchestra.run.gibba022:> mktemp 2021-11-21T03:48:57.346 INFO:teuthology.orchestra.run.gibba022.stdout:/tmp/tmp.8eUuVkfbkz 2021-11-21T03:48:57.347 DEBUG:teuthology.orchestra.run.gibba022:> sudo cp /var/lib/ceph/osd/cluster1-0/fsid /tmp/tmp.8eUuVkfbkz 2021-11-21T03:48:57.406 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod 0666 /tmp/tmp.8eUuVkfbkz 2021-11-21T03:48:57.521 DEBUG:teuthology.orchestra.remote:gibba022:/tmp/tmp.8eUuVkfbkz is 37B 2021-11-21T03:48:57.581 DEBUG:teuthology.orchestra.run.gibba022:> rm -fr /tmp/tmp.8eUuVkfbkz 2021-11-21T03:48:57.593 DEBUG:teuthology.orchestra.run.gibba022:> mktemp 2021-11-21T03:48:57.645 INFO:teuthology.orchestra.run.gibba022.stdout:/tmp/tmp.XYyCLSCRUI 2021-11-21T03:48:57.645 DEBUG:teuthology.orchestra.run.gibba022:> sudo cp /var/lib/ceph/osd/cluster1-1/fsid /tmp/tmp.XYyCLSCRUI 2021-11-21T03:48:57.704 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod 0666 /tmp/tmp.XYyCLSCRUI 2021-11-21T03:48:57.817 DEBUG:teuthology.orchestra.remote:gibba022:/tmp/tmp.XYyCLSCRUI is 37B 2021-11-21T03:48:57.867 DEBUG:teuthology.orchestra.run.gibba022:> rm -fr /tmp/tmp.XYyCLSCRUI 2021-11-21T03:48:57.883 DEBUG:teuthology.orchestra.run.gibba022:> mktemp 2021-11-21T03:48:57.932 INFO:teuthology.orchestra.run.gibba022.stdout:/tmp/tmp.lsE8jRirKM 2021-11-21T03:48:57.933 DEBUG:teuthology.orchestra.run.gibba022:> sudo cp /var/lib/ceph/osd/cluster1-2/fsid /tmp/tmp.lsE8jRirKM 2021-11-21T03:48:57.992 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod 0666 /tmp/tmp.lsE8jRirKM 2021-11-21T03:48:58.108 DEBUG:teuthology.orchestra.remote:gibba022:/tmp/tmp.lsE8jRirKM is 37B 2021-11-21T03:48:58.158 DEBUG:teuthology.orchestra.run.gibba022:> rm -fr /tmp/tmp.lsE8jRirKM 2021-11-21T03:48:58.171 DEBUG:teuthology.orchestra.run.gibba022:> sudo ceph --cluster cluster1 osd new c6df192b-addb-49fc-a68b-0cbb7350a7a4 0 2021-11-21T03:48:58.379 INFO:teuthology.orchestra.run.gibba022.stdout:0 2021-11-21T03:48:58.389 DEBUG:teuthology.orchestra.run.gibba022:> sudo ceph --cluster cluster1 osd new 0015e031-72c4-4baf-95d0-33d88b465cfa 1 2021-11-21T03:48:58.533 INFO:teuthology.orchestra.run.gibba022.stdout:1 2021-11-21T03:48:58.544 DEBUG:teuthology.orchestra.run.gibba022:> sudo ceph --cluster cluster1 osd new b3454541-438c-4879-b1a6-a735fdc63d37 2 2021-11-21T03:48:58.685 INFO:teuthology.orchestra.run.gibba022.stdout:2 2021-11-21T03:48:58.694 INFO:tasks.ceph.cluster1.osd.0:Restarting daemon 2021-11-21T03:48:58.695 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 0 2021-11-21T03:48:58.699 INFO:tasks.ceph.cluster1.osd.0:Started 2021-11-21T03:48:58.700 INFO:tasks.ceph.cluster1.osd.1:Restarting daemon 2021-11-21T03:48:58.701 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 1 2021-11-21T03:48:58.708 INFO:tasks.ceph.cluster1.osd.1:Started 2021-11-21T03:48:58.709 INFO:tasks.ceph.cluster1.osd.2:Restarting daemon 2021-11-21T03:48:58.710 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 2 2021-11-21T03:48:58.718 INFO:tasks.ceph.cluster1.osd.2:Started 2021-11-21T03:48:58.719 INFO:tasks.ceph:Waiting for OSDs to come up 2021-11-21T03:48:59.023 DEBUG:teuthology.orchestra.run.gibba022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster1 osd dump --format=json 2021-11-21T03:48:59.146 INFO:teuthology.misc.health.gibba022.stdout: 2021-11-21T03:48:59.146 INFO:teuthology.misc.health.gibba022.stdout:{"epoch":5,"fsid":"84f78865-ca38-49d0-bbfb-e8f9679d6c9c","created":"2021-11-21T03:48:57.256278+0000","modified":"2021-11-21T03:48:58.686272+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"c6df192b-addb-49fc-a68b-0cbb7350a7a4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0015e031-72c4-4baf-95d0-33d88b465cfa","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b3454541-438c-4879-b1a6-a735fdc63d37","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-21T03:48:59.157 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-11-21T03:48:59.273 INFO:tasks.ceph.cluster1.osd.0.gibba022.stderr:2021-11-21T03:48:59.275+0000 7fe7705ccf00 -1 Falling back to public interface 2021-11-21T03:48:59.280 INFO:tasks.ceph.cluster1.osd.1.gibba022.stderr:2021-11-21T03:48:59.282+0000 7f598030ff00 -1 Falling back to public interface 2021-11-21T03:48:59.287 INFO:tasks.ceph.cluster1.osd.2.gibba022.stderr:2021-11-21T03:48:59.289+0000 7fb5dc649f00 -1 Falling back to public interface 2021-11-21T03:49:00.356 INFO:tasks.ceph.cluster1.osd.0.gibba022.stderr:2021-11-21T03:49:00.358+0000 7fe7705ccf00 -1 osd.0 0 log_to_monitors {default=true} 2021-11-21T03:49:00.364 INFO:tasks.ceph.cluster1.osd.2.gibba022.stderr:2021-11-21T03:49:00.366+0000 7fb5dc649f00 -1 osd.2 0 log_to_monitors {default=true} 2021-11-21T03:49:00.365 INFO:tasks.ceph.cluster1.osd.1.gibba022.stderr:2021-11-21T03:49:00.366+0000 7f598030ff00 -1 osd.1 0 log_to_monitors {default=true} 2021-11-21T03:49:01.768 INFO:tasks.ceph.cluster1.osd.0.gibba022.stderr:2021-11-21T03:49:01.767+0000 7fe758ac2700 -1 osd.0 0 waiting for initial osdmap 2021-11-21T03:49:01.769 INFO:tasks.ceph.cluster1.osd.1.gibba022.stderr:2021-11-21T03:49:01.767+0000 7f5968805700 -1 osd.1 0 waiting for initial osdmap 2021-11-21T03:49:01.770 INFO:tasks.ceph.cluster1.osd.2.gibba022.stderr:2021-11-21T03:49:01.767+0000 7fb5c4b3f700 -1 osd.2 0 waiting for initial osdmap 2021-11-21T03:49:01.771 INFO:tasks.ceph.cluster1.osd.1.gibba022.stderr:2021-11-21T03:49:01.769+0000 7f5974222700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-21T03:49:01.772 INFO:tasks.ceph.cluster1.osd.2.gibba022.stderr:2021-11-21T03:49:01.769+0000 7fb5d055c700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-21T03:49:01.772 INFO:tasks.ceph.cluster1.osd.0.gibba022.stderr:2021-11-21T03:49:01.770+0000 7fe7644df700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-21T03:49:05.461 DEBUG:teuthology.orchestra.run.gibba022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster1 osd dump --format=json 2021-11-21T03:49:05.636 INFO:teuthology.misc.health.gibba022.stdout: 2021-11-21T03:49:05.637 INFO:teuthology.misc.health.gibba022.stdout:{"epoch":10,"fsid":"84f78865-ca38-49d0-bbfb-e8f9679d6c9c","created":"2021-11-21T03:48:57.256278+0000","modified":"2021-11-21T03:49:04.774401+0000","last_up_change":"2021-11-21T03:49:02.765855+0000","last_in_change":"2021-11-21T03:49:02.765855+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-21T03:48:59.777101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"c6df192b-addb-49fc-a68b-0cbb7350a7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6800","nonce":28475},{"type":"v1","addr":"172.21.2.122:6801","nonce":28475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6802","nonce":28475},{"type":"v1","addr":"172.21.2.122:6803","nonce":28475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6806","nonce":28475},{"type":"v1","addr":"172.21.2.122:6807","nonce":28475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6804","nonce":28475},{"type":"v1","addr":"172.21.2.122:6805","nonce":28475}]},"public_addr":"172.21.2.122:6801/28475","cluster_addr":"172.21.2.122:6803/28475","heartbeat_back_addr":"172.21.2.122:6807/28475","heartbeat_front_addr":"172.21.2.122:6805/28475","state":["exists","up"]},{"osd":1,"uuid":"0015e031-72c4-4baf-95d0-33d88b465cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":8,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6808","nonce":28476},{"type":"v1","addr":"172.21.2.122:6809","nonce":28476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6810","nonce":28476},{"type":"v1","addr":"172.21.2.122:6811","nonce":28476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6814","nonce":28476},{"type":"v1","addr":"172.21.2.122:6815","nonce":28476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6812","nonce":28476},{"type":"v1","addr":"172.21.2.122:6813","nonce":28476}]},"public_addr":"172.21.2.122:6809/28476","cluster_addr":"172.21.2.122:6811/28476","heartbeat_back_addr":"172.21.2.122:6815/28476","heartbeat_front_addr":"172.21.2.122:6813/28476","state":["exists","up"]},{"osd":2,"uuid":"b3454541-438c-4879-b1a6-a735fdc63d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6816","nonce":28499},{"type":"v1","addr":"172.21.2.122:6817","nonce":28499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6818","nonce":28499},{"type":"v1","addr":"172.21.2.122:6819","nonce":28499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6822","nonce":28499},{"type":"v1","addr":"172.21.2.122:6823","nonce":28499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6820","nonce":28499},{"type":"v1","addr":"172.21.2.122:6821","nonce":28499}]},"public_addr":"172.21.2.122:6817/28499","cluster_addr":"172.21.2.122:6819/28499","heartbeat_back_addr":"172.21.2.122:6823/28499","heartbeat_front_addr":"172.21.2.122:6821/28499","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:01.404905+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:01.389063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:01.383930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-21T03:49:05.650 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-11-21T03:49:05.650 INFO:tasks.ceph:Creating RBD pool 2021-11-21T03:49:05.651 DEBUG:teuthology.orchestra.run.gibba022:> sudo ceph --cluster cluster1 osd pool create rbd 8 2021-11-21T03:49:06.780 INFO:teuthology.orchestra.run.gibba022.stderr:pool 'rbd' created 2021-11-21T03:49:06.788 DEBUG:teuthology.orchestra.run.gibba022:> sudo ceph --cluster cluster1 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-11-21T03:49:07.782 INFO:teuthology.orchestra.run.gibba022.stderr:enabled application 'rbd' on pool 'rbd' 2021-11-21T03:49:07.790 INFO:tasks.ceph:Starting mds daemons in cluster cluster1... 2021-11-21T03:49:07.791 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2021-11-21T03:49:07.792 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-11-21T03:49:08.000 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:08.001 INFO:teuthology.orchestra.run.gibba022.stdout:{"epoch":12,"fsid":"84f78865-ca38-49d0-bbfb-e8f9679d6c9c","created":"2021-11-21T03:48:57.256278+0000","modified":"2021-11-21T03:49:07.779920+0000","last_up_change":"2021-11-21T03:49:02.765855+0000","last_in_change":"2021-11-21T03:49:02.765855+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-21T03:48:59.777101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-21T03:49:05.852559+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6df192b-addb-49fc-a68b-0cbb7350a7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6800","nonce":28475},{"type":"v1","addr":"172.21.2.122:6801","nonce":28475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6802","nonce":28475},{"type":"v1","addr":"172.21.2.122:6803","nonce":28475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6806","nonce":28475},{"type":"v1","addr":"172.21.2.122:6807","nonce":28475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6804","nonce":28475},{"type":"v1","addr":"172.21.2.122:6805","nonce":28475}]},"public_addr":"172.21.2.122:6801/28475","cluster_addr":"172.21.2.122:6803/28475","heartbeat_back_addr":"172.21.2.122:6807/28475","heartbeat_front_addr":"172.21.2.122:6805/28475","state":["exists","up"]},{"osd":1,"uuid":"0015e031-72c4-4baf-95d0-33d88b465cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6808","nonce":28476},{"type":"v1","addr":"172.21.2.122:6809","nonce":28476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6810","nonce":28476},{"type":"v1","addr":"172.21.2.122:6811","nonce":28476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6814","nonce":28476},{"type":"v1","addr":"172.21.2.122:6815","nonce":28476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6812","nonce":28476},{"type":"v1","addr":"172.21.2.122:6813","nonce":28476}]},"public_addr":"172.21.2.122:6809/28476","cluster_addr":"172.21.2.122:6811/28476","heartbeat_back_addr":"172.21.2.122:6815/28476","heartbeat_front_addr":"172.21.2.122:6813/28476","state":["exists","up"]},{"osd":2,"uuid":"b3454541-438c-4879-b1a6-a735fdc63d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6816","nonce":28499},{"type":"v1","addr":"172.21.2.122:6817","nonce":28499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6818","nonce":28499},{"type":"v1","addr":"172.21.2.122:6819","nonce":28499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6822","nonce":28499},{"type":"v1","addr":"172.21.2.122:6823","nonce":28499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6820","nonce":28499},{"type":"v1","addr":"172.21.2.122:6821","nonce":28499}]},"public_addr":"172.21.2.122:6817/28499","cluster_addr":"172.21.2.122:6819/28499","heartbeat_back_addr":"172.21.2.122:6823/28499","heartbeat_front_addr":"172.21.2.122:6821/28499","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:01.404905+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:01.389063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:01.383930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-21T03:49:08.010 INFO:tasks.ceph.ceph_manager.cluster1:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-21T03:48:59.777101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-21T03:49:05.852559+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-21T03:49:08.010 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd pool get device_health_metrics pg_num 2021-11-21T03:49:08.208 INFO:teuthology.orchestra.run.gibba022.stdout:pg_num: 1 2021-11-21T03:49:08.225 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd pool get rbd pg_num 2021-11-21T03:49:08.413 INFO:teuthology.orchestra.run.gibba022.stdout:pg_num: 8 2021-11-21T03:49:08.423 INFO:tasks.ceph:Waiting until cluster1 daemons up and pgs clean... 2021-11-21T03:49:08.424 INFO:tasks.ceph.ceph_manager.cluster1:waiting for mgr available 2021-11-21T03:49:08.424 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 mgr dump --format=json 2021-11-21T03:49:08.635 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:08.643 INFO:teuthology.orchestra.run.gibba022.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6824","nonce":27901},{"type":"v1","addr":"172.21.2.122:6825","nonce":27901}]},"active_addr":"172.21.2.122:6825/27901","active_change":"2021-11-21T03:48:59.758814+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.122:0","nonce":1893744140}]},{"addrvec":[{"type":"v2","addr":"172.21.2.122:0","nonce":3228165539}]},{"addrvec":[{"type":"v2","addr":"172.21.2.122:0","nonce":2618012160}]}]}} 2021-11-21T03:49:08.646 INFO:tasks.ceph.ceph_manager.cluster1:mgr available! 2021-11-21T03:49:08.646 INFO:tasks.ceph.ceph_manager.cluster1:waiting for all up 2021-11-21T03:49:08.647 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2021-11-21T03:49:08.829 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:08.830 INFO:teuthology.orchestra.run.gibba022.stdout:{"epoch":13,"fsid":"84f78865-ca38-49d0-bbfb-e8f9679d6c9c","created":"2021-11-21T03:48:57.256278+0000","modified":"2021-11-21T03:49:08.783151+0000","last_up_change":"2021-11-21T03:49:02.765855+0000","last_in_change":"2021-11-21T03:49:02.765855+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-21T03:48:59.777101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-21T03:49:05.852559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6df192b-addb-49fc-a68b-0cbb7350a7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6800","nonce":28475},{"type":"v1","addr":"172.21.2.122:6801","nonce":28475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6802","nonce":28475},{"type":"v1","addr":"172.21.2.122:6803","nonce":28475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6806","nonce":28475},{"type":"v1","addr":"172.21.2.122:6807","nonce":28475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6804","nonce":28475},{"type":"v1","addr":"172.21.2.122:6805","nonce":28475}]},"public_addr":"172.21.2.122:6801/28475","cluster_addr":"172.21.2.122:6803/28475","heartbeat_back_addr":"172.21.2.122:6807/28475","heartbeat_front_addr":"172.21.2.122:6805/28475","state":["exists","up"]},{"osd":1,"uuid":"0015e031-72c4-4baf-95d0-33d88b465cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6808","nonce":28476},{"type":"v1","addr":"172.21.2.122:6809","nonce":28476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6810","nonce":28476},{"type":"v1","addr":"172.21.2.122:6811","nonce":28476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6814","nonce":28476},{"type":"v1","addr":"172.21.2.122:6815","nonce":28476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6812","nonce":28476},{"type":"v1","addr":"172.21.2.122:6813","nonce":28476}]},"public_addr":"172.21.2.122:6809/28476","cluster_addr":"172.21.2.122:6811/28476","heartbeat_back_addr":"172.21.2.122:6815/28476","heartbeat_front_addr":"172.21.2.122:6813/28476","state":["exists","up"]},{"osd":2,"uuid":"b3454541-438c-4879-b1a6-a735fdc63d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6816","nonce":28499},{"type":"v1","addr":"172.21.2.122:6817","nonce":28499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6818","nonce":28499},{"type":"v1","addr":"172.21.2.122:6819","nonce":28499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6822","nonce":28499},{"type":"v1","addr":"172.21.2.122:6823","nonce":28499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6820","nonce":28499},{"type":"v1","addr":"172.21.2.122:6821","nonce":28499}]},"public_addr":"172.21.2.122:6817/28499","cluster_addr":"172.21.2.122:6819/28499","heartbeat_back_addr":"172.21.2.122:6823/28499","heartbeat_front_addr":"172.21.2.122:6821/28499","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:01.404905+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:01.389063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:01.383930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-21T03:49:08.839 INFO:tasks.ceph.ceph_manager.cluster1:all up! 2021-11-21T03:49:08.839 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2021-11-21T03:49:09.019 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:09.020 INFO:teuthology.orchestra.run.gibba022.stdout:{"epoch":13,"fsid":"84f78865-ca38-49d0-bbfb-e8f9679d6c9c","created":"2021-11-21T03:48:57.256278+0000","modified":"2021-11-21T03:49:08.783151+0000","last_up_change":"2021-11-21T03:49:02.765855+0000","last_in_change":"2021-11-21T03:49:02.765855+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-21T03:48:59.777101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-21T03:49:05.852559+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c6df192b-addb-49fc-a68b-0cbb7350a7a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6800","nonce":28475},{"type":"v1","addr":"172.21.2.122:6801","nonce":28475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6802","nonce":28475},{"type":"v1","addr":"172.21.2.122:6803","nonce":28475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6806","nonce":28475},{"type":"v1","addr":"172.21.2.122:6807","nonce":28475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6804","nonce":28475},{"type":"v1","addr":"172.21.2.122:6805","nonce":28475}]},"public_addr":"172.21.2.122:6801/28475","cluster_addr":"172.21.2.122:6803/28475","heartbeat_back_addr":"172.21.2.122:6807/28475","heartbeat_front_addr":"172.21.2.122:6805/28475","state":["exists","up"]},{"osd":1,"uuid":"0015e031-72c4-4baf-95d0-33d88b465cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6808","nonce":28476},{"type":"v1","addr":"172.21.2.122:6809","nonce":28476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6810","nonce":28476},{"type":"v1","addr":"172.21.2.122:6811","nonce":28476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6814","nonce":28476},{"type":"v1","addr":"172.21.2.122:6815","nonce":28476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6812","nonce":28476},{"type":"v1","addr":"172.21.2.122:6813","nonce":28476}]},"public_addr":"172.21.2.122:6809/28476","cluster_addr":"172.21.2.122:6811/28476","heartbeat_back_addr":"172.21.2.122:6815/28476","heartbeat_front_addr":"172.21.2.122:6813/28476","state":["exists","up"]},{"osd":2,"uuid":"b3454541-438c-4879-b1a6-a735fdc63d37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6816","nonce":28499},{"type":"v1","addr":"172.21.2.122:6817","nonce":28499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6818","nonce":28499},{"type":"v1","addr":"172.21.2.122:6819","nonce":28499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6822","nonce":28499},{"type":"v1","addr":"172.21.2.122:6823","nonce":28499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6820","nonce":28499},{"type":"v1","addr":"172.21.2.122:6821","nonce":28499}]},"public_addr":"172.21.2.122:6817/28499","cluster_addr":"172.21.2.122:6819/28499","heartbeat_back_addr":"172.21.2.122:6823/28499","heartbeat_front_addr":"172.21.2.122:6821/28499","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:01.404905+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:01.389063+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:01.383930+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-21T03:49:09.029 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.0 flush_pg_stats 2021-11-21T03:49:09.129 INFO:teuthology.orchestra.run.gibba022.stdout:34359738373 2021-11-21T03:49:09.130 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.1 flush_pg_stats 2021-11-21T03:49:09.231 INFO:teuthology.orchestra.run.gibba022.stdout:34359738371 2021-11-21T03:49:09.232 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.2 flush_pg_stats 2021-11-21T03:49:09.332 INFO:teuthology.orchestra.run.gibba022.stdout:34359738373 2021-11-21T03:49:09.333 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.0 2021-11-21T03:49:09.515 INFO:teuthology.orchestra.run.gibba022.stdout:34359738371 2021-11-21T03:49:09.524 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738373 got 34359738371 for osd.0 2021-11-21T03:49:10.526 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.0 2021-11-21T03:49:10.705 INFO:teuthology.orchestra.run.gibba022.stdout:34359738373 2021-11-21T03:49:10.714 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738373 got 34359738373 for osd.0 2021-11-21T03:49:10.715 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.1 2021-11-21T03:49:10.896 INFO:teuthology.orchestra.run.gibba022.stdout:34359738371 2021-11-21T03:49:10.906 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738371 got 34359738371 for osd.1 2021-11-21T03:49:10.907 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.2 2021-11-21T03:49:11.089 INFO:teuthology.orchestra.run.gibba022.stdout:34359738373 2021-11-21T03:49:11.098 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738373 got 34359738373 for osd.2 2021-11-21T03:49:11.098 INFO:tasks.ceph.ceph_manager.cluster1:waiting for clean 2021-11-21T03:49:11.099 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2021-11-21T03:49:11.279 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:11.280 INFO:teuthology.orchestra.run.gibba022.stderr:dumped all 2021-11-21T03:49:11.287 INFO:teuthology.orchestra.run.gibba022.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2021-11-21T03:49:09.763707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146064,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969456,"statfs":{"total":289910292480,"available":286688722944,"internally_reserved":3221225472,"allocated":319488,"data_stored":90027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.979401"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.785996+0000","last_change":"2021-11-21T03:49:07.785996+0000","last_active":"2021-11-21T03:49:07.785996+0000","last_peered":"2021-11-21T03:49:07.785996+0000","last_clean":"2021-11-21T03:49:07.785996+0000","last_became_active":"2021-11-21T03:49:07.785329+0000","last_became_peered":"2021-11-21T03:49:07.785329+0000","last_unstale":"2021-11-21T03:49:07.785996+0000","last_undegraded":"2021-11-21T03:49:07.785996+0000","last_fullsized":"2021-11-21T03:49:07.785996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.786114+0000","last_change":"2021-11-21T03:49:07.786114+0000","last_active":"2021-11-21T03:49:07.786114+0000","last_peered":"2021-11-21T03:49:07.786114+0000","last_clean":"2021-11-21T03:49:07.786114+0000","last_became_active":"2021-11-21T03:49:07.785397+0000","last_became_peered":"2021-11-21T03:49:07.785397+0000","last_unstale":"2021-11-21T03:49:07.786114+0000","last_undegraded":"2021-11-21T03:49:07.786114+0000","last_fullsized":"2021-11-21T03:49:07.786114+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.786091+0000","last_change":"2021-11-21T03:49:07.786091+0000","last_active":"2021-11-21T03:49:07.786091+0000","last_peered":"2021-11-21T03:49:07.786091+0000","last_clean":"2021-11-21T03:49:07.786091+0000","last_became_active":"2021-11-21T03:49:07.785335+0000","last_became_peered":"2021-11-21T03:49:07.785335+0000","last_unstale":"2021-11-21T03:49:07.786091+0000","last_undegraded":"2021-11-21T03:49:07.786091+0000","last_fullsized":"2021-11-21T03:49:07.786091+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.785118+0000","last_change":"2021-11-21T03:49:07.785118+0000","last_active":"2021-11-21T03:49:07.785118+0000","last_peered":"2021-11-21T03:49:07.785118+0000","last_clean":"2021-11-21T03:49:07.785118+0000","last_became_active":"2021-11-21T03:49:07.784912+0000","last_became_peered":"2021-11-21T03:49:07.784912+0000","last_unstale":"2021-11-21T03:49:07.785118+0000","last_undegraded":"2021-11-21T03:49:07.785118+0000","last_fullsized":"2021-11-21T03:49:07.785118+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":11,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-11-21T03:49:06.782711+0000","last_change":"2021-11-21T03:49:04.328116+0000","last_active":"2021-11-21T03:49:06.782711+0000","last_peered":"2021-11-21T03:49:06.782711+0000","last_clean":"2021-11-21T03:49:06.782711+0000","last_became_active":"2021-11-21T03:49:04.327332+0000","last_became_peered":"2021-11-21T03:49:04.327332+0000","last_unstale":"2021-11-21T03:49:06.782711+0000","last_undegraded":"2021-11-21T03:49:06.782711+0000","last_fullsized":"2021-11-21T03:49:06.782711+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:00.760891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:00.760891+0000","last_clean_scrub_stamp":"2021-11-21T03:49:00.760891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.785326+0000","last_change":"2021-11-21T03:49:07.785326+0000","last_active":"2021-11-21T03:49:07.785326+0000","last_peered":"2021-11-21T03:49:07.785326+0000","last_clean":"2021-11-21T03:49:07.785326+0000","last_became_active":"2021-11-21T03:49:07.784999+0000","last_became_peered":"2021-11-21T03:49:07.784999+0000","last_unstale":"2021-11-21T03:49:07.785326+0000","last_undegraded":"2021-11-21T03:49:07.785326+0000","last_fullsized":"2021-11-21T03:49:07.785326+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.785107+0000","last_change":"2021-11-21T03:49:07.785107+0000","last_active":"2021-11-21T03:49:07.785107+0000","last_peered":"2021-11-21T03:49:07.785107+0000","last_clean":"2021-11-21T03:49:07.785107+0000","last_became_active":"2021-11-21T03:49:07.784861+0000","last_became_peered":"2021-11-21T03:49:07.784861+0000","last_unstale":"2021-11-21T03:49:07.785107+0000","last_undegraded":"2021-11-21T03:49:07.785107+0000","last_fullsized":"2021-11-21T03:49:07.785107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.785875+0000","last_change":"2021-11-21T03:49:07.785474+0000","last_active":"2021-11-21T03:49:07.785875+0000","last_peered":"2021-11-21T03:49:07.785875+0000","last_clean":"2021-11-21T03:49:07.785875+0000","last_became_active":"2021-11-21T03:49:07.785263+0000","last_became_peered":"2021-11-21T03:49:07.785263+0000","last_unstale":"2021-11-21T03:49:07.785875+0000","last_undegraded":"2021-11-21T03:49:07.785875+0000","last_fullsized":"2021-11-21T03:49:07.785875+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.786142+0000","last_change":"2021-11-21T03:49:07.786142+0000","last_active":"2021-11-21T03:49:07.786142+0000","last_peered":"2021-11-21T03:49:07.786142+0000","last_clean":"2021-11-21T03:49:07.786142+0000","last_became_active":"2021-11-21T03:49:07.785320+0000","last_became_peered":"2021-11-21T03:49:07.785320+0000","last_unstale":"2021-11-21T03:49:07.786142+0000","last_undegraded":"2021-11-21T03:49:07.786142+0000","last_fullsized":"2021-11-21T03:49:07.786142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":30009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":30009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16800000000000001}]}]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":30009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]}]}]}} 2021-11-21T03:49:11.289 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2021-11-21T03:49:11.469 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:11.470 INFO:teuthology.orchestra.run.gibba022.stderr:dumped all 2021-11-21T03:49:11.478 INFO:teuthology.orchestra.run.gibba022.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2021-11-21T03:49:09.763707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146064,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969456,"statfs":{"total":289910292480,"available":286688722944,"internally_reserved":3221225472,"allocated":319488,"data_stored":90027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.979401"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.785996+0000","last_change":"2021-11-21T03:49:07.785996+0000","last_active":"2021-11-21T03:49:07.785996+0000","last_peered":"2021-11-21T03:49:07.785996+0000","last_clean":"2021-11-21T03:49:07.785996+0000","last_became_active":"2021-11-21T03:49:07.785329+0000","last_became_peered":"2021-11-21T03:49:07.785329+0000","last_unstale":"2021-11-21T03:49:07.785996+0000","last_undegraded":"2021-11-21T03:49:07.785996+0000","last_fullsized":"2021-11-21T03:49:07.785996+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.786114+0000","last_change":"2021-11-21T03:49:07.786114+0000","last_active":"2021-11-21T03:49:07.786114+0000","last_peered":"2021-11-21T03:49:07.786114+0000","last_clean":"2021-11-21T03:49:07.786114+0000","last_became_active":"2021-11-21T03:49:07.785397+0000","last_became_peered":"2021-11-21T03:49:07.785397+0000","last_unstale":"2021-11-21T03:49:07.786114+0000","last_undegraded":"2021-11-21T03:49:07.786114+0000","last_fullsized":"2021-11-21T03:49:07.786114+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.786091+0000","last_change":"2021-11-21T03:49:07.786091+0000","last_active":"2021-11-21T03:49:07.786091+0000","last_peered":"2021-11-21T03:49:07.786091+0000","last_clean":"2021-11-21T03:49:07.786091+0000","last_became_active":"2021-11-21T03:49:07.785335+0000","last_became_peered":"2021-11-21T03:49:07.785335+0000","last_unstale":"2021-11-21T03:49:07.786091+0000","last_undegraded":"2021-11-21T03:49:07.786091+0000","last_fullsized":"2021-11-21T03:49:07.786091+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.785118+0000","last_change":"2021-11-21T03:49:07.785118+0000","last_active":"2021-11-21T03:49:07.785118+0000","last_peered":"2021-11-21T03:49:07.785118+0000","last_clean":"2021-11-21T03:49:07.785118+0000","last_became_active":"2021-11-21T03:49:07.784912+0000","last_became_peered":"2021-11-21T03:49:07.784912+0000","last_unstale":"2021-11-21T03:49:07.785118+0000","last_undegraded":"2021-11-21T03:49:07.785118+0000","last_fullsized":"2021-11-21T03:49:07.785118+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"9'1","reported_seq":11,"reported_epoch":11,"state":"active+clean","last_fresh":"2021-11-21T03:49:06.782711+0000","last_change":"2021-11-21T03:49:04.328116+0000","last_active":"2021-11-21T03:49:06.782711+0000","last_peered":"2021-11-21T03:49:06.782711+0000","last_clean":"2021-11-21T03:49:06.782711+0000","last_became_active":"2021-11-21T03:49:04.327332+0000","last_became_peered":"2021-11-21T03:49:04.327332+0000","last_unstale":"2021-11-21T03:49:06.782711+0000","last_undegraded":"2021-11-21T03:49:06.782711+0000","last_fullsized":"2021-11-21T03:49:06.782711+0000","mapping_epoch":8,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":9,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:00.760891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:00.760891+0000","last_clean_scrub_stamp":"2021-11-21T03:49:00.760891+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.785326+0000","last_change":"2021-11-21T03:49:07.785326+0000","last_active":"2021-11-21T03:49:07.785326+0000","last_peered":"2021-11-21T03:49:07.785326+0000","last_clean":"2021-11-21T03:49:07.785326+0000","last_became_active":"2021-11-21T03:49:07.784999+0000","last_became_peered":"2021-11-21T03:49:07.784999+0000","last_unstale":"2021-11-21T03:49:07.785326+0000","last_undegraded":"2021-11-21T03:49:07.785326+0000","last_fullsized":"2021-11-21T03:49:07.785326+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.785107+0000","last_change":"2021-11-21T03:49:07.785107+0000","last_active":"2021-11-21T03:49:07.785107+0000","last_peered":"2021-11-21T03:49:07.785107+0000","last_clean":"2021-11-21T03:49:07.785107+0000","last_became_active":"2021-11-21T03:49:07.784861+0000","last_became_peered":"2021-11-21T03:49:07.784861+0000","last_unstale":"2021-11-21T03:49:07.785107+0000","last_undegraded":"2021-11-21T03:49:07.785107+0000","last_fullsized":"2021-11-21T03:49:07.785107+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.785875+0000","last_change":"2021-11-21T03:49:07.785474+0000","last_active":"2021-11-21T03:49:07.785875+0000","last_peered":"2021-11-21T03:49:07.785875+0000","last_clean":"2021-11-21T03:49:07.785875+0000","last_became_active":"2021-11-21T03:49:07.785263+0000","last_became_peered":"2021-11-21T03:49:07.785263+0000","last_unstale":"2021-11-21T03:49:07.785875+0000","last_undegraded":"2021-11-21T03:49:07.785875+0000","last_fullsized":"2021-11-21T03:49:07.785875+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2021-11-21T03:49:07.786142+0000","last_change":"2021-11-21T03:49:07.786142+0000","last_active":"2021-11-21T03:49:07.786142+0000","last_peered":"2021-11-21T03:49:07.786142+0000","last_clean":"2021-11-21T03:49:07.786142+0000","last_became_active":"2021-11-21T03:49:07.785320+0000","last_became_peered":"2021-11-21T03:49:07.785320+0000","last_unstale":"2021-11-21T03:49:07.786142+0000","last_undegraded":"2021-11-21T03:49:07.786142+0000","last_fullsized":"2021-11-21T03:49:07.786142+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:06.777762+0000","last_clean_scrub_stamp":"2021-11-21T03:49:06.777762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":30009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":30009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16800000000000001}]}]},{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":30009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]}]}]}} 2021-11-21T03:49:11.480 INFO:tasks.ceph.ceph_manager.cluster1:clean! 2021-11-21T03:49:11.480 INFO:tasks.ceph:Waiting until ceph cluster cluster1 is healthy... 2021-11-21T03:49:11.481 INFO:tasks.ceph.ceph_manager.cluster1:wait_until_healthy 2021-11-21T03:49:11.482 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 health --format=json 2021-11-21T03:49:11.701 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:11.711 INFO:teuthology.orchestra.run.gibba022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-11-21T03:49:11.711 INFO:tasks.ceph.ceph_manager.cluster1:wait_until_healthy done 2021-11-21T03:49:11.712 INFO:teuthology.run_tasks:Running task ceph... 2021-11-21T03:49:11.745 INFO:tasks.ceph:Creating ceph cluster cluster2... 2021-11-21T03:49:11.745 INFO:tasks.ceph:config {'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'cluster2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-11-21T03:49:11.747 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2021-11-18_06:00:03-rbd-octopus-distro-default-gibba/6511531', 'branch': 'octopus', 'description': 'rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6511531', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'gibba', 'meta': [{'desc': 'run two ceph clusters and install rbd-mirror'}, {'desc': 'configure the permissions for client.mirror'}, {'desc': '2 ceph clusters with 1 mon and 3 osds each'}, {'desc': 'run four rbd-mirror daemons per cluster'}, {'desc': 'run the rbd_mirror_stress.sh workunit to test the rbd-mirror daemon'}], 'name': 'teuthology-2021-11-18_06:00:03-rbd-octopus-distro-default-gibba', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'rhel', 'os_version': '8.3', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'octopus', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 1000, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'], ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6']], 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff', 'sleep_before_teardown': 0, 'suite': 'rbd', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff', 'targets': {'gibba022.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLxAEXjLpD4E/WZb3tl42Si4cfiZB0BFCFCmCGVeIAF9GDbeP8FPjEtUrzn4M+di0rRmJS82YtXSKHs52CYQFwNV5w+uWHMABbKMbUxNtXGYyBD9jdHijuz+z3An32XaLcWJZCbDaeaZLRjYBQkC/MqoL3vkwSNXxgOMNwYqai3gY6N5YlU+wof4cCRgDkOs+klbWKiJEedG8uTnOm9BbMDANtdtGfjVNvJt9fip+D5G7twr+wJhChpv9nshnIbRPh1eRGbgxIbQlVxrQQ2CedzX9PL8NFK59QHFHyhYqdOD859asCIGNgDWcIEXaC9euxMaEtQ2cl1Keh98k6Q1KlR4a7V6uCLiOid43XBex6GPl1BOuQ80Id3cDY3pr++lj4+FLZx03zU2kPmLWv7oAABAh1Q34iTMBd1eh2YxO5v/P/2t6uLivVzECiJ4MAMEK4d7hnbhLqpYRSd1LOCWKj4w2weOVFSU05XvB8kAW4W0BK8A+KHOt2y0iBEAuY70M=', 'gibba043.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZDWVZORVVcSG+wo1CCePocvjDxjTuvXsEfdDaPZ5saRH05achLVWhJHlKGIFhcg00SY9mg76RVwGOVNTbXBnaJe1WwsYFodmHpHksR+Ol0bVQyAcKP7XwmO17mwJnJ7PSp4yK16Wbh8T63Rtr+1ebkUbp++VYTKj5jmb6WNF9ieIthDFA8aSdL/w/VLZK96rKMnuHI/Pah3dIDHv1cbctxTzNvYOpbpAXpq8Fa+TozEuKlcUAIjnuuXZyvwiEL8LlSdU8uKJFzrDrN7uuMgyoGHqXiPIabRP8JPy+w9Az+M7gq2AAmAUlLoTV7ewVRTO5bH+6HrqNpsdnm5Ng3egM1TqDVf4YskxwncriLWu3ACqrGZQIcXbBV2ZmCIU1Wqtl47dTvYKGKt5AuLy7Hf18BH2qb2YDFyfIYmWJu/xUAoYlvMh4xM0LRDT7BNzHy8VM3rixQypwpxXzxT8IQWJ5BB2ZuMpBT+2aoMksfo2mNB24KUyJh47AY77wdCv1Y9M='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': ['rbd-mirror'], 'flavor': 'default', 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, {'ceph': {'cluster': 'cluster1', 'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, {'ceph': {'cluster': 'cluster2', 'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'}}, {'exec': {'cluster1.client.mirror.0': ["sudo ceph --cluster cluster1 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'"]}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.0', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.1', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.2', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.3', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.0', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.1', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.2', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.3', 'thrash': True}}, {'rbd-mirror-thrash': {'cluster': 'cluster1'}}, {'rbd-mirror-thrash': {'cluster': 'cluster2'}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/rbd_mirror_stress.sh']}, 'env': {'CEPH_ARGS': '', 'MIRROR_IMAGE_MODE': 'snapshot', 'MIRROR_POOL_MODE': 'image', 'RBD_IMAGE_FEATURES': 'layering,exclusive-lock,object-map,fast-diff', 'RBD_MIRROR_INSTANCES': '4', 'RBD_MIRROR_USE_EXISTING_CLUSTER': '1', 'RBD_MIRROR_USE_RBD_MIRROR': '1'}, 'timeout': '6h'}}], 'teuthology_branch': 'master', 'teuthology_sha1': '6cfddd5e1c7d5ede1367cf3087c21af44eb88356', 'timestamp': '2021-11-18_06:00:03', 'tube': 'gibba', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.gibba.19943'} 2021-11-21T03:49:11.750 DEBUG:teuthology.orchestra.run.gibba022:> install -d -m0755 -- /home/ubuntu/cephtest/cluster2.data 2021-11-21T03:49:11.754 DEBUG:teuthology.orchestra.run.gibba043:> install -d -m0755 -- /home/ubuntu/cephtest/cluster2.data 2021-11-21T03:49:11.768 DEBUG:teuthology.orchestra.run.gibba022:> sudo install -d -m0777 -- /var/run/ceph 2021-11-21T03:49:11.806 DEBUG:teuthology.orchestra.run.gibba043:> sudo install -d -m0777 -- /var/run/ceph 2021-11-21T03:49:11.830 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-11-21T03:49:11.830 DEBUG:teuthology.orchestra.run.gibba043:> dd if=/scratch_devs of=/dev/stdout 2021-11-21T03:49:11.881 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-11-21T03:49:11.881 DEBUG:teuthology.orchestra.run.gibba043:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-11-21T03:49:11.936 INFO:teuthology.orchestra.run.gibba043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-11-21T03:49:11.937 INFO:teuthology.orchestra.run.gibba043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-21T03:49:11.937 INFO:teuthology.orchestra.run.gibba043.stdout:Device: 6h/6d Inode: 106472 Links: 1 2021-11-21T03:49:11.937 INFO:teuthology.orchestra.run.gibba043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-21T03:49:11.938 INFO:teuthology.orchestra.run.gibba043.stdout:Context: system_u:object_r:device_t:s0 2021-11-21T03:49:11.938 INFO:teuthology.orchestra.run.gibba043.stdout:Access: 2021-11-21 03:48:00.841617029 +0000 2021-11-21T03:49:11.938 INFO:teuthology.orchestra.run.gibba043.stdout:Modify: 2021-11-21 03:41:23.589799821 +0000 2021-11-21T03:49:11.938 INFO:teuthology.orchestra.run.gibba043.stdout:Change: 2021-11-21 03:41:23.589799821 +0000 2021-11-21T03:49:11.939 INFO:teuthology.orchestra.run.gibba043.stdout: Birth: - 2021-11-21T03:49:11.940 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records in 2021-11-21T03:49:11.940 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records out 2021-11-21T03:49:11.940 INFO:teuthology.orchestra.run.gibba043.stderr:512 bytes copied, 0.000185953 s, 2.8 MB/s 2021-11-21T03:49:11.942 DEBUG:teuthology.orchestra.run.gibba043:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-11-21T03:49:11.995 INFO:teuthology.orchestra.run.gibba043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-11-21T03:49:11.995 INFO:teuthology.orchestra.run.gibba043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-21T03:49:11.995 INFO:teuthology.orchestra.run.gibba043.stdout:Device: 6h/6d Inode: 108224 Links: 1 2021-11-21T03:49:11.996 INFO:teuthology.orchestra.run.gibba043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-21T03:49:11.996 INFO:teuthology.orchestra.run.gibba043.stdout:Context: system_u:object_r:device_t:s0 2021-11-21T03:49:11.996 INFO:teuthology.orchestra.run.gibba043.stdout:Access: 2021-11-21 03:48:00.841617029 +0000 2021-11-21T03:49:11.996 INFO:teuthology.orchestra.run.gibba043.stdout:Modify: 2021-11-21 03:41:23.868798090 +0000 2021-11-21T03:49:11.996 INFO:teuthology.orchestra.run.gibba043.stdout:Change: 2021-11-21 03:41:23.868798090 +0000 2021-11-21T03:49:11.997 INFO:teuthology.orchestra.run.gibba043.stdout: Birth: - 2021-11-21T03:49:12.002 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records in 2021-11-21T03:49:12.003 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records out 2021-11-21T03:49:12.003 INFO:teuthology.orchestra.run.gibba043.stderr:512 bytes copied, 0.000158057 s, 3.2 MB/s 2021-11-21T03:49:12.004 DEBUG:teuthology.orchestra.run.gibba043:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-11-21T03:49:12.062 INFO:teuthology.orchestra.run.gibba043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-11-21T03:49:12.062 INFO:teuthology.orchestra.run.gibba043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-21T03:49:12.063 INFO:teuthology.orchestra.run.gibba043.stdout:Device: 6h/6d Inode: 116916 Links: 1 2021-11-21T03:49:12.063 INFO:teuthology.orchestra.run.gibba043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-21T03:49:12.064 INFO:teuthology.orchestra.run.gibba043.stdout:Context: system_u:object_r:device_t:s0 2021-11-21T03:49:12.064 INFO:teuthology.orchestra.run.gibba043.stdout:Access: 2021-11-21 03:48:00.841617029 +0000 2021-11-21T03:49:12.064 INFO:teuthology.orchestra.run.gibba043.stdout:Modify: 2021-11-21 03:41:24.173796197 +0000 2021-11-21T03:49:12.065 INFO:teuthology.orchestra.run.gibba043.stdout:Change: 2021-11-21 03:41:24.173796197 +0000 2021-11-21T03:49:12.065 INFO:teuthology.orchestra.run.gibba043.stdout: Birth: - 2021-11-21T03:49:12.069 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records in 2021-11-21T03:49:12.070 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records out 2021-11-21T03:49:12.071 INFO:teuthology.orchestra.run.gibba043.stderr:512 bytes copied, 0.000190358 s, 2.7 MB/s 2021-11-21T03:49:12.072 DEBUG:teuthology.orchestra.run.gibba043:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-11-21T03:49:12.124 INFO:teuthology.orchestra.run.gibba043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-11-21T03:49:12.124 INFO:teuthology.orchestra.run.gibba043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-21T03:49:12.125 INFO:teuthology.orchestra.run.gibba043.stdout:Device: 6h/6d Inode: 115293 Links: 1 2021-11-21T03:49:12.125 INFO:teuthology.orchestra.run.gibba043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-21T03:49:12.126 INFO:teuthology.orchestra.run.gibba043.stdout:Context: system_u:object_r:device_t:s0 2021-11-21T03:49:12.126 INFO:teuthology.orchestra.run.gibba043.stdout:Access: 2021-11-21 03:48:00.841617029 +0000 2021-11-21T03:49:12.126 INFO:teuthology.orchestra.run.gibba043.stdout:Modify: 2021-11-21 03:41:24.487794249 +0000 2021-11-21T03:49:12.127 INFO:teuthology.orchestra.run.gibba043.stdout:Change: 2021-11-21 03:41:24.487794249 +0000 2021-11-21T03:49:12.127 INFO:teuthology.orchestra.run.gibba043.stdout: Birth: - 2021-11-21T03:49:12.131 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records in 2021-11-21T03:49:12.132 INFO:teuthology.orchestra.run.gibba043.stderr:1+0 records out 2021-11-21T03:49:12.132 INFO:teuthology.orchestra.run.gibba043.stderr:512 bytes copied, 0.000165334 s, 3.1 MB/s 2021-11-21T03:49:12.134 INFO:tasks.ceph:osd dev map: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-21T03:49:12.135 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@gibba043.front.sepia.ceph.com'): {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-11-21T03:49:12.135 INFO:tasks.ceph:Generating config... 2021-11-21T03:49:12.137 INFO:tasks.ceph:[client] debug rbd = 20 2021-11-21T03:49:12.138 INFO:tasks.ceph:[client] debug rbd_mirror = 15 2021-11-21T03:49:12.138 INFO:tasks.ceph:[client] log to stderr = False 2021-11-21T03:49:12.139 INFO:tasks.ceph:[client] rbd default features = 125 2021-11-21T03:49:12.140 INFO:tasks.ceph:[client] rbd mirror image policy type = simple 2021-11-21T03:49:12.140 INFO:tasks.ceph:[client.mirror.0] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:49:12.141 INFO:tasks.ceph:[client.mirror.0] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:49:12.141 INFO:tasks.ceph:[client.mirror.1] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:49:12.141 INFO:tasks.ceph:[client.mirror.1] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:49:12.142 INFO:tasks.ceph:[client.mirror.2] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:49:12.142 INFO:tasks.ceph:[client.mirror.2] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:49:12.142 INFO:tasks.ceph:[client.mirror.3] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:49:12.143 INFO:tasks.ceph:[client.mirror.3] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:49:12.143 INFO:tasks.ceph:[global] mon client directed command retry = 5 2021-11-21T03:49:12.143 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2021-11-21T03:49:12.144 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-11-21T03:49:12.144 INFO:tasks.ceph:[mgr] debug ms = 1 2021-11-21T03:49:12.144 INFO:tasks.ceph:[mon] debug mon = 20 2021-11-21T03:49:12.145 INFO:tasks.ceph:[mon] debug ms = 1 2021-11-21T03:49:12.145 INFO:tasks.ceph:[mon] debug paxos = 20 2021-11-21T03:49:12.145 INFO:tasks.ceph:[osd] bdev async discard = True 2021-11-21T03:49:12.145 INFO:tasks.ceph:[osd] bdev enable discard = True 2021-11-21T03:49:12.146 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2021-11-21T03:49:12.146 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-11-21T03:49:12.146 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-11-21T03:49:12.147 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-11-21T03:49:12.147 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-11-21T03:49:12.147 INFO:tasks.ceph:[osd] debug ms = 1 2021-11-21T03:49:12.148 INFO:tasks.ceph:[osd] debug osd = 20 2021-11-21T03:49:12.148 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-11-21T03:49:12.148 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-11-21T03:49:12.148 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-11-21T03:49:12.149 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-11-21T03:49:12.149 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-11-21T03:49:12.149 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-11-21T03:49:12.150 INFO:tasks.ceph:Setting up cluster2.mon.a... 2021-11-21T03:49:12.150 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/cluster2.keyring 2021-11-21T03:49:12.202 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster2.keyring 2021-11-21T03:49:12.204 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/cluster2.keyring 2021-11-21T03:49:12.273 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod 0644 /etc/ceph/cluster2.keyring 2021-11-21T03:49:12.333 DEBUG:tasks.ceph:Ceph mon addresses: [('cluster2.mon.a', '172.21.2.143')] 2021-11-21T03:49:12.333 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.2.143 --print /home/ubuntu/cephtest/cluster2.monmap 2021-11-21T03:49:12.399 INFO:teuthology.orchestra.run.gibba043.stdout:monmaptool: monmap file /home/ubuntu/cephtest/cluster2.monmap 2021-11-21T03:49:12.399 INFO:teuthology.orchestra.run.gibba043.stdout:monmaptool: generated fsid 3cfc0544-020d-4e5b-8500-d522ef4891d9 2021-11-21T03:49:12.400 INFO:teuthology.orchestra.run.gibba043.stdout:epoch 0 2021-11-21T03:49:12.400 INFO:teuthology.orchestra.run.gibba043.stdout:fsid 3cfc0544-020d-4e5b-8500-d522ef4891d9 2021-11-21T03:49:12.401 INFO:teuthology.orchestra.run.gibba043.stdout:last_changed 2021-11-21T03:49:12.400633+0000 2021-11-21T03:49:12.401 INFO:teuthology.orchestra.run.gibba043.stdout:created 2021-11-21T03:49:12.400633+0000 2021-11-21T03:49:12.401 INFO:teuthology.orchestra.run.gibba043.stdout:min_mon_release 0 (unknown) 2021-11-21T03:49:12.402 INFO:teuthology.orchestra.run.gibba043.stdout:0: [v2:172.21.2.143:3300/0,v1:172.21.2.143:6789/0] mon.a 2021-11-21T03:49:12.402 INFO:teuthology.orchestra.run.gibba043.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/cluster2.monmap (1 monitors) 2021-11-21T03:49:12.403 INFO:tasks.ceph:Writing /etc/ceph/cluster2.conf for FSID 3cfc0544-020d-4e5b-8500-d522ef4891d9... 2021-11-21T03:49:12.405 DEBUG:teuthology.orchestra.run.gibba022:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster2.conf && sudo chmod 0644 /etc/ceph/cluster2.conf > /dev/null 2021-11-21T03:49:12.410 DEBUG:teuthology.orchestra.run.gibba043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster2.conf && sudo chmod 0644 /etc/ceph/cluster2.conf > /dev/null 2021-11-21T03:49:12.444 INFO:teuthology.orchestra.run.gibba022.stdout:[global] 2021-11-21T03:49:12.444 INFO:teuthology.orchestra.run.gibba022.stdout: chdir = "" 2021-11-21T03:49:12.445 INFO:teuthology.orchestra.run.gibba022.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-21T03:49:12.445 INFO:teuthology.orchestra.run.gibba022.stdout: auth supported = cephx 2021-11-21T03:49:12.448 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.448 INFO:teuthology.orchestra.run.gibba022.stdout: filestore xattr use omap = true 2021-11-21T03:49:12.448 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.448 INFO:teuthology.orchestra.run.gibba022.stdout: mon clock drift allowed = 1.000 2021-11-21T03:49:12.449 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.449 INFO:teuthology.orchestra.run.gibba022.stdout: osd crush chooseleaf type = 0 2021-11-21T03:49:12.449 INFO:teuthology.orchestra.run.gibba022.stdout: auth debug = true 2021-11-21T03:49:12.449 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.449 INFO:teuthology.orchestra.run.gibba022.stdout: ms die on old message = true 2021-11-21T03:49:12.450 INFO:teuthology.orchestra.run.gibba022.stdout: ms die on bug = true 2021-11-21T03:49:12.450 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.451 INFO:teuthology.orchestra.run.gibba022.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-21T03:49:12.451 INFO:teuthology.orchestra.run.gibba022.stdout: mon pg warn max object skew = 0 2021-11-21T03:49:12.451 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.452 INFO:teuthology.orchestra.run.gibba022.stdout: # disable pg_autoscaler by default for new pools 2021-11-21T03:49:12.452 INFO:teuthology.orchestra.run.gibba022.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-21T03:49:12.452 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.452 INFO:teuthology.orchestra.run.gibba022.stdout: osd pool default size = 2 2021-11-21T03:49:12.453 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.453 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd allow primary affinity = true 2021-11-21T03:49:12.453 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd allow pg remap = true 2021-11-21T03:49:12.454 INFO:teuthology.orchestra.run.gibba022.stdout: mon warn on legacy crush tunables = false 2021-11-21T03:49:12.455 INFO:teuthology.orchestra.run.gibba022.stdout: mon warn on crush straw calc version zero = false 2021-11-21T03:49:12.455 INFO:teuthology.orchestra.run.gibba022.stdout: mon warn on no sortbitwise = false 2021-11-21T03:49:12.455 INFO:teuthology.orchestra.run.gibba022.stdout: mon warn on osd down out interval zero = false 2021-11-21T03:49:12.456 INFO:teuthology.orchestra.run.gibba022.stdout: mon warn on too few osds = false 2021-11-21T03:49:12.456 INFO:teuthology.orchestra.run.gibba022.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-21T03:49:12.456 INFO:teuthology.orchestra.run.gibba022.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-21T03:49:12.456 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.457 INFO:teuthology.orchestra.run.gibba022.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-21T03:49:12.457 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.458 INFO:teuthology.orchestra.run.gibba022.stdout: osd default data pool replay window = 5 2021-11-21T03:49:12.458 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.458 INFO:teuthology.orchestra.run.gibba022.stdout: mon allow pool delete = true 2021-11-21T03:49:12.459 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.459 INFO:teuthology.orchestra.run.gibba022.stdout: mon cluster log file level = debug 2021-11-21T03:49:12.459 INFO:teuthology.orchestra.run.gibba022.stdout: debug asserts on shutdown = true 2021-11-21T03:49:12.459 INFO:teuthology.orchestra.run.gibba022.stdout: mon health detail to clog = false 2021-11-21T03:49:12.460 INFO:teuthology.orchestra.run.gibba022.stdout: mon host = 172.21.2.143 2021-11-21T03:49:12.460 INFO:teuthology.orchestra.run.gibba022.stdout: mon client directed command retry = 5 2021-11-21T03:49:12.461 INFO:teuthology.orchestra.run.gibba022.stdout: ms inject socket failures = 5000 2021-11-21T03:49:12.461 INFO:teuthology.orchestra.run.gibba022.stdout: fsid = 3cfc0544-020d-4e5b-8500-d522ef4891d9 2021-11-21T03:49:12.461 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.461 INFO:teuthology.orchestra.run.gibba022.stdout:[osd] 2021-11-21T03:49:12.462 INFO:teuthology.orchestra.run.gibba022.stdout: osd journal size = 100 2021-11-21T03:49:12.462 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.463 INFO:teuthology.orchestra.run.gibba022.stdout: osd scrub load threshold = 5.0 2021-11-21T03:49:12.463 INFO:teuthology.orchestra.run.gibba022.stdout: osd scrub max interval = 600 2021-11-21T03:49:12.463 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.463 INFO:teuthology.orchestra.run.gibba022.stdout: osd recover clone overlap = true 2021-11-21T03:49:12.464 INFO:teuthology.orchestra.run.gibba022.stdout: osd recovery max chunk = 1048576 2021-11-21T03:49:12.464 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.464 INFO:teuthology.orchestra.run.gibba022.stdout: osd debug shutdown = true 2021-11-21T03:49:12.464 INFO:teuthology.orchestra.run.gibba022.stdout: osd debug op order = true 2021-11-21T03:49:12.464 INFO:teuthology.orchestra.run.gibba022.stdout: osd debug verify stray on activate = true 2021-11-21T03:49:12.465 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.465 INFO:teuthology.orchestra.run.gibba022.stdout: osd open classes on start = true 2021-11-21T03:49:12.465 INFO:teuthology.orchestra.run.gibba022.stdout: osd debug pg log writeout = true 2021-11-21T03:49:12.465 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.466 INFO:teuthology.orchestra.run.gibba022.stdout: osd deep scrub update digest min age = 30 2021-11-21T03:49:12.466 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.466 INFO:teuthology.orchestra.run.gibba022.stdout: osd map max advance = 10 2021-11-21T03:49:12.466 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.466 INFO:teuthology.orchestra.run.gibba022.stdout: journal zero on create = true 2021-11-21T03:49:12.467 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.467 INFO:teuthology.orchestra.run.gibba022.stdout: filestore ondisk finisher threads = 3 2021-11-21T03:49:12.467 INFO:teuthology.orchestra.run.gibba022.stdout: filestore apply finisher threads = 3 2021-11-21T03:49:12.468 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.468 INFO:teuthology.orchestra.run.gibba022.stdout: bdev debug aio = true 2021-11-21T03:49:12.468 INFO:teuthology.orchestra.run.gibba022.stdout: osd debug misdirected ops = true 2021-11-21T03:49:12.468 INFO:teuthology.orchestra.run.gibba022.stdout: bdev async discard = True 2021-11-21T03:49:12.469 INFO:teuthology.orchestra.run.gibba022.stdout: bdev enable discard = True 2021-11-21T03:49:12.469 INFO:teuthology.orchestra.run.gibba022.stdout: bluestore allocator = stupid 2021-11-21T03:49:12.469 INFO:teuthology.orchestra.run.gibba022.stdout: bluestore block size = 96636764160 2021-11-21T03:49:12.469 INFO:teuthology.orchestra.run.gibba022.stdout: bluestore fsck on mount = True 2021-11-21T03:49:12.470 INFO:teuthology.orchestra.run.gibba022.stdout: debug bluefs = 20 2021-11-21T03:49:12.470 INFO:teuthology.orchestra.run.gibba022.stdout: debug bluestore = 20 2021-11-21T03:49:12.470 INFO:teuthology.orchestra.run.gibba022.stdout: debug ms = 1 2021-11-21T03:49:12.470 INFO:teuthology.orchestra.run.gibba022.stdout: debug osd = 20 2021-11-21T03:49:12.471 INFO:teuthology.orchestra.run.gibba022.stdout: debug rocksdb = 10 2021-11-21T03:49:12.472 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd backfillfull_ratio = 0.85 2021-11-21T03:49:12.472 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd full ratio = 0.9 2021-11-21T03:49:12.472 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd nearfull ratio = 0.8 2021-11-21T03:49:12.473 INFO:teuthology.orchestra.run.gibba022.stdout: osd failsafe full ratio = 0.95 2021-11-21T03:49:12.473 INFO:teuthology.orchestra.run.gibba022.stdout: osd objectstore = bluestore 2021-11-21T03:49:12.473 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.473 INFO:teuthology.orchestra.run.gibba022.stdout:[mgr] 2021-11-21T03:49:12.474 INFO:teuthology.orchestra.run.gibba022.stdout: debug ms = 1 2021-11-21T03:49:12.474 INFO:teuthology.orchestra.run.gibba022.stdout: debug mgr = 20 2021-11-21T03:49:12.474 INFO:teuthology.orchestra.run.gibba022.stdout: debug mon = 20 2021-11-21T03:49:12.474 INFO:teuthology.orchestra.run.gibba022.stdout: debug auth = 20 2021-11-21T03:49:12.475 INFO:teuthology.orchestra.run.gibba022.stdout: mon reweight min pgs per osd = 4 2021-11-21T03:49:12.475 INFO:teuthology.orchestra.run.gibba022.stdout: mon reweight min bytes per osd = 10 2021-11-21T03:49:12.475 INFO:teuthology.orchestra.run.gibba022.stdout: mgr/telemetry/nag = false 2021-11-21T03:49:12.475 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.475 INFO:teuthology.orchestra.run.gibba022.stdout:[mon] 2021-11-21T03:49:12.476 INFO:teuthology.orchestra.run.gibba022.stdout: debug ms = 1 2021-11-21T03:49:12.476 INFO:teuthology.orchestra.run.gibba022.stdout: debug mon = 20 2021-11-21T03:49:12.476 INFO:teuthology.orchestra.run.gibba022.stdout: debug paxos = 20 2021-11-21T03:49:12.476 INFO:teuthology.orchestra.run.gibba022.stdout: debug auth = 20 2021-11-21T03:49:12.477 INFO:teuthology.orchestra.run.gibba022.stdout: mon data avail warn = 5 2021-11-21T03:49:12.477 INFO:teuthology.orchestra.run.gibba022.stdout: mon mgr mkfs grace = 240 2021-11-21T03:49:12.477 INFO:teuthology.orchestra.run.gibba022.stdout: mon reweight min pgs per osd = 4 2021-11-21T03:49:12.477 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd reporter subtree level = osd 2021-11-21T03:49:12.477 INFO:teuthology.orchestra.run.gibba022.stdout: mon osd prime pg temp = true 2021-11-21T03:49:12.478 INFO:teuthology.orchestra.run.gibba022.stdout: mon reweight min bytes per osd = 10 2021-11-21T03:49:12.478 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.479 INFO:teuthology.orchestra.run.gibba022.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-21T03:49:12.479 INFO:teuthology.orchestra.run.gibba022.stdout: auth mon ticket ttl = 660 # 11m 2021-11-21T03:49:12.479 INFO:teuthology.orchestra.run.gibba022.stdout: auth service ticket ttl = 240 # 4m 2021-11-21T03:49:12.479 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.480 INFO:teuthology.orchestra.run.gibba022.stdout: # don't complain about insecure global_id in the test suite 2021-11-21T03:49:12.480 INFO:teuthology.orchestra.run.gibba022.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-21T03:49:12.480 INFO:teuthology.orchestra.run.gibba022.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-21T03:49:12.480 INFO:teuthology.orchestra.run.gibba022.stdout: 2021-11-21T03:49:12.480 INFO:teuthology.orchestra.run.gibba022.stdout:[client] 2021-11-21T03:49:12.481 INFO:teuthology.orchestra.run.gibba022.stdout: rgw cache enabled = true 2021-11-21T03:49:12.481 INFO:teuthology.orchestra.run.gibba022.stdout: rgw enable ops log = true 2021-11-21T03:49:12.482 INFO:teuthology.orchestra.run.gibba022.stdout: rgw enable usage log = true 2021-11-21T03:49:12.482 INFO:teuthology.orchestra.run.gibba022.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-21T03:49:12.482 INFO:teuthology.orchestra.run.gibba022.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-21T03:49:12.483 INFO:teuthology.orchestra.run.gibba022.stdout: debug rbd = 20 2021-11-21T03:49:12.483 INFO:teuthology.orchestra.run.gibba022.stdout: debug rbd_mirror = 15 2021-11-21T03:49:12.484 INFO:teuthology.orchestra.run.gibba022.stdout: log to stderr = False 2021-11-21T03:49:12.484 INFO:teuthology.orchestra.run.gibba022.stdout: rbd default features = 125 2021-11-21T03:49:12.484 INFO:teuthology.orchestra.run.gibba022.stdout: rbd mirror image policy type = simple 2021-11-21T03:49:12.484 INFO:teuthology.orchestra.run.gibba022.stdout:[mon.a] 2021-11-21T03:49:12.485 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.0] 2021-11-21T03:49:12.485 INFO:teuthology.orchestra.run.gibba022.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:49:12.485 INFO:teuthology.orchestra.run.gibba022.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:49:12.485 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.1] 2021-11-21T03:49:12.485 INFO:teuthology.orchestra.run.gibba022.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:49:12.486 INFO:teuthology.orchestra.run.gibba022.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:49:12.486 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.2] 2021-11-21T03:49:12.486 INFO:teuthology.orchestra.run.gibba022.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:49:12.486 INFO:teuthology.orchestra.run.gibba022.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:49:12.487 INFO:teuthology.orchestra.run.gibba022.stdout:[client.mirror.3] 2021-11-21T03:49:12.487 INFO:teuthology.orchestra.run.gibba022.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:49:12.488 INFO:teuthology.orchestra.run.gibba022.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:49:12.490 INFO:teuthology.orchestra.run.gibba043.stdout:[global] 2021-11-21T03:49:12.490 INFO:teuthology.orchestra.run.gibba043.stdout: chdir = "" 2021-11-21T03:49:12.491 INFO:teuthology.orchestra.run.gibba043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-21T03:49:12.491 INFO:teuthology.orchestra.run.gibba043.stdout: auth supported = cephx 2021-11-21T03:49:12.491 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.491 INFO:teuthology.orchestra.run.gibba043.stdout: filestore xattr use omap = true 2021-11-21T03:49:12.492 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.493 INFO:teuthology.orchestra.run.gibba043.stdout: mon clock drift allowed = 1.000 2021-11-21T03:49:12.493 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.493 INFO:teuthology.orchestra.run.gibba043.stdout: osd crush chooseleaf type = 0 2021-11-21T03:49:12.494 INFO:teuthology.orchestra.run.gibba043.stdout: auth debug = true 2021-11-21T03:49:12.494 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.494 INFO:teuthology.orchestra.run.gibba043.stdout: ms die on old message = true 2021-11-21T03:49:12.495 INFO:teuthology.orchestra.run.gibba043.stdout: ms die on bug = true 2021-11-21T03:49:12.495 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.495 INFO:teuthology.orchestra.run.gibba043.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-21T03:49:12.495 INFO:teuthology.orchestra.run.gibba043.stdout: mon pg warn max object skew = 0 2021-11-21T03:49:12.495 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.496 INFO:teuthology.orchestra.run.gibba043.stdout: # disable pg_autoscaler by default for new pools 2021-11-21T03:49:12.496 INFO:teuthology.orchestra.run.gibba043.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-21T03:49:12.496 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.497 INFO:teuthology.orchestra.run.gibba043.stdout: osd pool default size = 2 2021-11-21T03:49:12.497 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.498 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd allow primary affinity = true 2021-11-21T03:49:12.498 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd allow pg remap = true 2021-11-21T03:49:12.498 INFO:teuthology.orchestra.run.gibba043.stdout: mon warn on legacy crush tunables = false 2021-11-21T03:49:12.498 INFO:teuthology.orchestra.run.gibba043.stdout: mon warn on crush straw calc version zero = false 2021-11-21T03:49:12.498 INFO:teuthology.orchestra.run.gibba043.stdout: mon warn on no sortbitwise = false 2021-11-21T03:49:12.499 INFO:teuthology.orchestra.run.gibba043.stdout: mon warn on osd down out interval zero = false 2021-11-21T03:49:12.499 INFO:teuthology.orchestra.run.gibba043.stdout: mon warn on too few osds = false 2021-11-21T03:49:12.499 INFO:teuthology.orchestra.run.gibba043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-21T03:49:12.499 INFO:teuthology.orchestra.run.gibba043.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-21T03:49:12.500 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.500 INFO:teuthology.orchestra.run.gibba043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-21T03:49:12.500 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.500 INFO:teuthology.orchestra.run.gibba043.stdout: osd default data pool replay window = 5 2021-11-21T03:49:12.500 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.501 INFO:teuthology.orchestra.run.gibba043.stdout: mon allow pool delete = true 2021-11-21T03:49:12.501 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.501 INFO:teuthology.orchestra.run.gibba043.stdout: mon cluster log file level = debug 2021-11-21T03:49:12.501 INFO:teuthology.orchestra.run.gibba043.stdout: debug asserts on shutdown = true 2021-11-21T03:49:12.501 INFO:teuthology.orchestra.run.gibba043.stdout: mon health detail to clog = false 2021-11-21T03:49:12.502 INFO:teuthology.orchestra.run.gibba043.stdout: mon host = 172.21.2.143 2021-11-21T03:49:12.502 INFO:teuthology.orchestra.run.gibba043.stdout: mon client directed command retry = 5 2021-11-21T03:49:12.503 INFO:teuthology.orchestra.run.gibba043.stdout: ms inject socket failures = 5000 2021-11-21T03:49:12.503 INFO:teuthology.orchestra.run.gibba043.stdout: fsid = 3cfc0544-020d-4e5b-8500-d522ef4891d9 2021-11-21T03:49:12.503 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.503 INFO:teuthology.orchestra.run.gibba043.stdout:[osd] 2021-11-21T03:49:12.503 INFO:teuthology.orchestra.run.gibba043.stdout: osd journal size = 100 2021-11-21T03:49:12.504 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.505 INFO:teuthology.orchestra.run.gibba043.stdout: osd scrub load threshold = 5.0 2021-11-21T03:49:12.505 INFO:teuthology.orchestra.run.gibba043.stdout: osd scrub max interval = 600 2021-11-21T03:49:12.505 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.506 INFO:teuthology.orchestra.run.gibba043.stdout: osd recover clone overlap = true 2021-11-21T03:49:12.506 INFO:teuthology.orchestra.run.gibba043.stdout: osd recovery max chunk = 1048576 2021-11-21T03:49:12.506 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.506 INFO:teuthology.orchestra.run.gibba043.stdout: osd debug shutdown = true 2021-11-21T03:49:12.507 INFO:teuthology.orchestra.run.gibba043.stdout: osd debug op order = true 2021-11-21T03:49:12.507 INFO:teuthology.orchestra.run.gibba043.stdout: osd debug verify stray on activate = true 2021-11-21T03:49:12.507 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.507 INFO:teuthology.orchestra.run.gibba043.stdout: osd open classes on start = true 2021-11-21T03:49:12.507 INFO:teuthology.orchestra.run.gibba043.stdout: osd debug pg log writeout = true 2021-11-21T03:49:12.508 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.508 INFO:teuthology.orchestra.run.gibba043.stdout: osd deep scrub update digest min age = 30 2021-11-21T03:49:12.508 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.508 INFO:teuthology.orchestra.run.gibba043.stdout: osd map max advance = 10 2021-11-21T03:49:12.508 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.509 INFO:teuthology.orchestra.run.gibba043.stdout: journal zero on create = true 2021-11-21T03:49:12.509 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.509 INFO:teuthology.orchestra.run.gibba043.stdout: filestore ondisk finisher threads = 3 2021-11-21T03:49:12.509 INFO:teuthology.orchestra.run.gibba043.stdout: filestore apply finisher threads = 3 2021-11-21T03:49:12.510 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.510 INFO:teuthology.orchestra.run.gibba043.stdout: bdev debug aio = true 2021-11-21T03:49:12.510 INFO:teuthology.orchestra.run.gibba043.stdout: osd debug misdirected ops = true 2021-11-21T03:49:12.510 INFO:teuthology.orchestra.run.gibba043.stdout: bdev async discard = True 2021-11-21T03:49:12.510 INFO:teuthology.orchestra.run.gibba043.stdout: bdev enable discard = True 2021-11-21T03:49:12.511 INFO:teuthology.orchestra.run.gibba043.stdout: bluestore allocator = stupid 2021-11-21T03:49:12.511 INFO:teuthology.orchestra.run.gibba043.stdout: bluestore block size = 96636764160 2021-11-21T03:49:12.511 INFO:teuthology.orchestra.run.gibba043.stdout: bluestore fsck on mount = True 2021-11-21T03:49:12.511 INFO:teuthology.orchestra.run.gibba043.stdout: debug bluefs = 20 2021-11-21T03:49:12.512 INFO:teuthology.orchestra.run.gibba043.stdout: debug bluestore = 20 2021-11-21T03:49:12.512 INFO:teuthology.orchestra.run.gibba043.stdout: debug ms = 1 2021-11-21T03:49:12.512 INFO:teuthology.orchestra.run.gibba043.stdout: debug osd = 20 2021-11-21T03:49:12.513 INFO:teuthology.orchestra.run.gibba043.stdout: debug rocksdb = 10 2021-11-21T03:49:12.513 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd backfillfull_ratio = 0.85 2021-11-21T03:49:12.513 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd full ratio = 0.9 2021-11-21T03:49:12.513 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd nearfull ratio = 0.8 2021-11-21T03:49:12.513 INFO:teuthology.orchestra.run.gibba043.stdout: osd failsafe full ratio = 0.95 2021-11-21T03:49:12.514 INFO:teuthology.orchestra.run.gibba043.stdout: osd objectstore = bluestore 2021-11-21T03:49:12.514 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.514 INFO:teuthology.orchestra.run.gibba043.stdout:[mgr] 2021-11-21T03:49:12.515 INFO:teuthology.orchestra.run.gibba043.stdout: debug ms = 1 2021-11-21T03:49:12.515 INFO:teuthology.orchestra.run.gibba043.stdout: debug mgr = 20 2021-11-21T03:49:12.515 INFO:teuthology.orchestra.run.gibba043.stdout: debug mon = 20 2021-11-21T03:49:12.515 INFO:teuthology.orchestra.run.gibba043.stdout: debug auth = 20 2021-11-21T03:49:12.516 INFO:teuthology.orchestra.run.gibba043.stdout: mon reweight min pgs per osd = 4 2021-11-21T03:49:12.516 INFO:teuthology.orchestra.run.gibba043.stdout: mon reweight min bytes per osd = 10 2021-11-21T03:49:12.516 INFO:teuthology.orchestra.run.gibba043.stdout: mgr/telemetry/nag = false 2021-11-21T03:49:12.516 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.517 INFO:teuthology.orchestra.run.gibba043.stdout:[mon] 2021-11-21T03:49:12.517 INFO:teuthology.orchestra.run.gibba043.stdout: debug ms = 1 2021-11-21T03:49:12.517 INFO:teuthology.orchestra.run.gibba043.stdout: debug mon = 20 2021-11-21T03:49:12.517 INFO:teuthology.orchestra.run.gibba043.stdout: debug paxos = 20 2021-11-21T03:49:12.517 INFO:teuthology.orchestra.run.gibba043.stdout: debug auth = 20 2021-11-21T03:49:12.518 INFO:teuthology.orchestra.run.gibba043.stdout: mon data avail warn = 5 2021-11-21T03:49:12.518 INFO:teuthology.orchestra.run.gibba043.stdout: mon mgr mkfs grace = 240 2021-11-21T03:49:12.518 INFO:teuthology.orchestra.run.gibba043.stdout: mon reweight min pgs per osd = 4 2021-11-21T03:49:12.518 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd reporter subtree level = osd 2021-11-21T03:49:12.519 INFO:teuthology.orchestra.run.gibba043.stdout: mon osd prime pg temp = true 2021-11-21T03:49:12.519 INFO:teuthology.orchestra.run.gibba043.stdout: mon reweight min bytes per osd = 10 2021-11-21T03:49:12.519 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.519 INFO:teuthology.orchestra.run.gibba043.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-21T03:49:12.519 INFO:teuthology.orchestra.run.gibba043.stdout: auth mon ticket ttl = 660 # 11m 2021-11-21T03:49:12.520 INFO:teuthology.orchestra.run.gibba043.stdout: auth service ticket ttl = 240 # 4m 2021-11-21T03:49:12.520 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.520 INFO:teuthology.orchestra.run.gibba043.stdout: # don't complain about insecure global_id in the test suite 2021-11-21T03:49:12.520 INFO:teuthology.orchestra.run.gibba043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-21T03:49:12.520 INFO:teuthology.orchestra.run.gibba043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-21T03:49:12.521 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:12.521 INFO:teuthology.orchestra.run.gibba043.stdout:[client] 2021-11-21T03:49:12.521 INFO:teuthology.orchestra.run.gibba043.stdout: rgw cache enabled = true 2021-11-21T03:49:12.521 INFO:teuthology.orchestra.run.gibba043.stdout: rgw enable ops log = true 2021-11-21T03:49:12.522 INFO:teuthology.orchestra.run.gibba043.stdout: rgw enable usage log = true 2021-11-21T03:49:12.522 INFO:teuthology.orchestra.run.gibba043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-21T03:49:12.522 INFO:teuthology.orchestra.run.gibba043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-21T03:49:12.522 INFO:teuthology.orchestra.run.gibba043.stdout: debug rbd = 20 2021-11-21T03:49:12.522 INFO:teuthology.orchestra.run.gibba043.stdout: debug rbd_mirror = 15 2021-11-21T03:49:12.523 INFO:teuthology.orchestra.run.gibba043.stdout: log to stderr = False 2021-11-21T03:49:12.523 INFO:teuthology.orchestra.run.gibba043.stdout: rbd default features = 125 2021-11-21T03:49:12.524 INFO:teuthology.orchestra.run.gibba043.stdout: rbd mirror image policy type = simple 2021-11-21T03:49:12.524 INFO:teuthology.orchestra.run.gibba043.stdout:[mon.a] 2021-11-21T03:49:12.524 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.0] 2021-11-21T03:49:12.524 INFO:teuthology.orchestra.run.gibba043.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:49:12.525 INFO:teuthology.orchestra.run.gibba043.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:49:12.525 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.1] 2021-11-21T03:49:12.526 INFO:teuthology.orchestra.run.gibba043.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:49:12.526 INFO:teuthology.orchestra.run.gibba043.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:49:12.526 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.2] 2021-11-21T03:49:12.526 INFO:teuthology.orchestra.run.gibba043.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:49:12.526 INFO:teuthology.orchestra.run.gibba043.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:49:12.527 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.3] 2021-11-21T03:49:12.527 INFO:teuthology.orchestra.run.gibba043.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-21T03:49:12.527 INFO:teuthology.orchestra.run.gibba043.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-21T03:49:12.528 INFO:tasks.ceph:Creating admin key on cluster2.mon.a... 2021-11-21T03:49:12.528 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/cluster2.keyring 2021-11-21T03:49:12.572 INFO:tasks.ceph:Copying monmap to all nodes... 2021-11-21T03:49:12.627 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster2.keyring is 206B 2021-11-21T03:49:12.729 DEBUG:teuthology.orchestra.remote:gibba043:/home/ubuntu/cephtest/cluster2.monmap is 179B 2021-11-21T03:49:12.781 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba022.front.sepia.ceph.com 2021-11-21T03:49:12.781 DEBUG:teuthology.orchestra.run.gibba022:> set -ex 2021-11-21T03:49:12.782 DEBUG:teuthology.orchestra.run.gibba022:> sudo dd of=/etc/ceph/cluster2.keyring 2021-11-21T03:49:12.782 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod 0644 /etc/ceph/cluster2.keyring 2021-11-21T03:49:12.810 DEBUG:teuthology.orchestra.run.gibba022:> set -ex 2021-11-21T03:49:12.811 DEBUG:teuthology.orchestra.run.gibba022:> dd of=/home/ubuntu/cephtest/cluster2.monmap 2021-11-21T03:49:12.863 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba043.front.sepia.ceph.com 2021-11-21T03:49:12.864 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-11-21T03:49:12.864 DEBUG:teuthology.orchestra.run.gibba043:> sudo dd of=/etc/ceph/cluster2.keyring 2021-11-21T03:49:12.864 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod 0644 /etc/ceph/cluster2.keyring 2021-11-21T03:49:12.894 DEBUG:teuthology.orchestra.run.gibba043:> set -ex 2021-11-21T03:49:12.894 DEBUG:teuthology.orchestra.run.gibba043:> dd of=/home/ubuntu/cephtest/cluster2.monmap 2021-11-21T03:49:12.946 INFO:tasks.ceph:Setting up mon nodes... 2021-11-21T03:49:12.947 INFO:tasks.ceph:Setting up mgr nodes... 2021-11-21T03:49:12.948 DEBUG:teuthology.orchestra.run.gibba022:> sudo mkdir -p /var/lib/ceph/mgr/cluster2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/cluster2-x/keyring 2021-11-21T03:49:12.985 INFO:teuthology.orchestra.run.gibba022.stdout:creating /var/lib/ceph/mgr/cluster2-x/keyring 2021-11-21T03:49:12.987 INFO:tasks.ceph:Setting up mds nodes... 2021-11-21T03:49:12.987 INFO:tasks.ceph_client:Setting up client nodes... 2021-11-21T03:49:12.988 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/cluster2.client.0.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.0.keyring 2021-11-21T03:49:13.055 INFO:teuthology.orchestra.run.gibba022.stdout:creating /etc/ceph/cluster2.client.0.keyring 2021-11-21T03:49:13.065 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror /etc/ceph/cluster2.client.mirror.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.keyring 2021-11-21T03:49:13.100 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster2.client.mirror.keyring 2021-11-21T03:49:13.109 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.0 /etc/ceph/cluster2.client.mirror.0.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.0.keyring 2021-11-21T03:49:13.178 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster2.client.mirror.0.keyring 2021-11-21T03:49:13.187 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.1 /etc/ceph/cluster2.client.mirror.1.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.1.keyring 2021-11-21T03:49:13.255 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster2.client.mirror.1.keyring 2021-11-21T03:49:13.264 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.2 /etc/ceph/cluster2.client.mirror.2.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.2.keyring 2021-11-21T03:49:13.332 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster2.client.mirror.2.keyring 2021-11-21T03:49:13.341 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.3 /etc/ceph/cluster2.client.mirror.3.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.3.keyring 2021-11-21T03:49:13.409 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster2.client.mirror.3.keyring 2021-11-21T03:49:13.418 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.4 /etc/ceph/cluster2.client.mirror.4.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.4.keyring 2021-11-21T03:49:13.488 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster2.client.mirror.4.keyring 2021-11-21T03:49:13.497 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.5 /etc/ceph/cluster2.client.mirror.5.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.5.keyring 2021-11-21T03:49:13.565 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster2.client.mirror.5.keyring 2021-11-21T03:49:13.575 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.6 /etc/ceph/cluster2.client.mirror.6.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.6.keyring 2021-11-21T03:49:13.644 INFO:teuthology.orchestra.run.gibba043.stdout:creating /etc/ceph/cluster2.client.mirror.6.keyring 2021-11-21T03:49:13.654 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-11-21T03:49:13.654 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@gibba022.front.sepia.ceph.com'): {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@gibba043.front.sepia.ceph.com'): {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-11-21T03:49:13.655 DEBUG:teuthology.orchestra.run.gibba043:> sudo mkdir -p /var/lib/ceph/osd/cluster2-0 2021-11-21T03:49:13.713 INFO:tasks.ceph:roles_to_devs: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-21T03:49:13.714 INFO:tasks.ceph:role: cluster2.osd.0 2021-11-21T03:49:13.714 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba043.front.sepia.ceph.com 2021-11-21T03:49:13.715 DEBUG:teuthology.orchestra.run.gibba043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-11-21T03:49:13.772 INFO:teuthology.orchestra.run.gibba043.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-11-21T03:49:13.773 INFO:teuthology.orchestra.run.gibba043.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-21T03:49:13.773 INFO:teuthology.orchestra.run.gibba043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-21T03:49:13.773 INFO:teuthology.orchestra.run.gibba043.stdout: = reflink=1 2021-11-21T03:49:13.773 INFO:teuthology.orchestra.run.gibba043.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-21T03:49:13.774 INFO:teuthology.orchestra.run.gibba043.stdout: = sunit=0 swidth=0 blks 2021-11-21T03:49:13.774 INFO:teuthology.orchestra.run.gibba043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-21T03:49:13.774 INFO:teuthology.orchestra.run.gibba043.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-21T03:49:13.774 INFO:teuthology.orchestra.run.gibba043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-21T03:49:13.775 INFO:teuthology.orchestra.run.gibba043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-21T03:49:13.795 INFO:teuthology.orchestra.run.gibba043.stdout:Discarding blocks...Done. 2021-11-21T03:49:13.796 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba043.front.sepia.ceph.com -o noatime 2021-11-21T03:49:13.797 DEBUG:teuthology.orchestra.run.gibba043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/cluster2-0 2021-11-21T03:49:13.869 DEBUG:teuthology.orchestra.run.gibba043:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-0 2021-11-21T03:49:13.931 DEBUG:teuthology.orchestra.run.gibba043:> sudo mkdir -p /var/lib/ceph/osd/cluster2-1 2021-11-21T03:49:13.989 INFO:tasks.ceph:roles_to_devs: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-21T03:49:13.990 INFO:tasks.ceph:role: cluster2.osd.1 2021-11-21T03:49:13.990 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba043.front.sepia.ceph.com 2021-11-21T03:49:13.991 DEBUG:teuthology.orchestra.run.gibba043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-11-21T03:49:14.048 INFO:teuthology.orchestra.run.gibba043.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-11-21T03:49:14.049 INFO:teuthology.orchestra.run.gibba043.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-21T03:49:14.049 INFO:teuthology.orchestra.run.gibba043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-21T03:49:14.049 INFO:teuthology.orchestra.run.gibba043.stdout: = reflink=1 2021-11-21T03:49:14.050 INFO:teuthology.orchestra.run.gibba043.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-21T03:49:14.050 INFO:teuthology.orchestra.run.gibba043.stdout: = sunit=0 swidth=0 blks 2021-11-21T03:49:14.050 INFO:teuthology.orchestra.run.gibba043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-21T03:49:14.050 INFO:teuthology.orchestra.run.gibba043.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-21T03:49:14.051 INFO:teuthology.orchestra.run.gibba043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-21T03:49:14.051 INFO:teuthology.orchestra.run.gibba043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-21T03:49:14.072 INFO:teuthology.orchestra.run.gibba043.stdout:Discarding blocks...Done. 2021-11-21T03:49:14.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba043.front.sepia.ceph.com -o noatime 2021-11-21T03:49:14.073 DEBUG:teuthology.orchestra.run.gibba043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/cluster2-1 2021-11-21T03:49:14.146 DEBUG:teuthology.orchestra.run.gibba043:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-1 2021-11-21T03:49:14.208 DEBUG:teuthology.orchestra.run.gibba043:> sudo mkdir -p /var/lib/ceph/osd/cluster2-2 2021-11-21T03:49:14.267 INFO:tasks.ceph:roles_to_devs: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-21T03:49:14.268 INFO:tasks.ceph:role: cluster2.osd.2 2021-11-21T03:49:14.268 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba043.front.sepia.ceph.com 2021-11-21T03:49:14.268 DEBUG:teuthology.orchestra.run.gibba043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-11-21T03:49:14.327 INFO:teuthology.orchestra.run.gibba043.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-11-21T03:49:14.327 INFO:teuthology.orchestra.run.gibba043.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-21T03:49:14.327 INFO:teuthology.orchestra.run.gibba043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-21T03:49:14.328 INFO:teuthology.orchestra.run.gibba043.stdout: = reflink=1 2021-11-21T03:49:14.328 INFO:teuthology.orchestra.run.gibba043.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-21T03:49:14.328 INFO:teuthology.orchestra.run.gibba043.stdout: = sunit=0 swidth=0 blks 2021-11-21T03:49:14.328 INFO:teuthology.orchestra.run.gibba043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-21T03:49:14.328 INFO:teuthology.orchestra.run.gibba043.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-21T03:49:14.329 INFO:teuthology.orchestra.run.gibba043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-21T03:49:14.329 INFO:teuthology.orchestra.run.gibba043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-21T03:49:14.351 INFO:teuthology.orchestra.run.gibba043.stdout:Discarding blocks...Done. 2021-11-21T03:49:14.352 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba043.front.sepia.ceph.com -o noatime 2021-11-21T03:49:14.352 DEBUG:teuthology.orchestra.run.gibba043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/cluster2-2 2021-11-21T03:49:14.425 DEBUG:teuthology.orchestra.run.gibba043:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-2 2021-11-21T03:49:14.487 DEBUG:teuthology.orchestra.run.gibba043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/cluster2.monmap 2021-11-21T03:49:14.558 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:14.559+0000 7f2fb5718f00 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-0/keyring: can't open /var/lib/ceph/osd/cluster2-0/keyring: (2) No such file or directory 2021-11-21T03:49:14.558 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:14.559+0000 7f2fb5718f00 -1 created new key in keyring /var/lib/ceph/osd/cluster2-0/keyring 2021-11-21T03:49:14.558 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:14.559+0000 7f2fb5718f00 -1 bluestore(/var/lib/ceph/osd/cluster2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-0/block: (2) No such file or directory 2021-11-21T03:49:14.559 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:14.559+0000 7f2fb5718f00 -1 bluestore(/var/lib/ceph/osd/cluster2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-0/block: (2) No such file or directory 2021-11-21T03:49:14.559 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:14.559+0000 7f2fb5718f00 -1 bluestore(/var/lib/ceph/osd/cluster2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-0/block: (2) No such file or directory 2021-11-21T03:49:14.559 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:14.560+0000 7f2fb5718f00 -1 bluestore(/var/lib/ceph/osd/cluster2-0) _read_fsid unparsable uuid 2021-11-21T03:49:14.563 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:14.565+0000 7f2fb5718f00 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-21T03:49:16.918 DEBUG:teuthology.orchestra.run.gibba043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-0 2021-11-21T03:49:16.980 DEBUG:teuthology.orchestra.run.gibba043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/cluster2.monmap 2021-11-21T03:49:17.051 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:17.053+0000 7fb6785a4f00 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-1/keyring: can't open /var/lib/ceph/osd/cluster2-1/keyring: (2) No such file or directory 2021-11-21T03:49:17.052 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:17.053+0000 7fb6785a4f00 -1 created new key in keyring /var/lib/ceph/osd/cluster2-1/keyring 2021-11-21T03:49:17.052 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:17.053+0000 7fb6785a4f00 -1 bluestore(/var/lib/ceph/osd/cluster2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-1/block: (2) No such file or directory 2021-11-21T03:49:17.052 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:17.053+0000 7fb6785a4f00 -1 bluestore(/var/lib/ceph/osd/cluster2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-1/block: (2) No such file or directory 2021-11-21T03:49:17.052 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:17.053+0000 7fb6785a4f00 -1 bluestore(/var/lib/ceph/osd/cluster2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-1/block: (2) No such file or directory 2021-11-21T03:49:17.053 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:17.053+0000 7fb6785a4f00 -1 bluestore(/var/lib/ceph/osd/cluster2-1) _read_fsid unparsable uuid 2021-11-21T03:49:17.057 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:17.059+0000 7fb6785a4f00 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-21T03:49:19.391 DEBUG:teuthology.orchestra.run.gibba043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-1 2021-11-21T03:49:19.450 DEBUG:teuthology.orchestra.run.gibba043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/cluster2.monmap 2021-11-21T03:49:19.520 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:19.521+0000 7f9995ea2f00 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-2/keyring: can't open /var/lib/ceph/osd/cluster2-2/keyring: (2) No such file or directory 2021-11-21T03:49:19.520 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:19.521+0000 7f9995ea2f00 -1 created new key in keyring /var/lib/ceph/osd/cluster2-2/keyring 2021-11-21T03:49:19.520 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:19.521+0000 7f9995ea2f00 -1 bluestore(/var/lib/ceph/osd/cluster2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-2/block: (2) No such file or directory 2021-11-21T03:49:19.521 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:19.521+0000 7f9995ea2f00 -1 bluestore(/var/lib/ceph/osd/cluster2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-2/block: (2) No such file or directory 2021-11-21T03:49:19.521 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:19.521+0000 7f9995ea2f00 -1 bluestore(/var/lib/ceph/osd/cluster2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-2/block: (2) No such file or directory 2021-11-21T03:49:19.521 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:19.522+0000 7f9995ea2f00 -1 bluestore(/var/lib/ceph/osd/cluster2-2) _read_fsid unparsable uuid 2021-11-21T03:49:19.525 INFO:teuthology.orchestra.run.gibba043.stderr:2021-11-21T03:49:19.527+0000 7f9995ea2f00 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-21T03:49:21.861 DEBUG:teuthology.orchestra.run.gibba043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-2 2021-11-21T03:49:21.923 INFO:tasks.ceph:Reading keys from all nodes... 2021-11-21T03:49:21.923 DEBUG:teuthology.orchestra.run.gibba022:> mktemp 2021-11-21T03:49:21.936 INFO:teuthology.orchestra.run.gibba022.stdout:/tmp/tmp.V93g5FuoGk 2021-11-21T03:49:21.936 DEBUG:teuthology.orchestra.run.gibba022:> sudo cp /var/lib/ceph/mgr/cluster2-x/keyring /tmp/tmp.V93g5FuoGk 2021-11-21T03:49:21.994 DEBUG:teuthology.orchestra.run.gibba022:> sudo chmod 0666 /tmp/tmp.V93g5FuoGk 2021-11-21T03:49:22.110 DEBUG:teuthology.orchestra.remote:gibba022:/tmp/tmp.V93g5FuoGk is 56B 2021-11-21T03:49:22.161 DEBUG:teuthology.orchestra.run.gibba022:> rm -fr /tmp/tmp.V93g5FuoGk 2021-11-21T03:49:22.173 DEBUG:teuthology.orchestra.run.gibba043:> mktemp 2021-11-21T03:49:22.186 INFO:teuthology.orchestra.run.gibba043.stdout:/tmp/tmp.lS3vOVTtN2 2021-11-21T03:49:22.186 DEBUG:teuthology.orchestra.run.gibba043:> sudo cp /var/lib/ceph/osd/cluster2-0/keyring /tmp/tmp.lS3vOVTtN2 2021-11-21T03:49:22.245 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod 0666 /tmp/tmp.lS3vOVTtN2 2021-11-21T03:49:22.360 DEBUG:teuthology.orchestra.remote:gibba043:/tmp/tmp.lS3vOVTtN2 is 56B 2021-11-21T03:49:22.409 DEBUG:teuthology.orchestra.run.gibba043:> rm -fr /tmp/tmp.lS3vOVTtN2 2021-11-21T03:49:22.420 DEBUG:teuthology.orchestra.run.gibba043:> mktemp 2021-11-21T03:49:22.470 INFO:teuthology.orchestra.run.gibba043.stdout:/tmp/tmp.WSq09rePnm 2021-11-21T03:49:22.471 DEBUG:teuthology.orchestra.run.gibba043:> sudo cp /var/lib/ceph/osd/cluster2-1/keyring /tmp/tmp.WSq09rePnm 2021-11-21T03:49:22.529 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod 0666 /tmp/tmp.WSq09rePnm 2021-11-21T03:49:22.643 DEBUG:teuthology.orchestra.remote:gibba043:/tmp/tmp.WSq09rePnm is 56B 2021-11-21T03:49:22.696 DEBUG:teuthology.orchestra.run.gibba043:> rm -fr /tmp/tmp.WSq09rePnm 2021-11-21T03:49:22.709 DEBUG:teuthology.orchestra.run.gibba043:> mktemp 2021-11-21T03:49:22.760 INFO:teuthology.orchestra.run.gibba043.stdout:/tmp/tmp.H4VnY1ei2y 2021-11-21T03:49:22.761 DEBUG:teuthology.orchestra.run.gibba043:> sudo cp /var/lib/ceph/osd/cluster2-2/keyring /tmp/tmp.H4VnY1ei2y 2021-11-21T03:49:22.820 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod 0666 /tmp/tmp.H4VnY1ei2y 2021-11-21T03:49:22.934 DEBUG:teuthology.orchestra.remote:gibba043:/tmp/tmp.H4VnY1ei2y is 56B 2021-11-21T03:49:22.985 DEBUG:teuthology.orchestra.run.gibba043:> rm -fr /tmp/tmp.H4VnY1ei2y 2021-11-21T03:49:23.011 DEBUG:teuthology.orchestra.remote:gibba022:/etc/ceph/cluster2.client.0.keyring is 59B 2021-11-21T03:49:23.075 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster2.client.mirror.keyring is 64B 2021-11-21T03:49:23.140 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster2.client.mirror.0.keyring is 66B 2021-11-21T03:49:23.240 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster2.client.mirror.1.keyring is 66B 2021-11-21T03:49:23.337 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster2.client.mirror.2.keyring is 66B 2021-11-21T03:49:23.436 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster2.client.mirror.3.keyring is 66B 2021-11-21T03:49:23.535 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster2.client.mirror.4.keyring is 66B 2021-11-21T03:49:23.631 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster2.client.mirror.5.keyring is 66B 2021-11-21T03:49:23.733 DEBUG:teuthology.orchestra.remote:gibba043:/etc/ceph/cluster2.client.mirror.6.keyring is 66B 2021-11-21T03:49:23.783 INFO:tasks.ceph:Adding keys to all mons... 2021-11-21T03:49:23.783 DEBUG:teuthology.orchestra.run.gibba043:> sudo tee -a /etc/ceph/cluster2.keyring 2021-11-21T03:49:23.828 INFO:teuthology.orchestra.run.gibba043.stdout:[mgr.x] 2021-11-21T03:49:23.828 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQC4wZlhYmrmOhAA8tuSXvlS/hBsA/wYqOFi4A== 2021-11-21T03:49:23.829 INFO:teuthology.orchestra.run.gibba043.stdout:[osd.0] 2021-11-21T03:49:23.829 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQC6wZlhI7FrIRAAI7azbs1nFTK+/ZV8rPTjyQ== 2021-11-21T03:49:23.829 INFO:teuthology.orchestra.run.gibba043.stdout:[osd.1] 2021-11-21T03:49:23.829 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQC9wZlhvZM8AxAA1gE5zjdyb2pc0ie6t7e/+w== 2021-11-21T03:49:23.830 INFO:teuthology.orchestra.run.gibba043.stdout:[osd.2] 2021-11-21T03:49:23.830 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQC/wZlhJaknHxAAJCh/hql17OB0vIIsXwMi2w== 2021-11-21T03:49:23.830 INFO:teuthology.orchestra.run.gibba043.stdout:[client.0] 2021-11-21T03:49:23.830 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQC5wZlhJrF6AxAAuWQDbt2NW5MTrUl2DlUSEg== 2021-11-21T03:49:23.831 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror] 2021-11-21T03:49:23.831 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQC5wZlhxrcmBhAAPeGaxRpDLI7ZVRYYggb1+Q== 2021-11-21T03:49:23.831 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.0] 2021-11-21T03:49:23.831 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQC5wZlhAaDNChAApX4f3qX4DKeKU/fOd3Douw== 2021-11-21T03:49:23.831 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.1] 2021-11-21T03:49:23.832 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQC5wZlhZGdmDxAAZjrgVoUwI/FANgam77AG8w== 2021-11-21T03:49:23.832 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.2] 2021-11-21T03:49:23.832 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQC5wZlhknv+ExAADObhXIrml3Qu3MIqp5sD2w== 2021-11-21T03:49:23.832 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.3] 2021-11-21T03:49:23.833 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQC5wZlhOImQGBAAQfCRg9hUuUyAnUBOcfci8Q== 2021-11-21T03:49:23.833 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.4] 2021-11-21T03:49:23.833 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQC5wZlhQaVBHRAAYK42KuzsrBBd6uWFEtlscw== 2021-11-21T03:49:23.833 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.5] 2021-11-21T03:49:23.833 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQC5wZlhiCfmIRAAVcDYMdWpIMcKJE8azuIBwA== 2021-11-21T03:49:23.834 INFO:teuthology.orchestra.run.gibba043.stdout:[client.mirror.6] 2021-11-21T03:49:23.834 INFO:teuthology.orchestra.run.gibba043.stdout: key = AQC5wZlhVq2PJhAAErUrA8GqqWbdoAvChrqhjw== 2021-11-21T03:49:23.836 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-21T03:49:23.910 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-21T03:49:23.985 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-21T03:49:24.060 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-21T03:49:24.135 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:49:24.212 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:49:24.288 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:49:24.365 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:49:24.448 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:49:24.526 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:49:24.603 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.4 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:49:24.680 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.5 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:49:24.757 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.6 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-21T03:49:24.834 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-11-21T03:49:24.835 DEBUG:teuthology.orchestra.run.gibba043:> sudo mkdir -p /var/lib/ceph/mon/cluster2-a 2021-11-21T03:49:24.894 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster cluster2 --mkfs -i a --monmap /home/ubuntu/cephtest/cluster2.monmap --keyring /etc/ceph/cluster2.keyring 2021-11-21T03:49:24.975 DEBUG:teuthology.orchestra.run.gibba043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/cluster2-a 2021-11-21T03:49:25.039 DEBUG:teuthology.orchestra.run.gibba043:> rm -- /home/ubuntu/cephtest/cluster2.monmap 2021-11-21T03:49:25.092 INFO:tasks.ceph:Starting mon daemons in cluster cluster2... 2021-11-21T03:49:25.093 INFO:tasks.ceph.cluster2.mon.a:Restarting daemon 2021-11-21T03:49:25.094 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster cluster2 -i a 2021-11-21T03:49:25.135 INFO:tasks.ceph.cluster2.mon.a:Started 2021-11-21T03:49:25.136 INFO:tasks.ceph:Starting mgr daemons in cluster cluster2... 2021-11-21T03:49:25.136 INFO:tasks.ceph.cluster2.mgr.x:Restarting daemon 2021-11-21T03:49:25.136 DEBUG:teuthology.orchestra.run.gibba022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster cluster2 -i x 2021-11-21T03:49:25.140 INFO:tasks.ceph.cluster2.mgr.x:Started 2021-11-21T03:49:25.140 INFO:tasks.ceph:Setting crush tunables to default 2021-11-21T03:49:25.141 DEBUG:teuthology.orchestra.run.gibba043:> sudo ceph --cluster cluster2 osd crush tunables default 2021-11-21T03:49:25.275 INFO:teuthology.orchestra.run.gibba043.stderr:adjusted tunables profile to default 2021-11-21T03:49:25.283 INFO:tasks.ceph:Starting osd daemons in cluster cluster2... 2021-11-21T03:49:25.284 DEBUG:teuthology.orchestra.run.gibba043:> mktemp 2021-11-21T03:49:25.296 INFO:teuthology.orchestra.run.gibba043.stdout:/tmp/tmp.2gw6QBfMPh 2021-11-21T03:49:25.297 DEBUG:teuthology.orchestra.run.gibba043:> sudo cp /var/lib/ceph/osd/cluster2-0/fsid /tmp/tmp.2gw6QBfMPh 2021-11-21T03:49:25.356 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod 0666 /tmp/tmp.2gw6QBfMPh 2021-11-21T03:49:25.520 DEBUG:teuthology.orchestra.remote:gibba043:/tmp/tmp.2gw6QBfMPh is 37B 2021-11-21T03:49:25.593 DEBUG:teuthology.orchestra.run.gibba043:> rm -fr /tmp/tmp.2gw6QBfMPh 2021-11-21T03:49:25.617 DEBUG:teuthology.orchestra.run.gibba043:> mktemp 2021-11-21T03:49:25.681 INFO:teuthology.orchestra.run.gibba043.stdout:/tmp/tmp.PhZY98ayCg 2021-11-21T03:49:25.682 DEBUG:teuthology.orchestra.run.gibba043:> sudo cp /var/lib/ceph/osd/cluster2-1/fsid /tmp/tmp.PhZY98ayCg 2021-11-21T03:49:25.745 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod 0666 /tmp/tmp.PhZY98ayCg 2021-11-21T03:49:25.883 DEBUG:teuthology.orchestra.remote:gibba043:/tmp/tmp.PhZY98ayCg is 37B 2021-11-21T03:49:25.911 DEBUG:teuthology.orchestra.run.gibba043:> rm -fr /tmp/tmp.PhZY98ayCg 2021-11-21T03:49:25.926 DEBUG:teuthology.orchestra.run.gibba043:> mktemp 2021-11-21T03:49:25.981 INFO:teuthology.orchestra.run.gibba043.stdout:/tmp/tmp.cPI4yk1l3p 2021-11-21T03:49:25.982 DEBUG:teuthology.orchestra.run.gibba043:> sudo cp /var/lib/ceph/osd/cluster2-2/fsid /tmp/tmp.cPI4yk1l3p 2021-11-21T03:49:26.042 DEBUG:teuthology.orchestra.run.gibba043:> sudo chmod 0666 /tmp/tmp.cPI4yk1l3p 2021-11-21T03:49:26.165 DEBUG:teuthology.orchestra.remote:gibba043:/tmp/tmp.cPI4yk1l3p is 37B 2021-11-21T03:49:26.215 DEBUG:teuthology.orchestra.run.gibba043:> rm -fr /tmp/tmp.cPI4yk1l3p 2021-11-21T03:49:26.226 DEBUG:teuthology.orchestra.run.gibba043:> sudo ceph --cluster cluster2 osd new 3d036e95-d872-42f7-89d9-9e0c745d69ee 0 2021-11-21T03:49:26.404 INFO:teuthology.orchestra.run.gibba043.stdout:0 2021-11-21T03:49:26.412 DEBUG:teuthology.orchestra.run.gibba043:> sudo ceph --cluster cluster2 osd new 1005eb03-7c07-46ef-adcb-74b6c646af02 1 2021-11-21T03:49:26.549 INFO:teuthology.orchestra.run.gibba043.stdout:1 2021-11-21T03:49:26.559 DEBUG:teuthology.orchestra.run.gibba043:> sudo ceph --cluster cluster2 osd new 5e925b75-a733-4fe9-9b49-9c0afd8dc727 2 2021-11-21T03:49:26.698 INFO:teuthology.orchestra.run.gibba043.stdout:2 2021-11-21T03:49:26.706 INFO:tasks.ceph.cluster2.osd.0:Restarting daemon 2021-11-21T03:49:26.707 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 0 2021-11-21T03:49:26.709 INFO:tasks.ceph.cluster2.osd.0:Started 2021-11-21T03:49:26.710 INFO:tasks.ceph.cluster2.osd.1:Restarting daemon 2021-11-21T03:49:26.710 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 1 2021-11-21T03:49:26.712 INFO:tasks.ceph.cluster2.osd.1:Started 2021-11-21T03:49:26.713 INFO:tasks.ceph.cluster2.osd.2:Restarting daemon 2021-11-21T03:49:26.713 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 2 2021-11-21T03:49:26.715 INFO:tasks.ceph.cluster2.osd.2:Started 2021-11-21T03:49:26.715 INFO:tasks.ceph:Waiting for OSDs to come up 2021-11-21T03:49:27.018 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster2 osd dump --format=json 2021-11-21T03:49:27.140 INFO:teuthology.misc.health.gibba043.stdout: 2021-11-21T03:49:27.140 INFO:teuthology.misc.health.gibba043.stdout:{"epoch":5,"fsid":"3cfc0544-020d-4e5b-8500-d522ef4891d9","created":"2021-11-21T03:49:25.211869+0000","modified":"2021-11-21T03:49:26.699505+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"3d036e95-d872-42f7-89d9-9e0c745d69ee","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1005eb03-7c07-46ef-adcb-74b6c646af02","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5e925b75-a733-4fe9-9b49-9c0afd8dc727","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-21T03:49:27.147 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-11-21T03:49:27.277 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:2021-11-21T03:49:27.279+0000 7f73f7b92f00 -1 Falling back to public interface 2021-11-21T03:49:27.290 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:2021-11-21T03:49:27.291+0000 7ff422434f00 -1 Falling back to public interface 2021-11-21T03:49:27.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T03:49:27.291+0000 7f6bb131ef00 -1 Falling back to public interface 2021-11-21T03:49:28.355 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:2021-11-21T03:49:28.357+0000 7f73f7b92f00 -1 osd.0 0 log_to_monitors {default=true} 2021-11-21T03:49:28.373 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:2021-11-21T03:49:28.375+0000 7ff422434f00 -1 osd.1 0 log_to_monitors {default=true} 2021-11-21T03:49:28.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T03:49:28.377+0000 7f6bb131ef00 -1 osd.2 0 log_to_monitors {default=true} 2021-11-21T03:49:30.284 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:2021-11-21T03:49:30.285+0000 7ff40a92a700 -1 osd.1 0 waiting for initial osdmap 2021-11-21T03:49:30.285 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:2021-11-21T03:49:30.285+0000 7f73e0088700 -1 osd.0 0 waiting for initial osdmap 2021-11-21T03:49:30.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T03:49:30.286+0000 7f6b99814700 -1 osd.2 0 waiting for initial osdmap 2021-11-21T03:49:30.286 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:2021-11-21T03:49:30.288+0000 7ff416347700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-21T03:49:30.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T03:49:30.288+0000 7f6ba5231700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-21T03:49:30.288 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:2021-11-21T03:49:30.288+0000 7f73ebaa5700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-21T03:49:33.451 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster2 osd dump --format=json 2021-11-21T03:49:33.627 INFO:teuthology.misc.health.gibba043.stdout: 2021-11-21T03:49:33.627 INFO:teuthology.misc.health.gibba043.stdout:{"epoch":11,"fsid":"3cfc0544-020d-4e5b-8500-d522ef4891d9","created":"2021-11-21T03:49:25.211869+0000","modified":"2021-11-21T03:49:33.292466+0000","last_up_change":"2021-11-21T03:49:31.283309+0000","last_in_change":"2021-11-21T03:49:31.283309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-21T03:49:27.294703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"3d036e95-d872-42f7-89d9-9e0c745d69ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6800","nonce":29172},{"type":"v1","addr":"172.21.2.143:6801","nonce":29172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6802","nonce":29172},{"type":"v1","addr":"172.21.2.143:6803","nonce":29172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6806","nonce":29172},{"type":"v1","addr":"172.21.2.143:6807","nonce":29172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6804","nonce":29172},{"type":"v1","addr":"172.21.2.143:6805","nonce":29172}]},"public_addr":"172.21.2.143:6801/29172","cluster_addr":"172.21.2.143:6803/29172","heartbeat_back_addr":"172.21.2.143:6807/29172","heartbeat_front_addr":"172.21.2.143:6805/29172","state":["exists","up"]},{"osd":1,"uuid":"1005eb03-7c07-46ef-adcb-74b6c646af02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6809","nonce":29173},{"type":"v1","addr":"172.21.2.143:6811","nonce":29173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6813","nonce":29173},{"type":"v1","addr":"172.21.2.143:6814","nonce":29173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6820","nonce":29173},{"type":"v1","addr":"172.21.2.143:6822","nonce":29173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6816","nonce":29173},{"type":"v1","addr":"172.21.2.143:6818","nonce":29173}]},"public_addr":"172.21.2.143:6811/29173","cluster_addr":"172.21.2.143:6814/29173","heartbeat_back_addr":"172.21.2.143:6822/29173","heartbeat_front_addr":"172.21.2.143:6818/29173","state":["exists","up"]},{"osd":2,"uuid":"5e925b75-a733-4fe9-9b49-9c0afd8dc727","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6808","nonce":29174},{"type":"v1","addr":"172.21.2.143:6810","nonce":29174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6812","nonce":29174},{"type":"v1","addr":"172.21.2.143:6815","nonce":29174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6821","nonce":29174},{"type":"v1","addr":"172.21.2.143:6823","nonce":29174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6817","nonce":29174},{"type":"v1","addr":"172.21.2.143:6819","nonce":29174}]},"public_addr":"172.21.2.143:6810/29174","cluster_addr":"172.21.2.143:6815/29174","heartbeat_back_addr":"172.21.2.143:6823/29174","heartbeat_front_addr":"172.21.2.143:6819/29174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:29.352353+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:29.369920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:29.422284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-21T03:49:33.635 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-11-21T03:49:33.635 INFO:tasks.ceph:Creating RBD pool 2021-11-21T03:49:33.636 DEBUG:teuthology.orchestra.run.gibba043:> sudo ceph --cluster cluster2 osd pool create rbd 8 2021-11-21T03:49:34.297 INFO:teuthology.orchestra.run.gibba043.stderr:pool 'rbd' created 2021-11-21T03:49:34.305 DEBUG:teuthology.orchestra.run.gibba043:> sudo ceph --cluster cluster2 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-11-21T03:49:35.300 INFO:teuthology.orchestra.run.gibba043.stderr:enabled application 'rbd' on pool 'rbd' 2021-11-21T03:49:35.307 INFO:tasks.ceph:Starting mds daemons in cluster cluster2... 2021-11-21T03:49:35.308 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2021-11-21T03:49:35.309 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-11-21T03:49:35.490 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:35.491 INFO:teuthology.orchestra.run.gibba043.stdout:{"epoch":13,"fsid":"3cfc0544-020d-4e5b-8500-d522ef4891d9","created":"2021-11-21T03:49:25.211869+0000","modified":"2021-11-21T03:49:35.297728+0000","last_up_change":"2021-11-21T03:49:31.283309+0000","last_in_change":"2021-11-21T03:49:31.283309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-21T03:49:27.294703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-21T03:49:33.839618+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3d036e95-d872-42f7-89d9-9e0c745d69ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6800","nonce":29172},{"type":"v1","addr":"172.21.2.143:6801","nonce":29172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6802","nonce":29172},{"type":"v1","addr":"172.21.2.143:6803","nonce":29172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6806","nonce":29172},{"type":"v1","addr":"172.21.2.143:6807","nonce":29172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6804","nonce":29172},{"type":"v1","addr":"172.21.2.143:6805","nonce":29172}]},"public_addr":"172.21.2.143:6801/29172","cluster_addr":"172.21.2.143:6803/29172","heartbeat_back_addr":"172.21.2.143:6807/29172","heartbeat_front_addr":"172.21.2.143:6805/29172","state":["exists","up"]},{"osd":1,"uuid":"1005eb03-7c07-46ef-adcb-74b6c646af02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6809","nonce":29173},{"type":"v1","addr":"172.21.2.143:6811","nonce":29173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6813","nonce":29173},{"type":"v1","addr":"172.21.2.143:6814","nonce":29173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6820","nonce":29173},{"type":"v1","addr":"172.21.2.143:6822","nonce":29173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6816","nonce":29173},{"type":"v1","addr":"172.21.2.143:6818","nonce":29173}]},"public_addr":"172.21.2.143:6811/29173","cluster_addr":"172.21.2.143:6814/29173","heartbeat_back_addr":"172.21.2.143:6822/29173","heartbeat_front_addr":"172.21.2.143:6818/29173","state":["exists","up"]},{"osd":2,"uuid":"5e925b75-a733-4fe9-9b49-9c0afd8dc727","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6808","nonce":29174},{"type":"v1","addr":"172.21.2.143:6810","nonce":29174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6812","nonce":29174},{"type":"v1","addr":"172.21.2.143:6815","nonce":29174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6821","nonce":29174},{"type":"v1","addr":"172.21.2.143:6823","nonce":29174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6817","nonce":29174},{"type":"v1","addr":"172.21.2.143:6819","nonce":29174}]},"public_addr":"172.21.2.143:6810/29174","cluster_addr":"172.21.2.143:6815/29174","heartbeat_back_addr":"172.21.2.143:6823/29174","heartbeat_front_addr":"172.21.2.143:6819/29174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:29.352353+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:29.369920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:29.422284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-21T03:49:35.500 INFO:tasks.ceph.ceph_manager.cluster2:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-21T03:49:27.294703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-21T03:49:33.839618+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-21T03:49:35.500 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd pool get device_health_metrics pg_num 2021-11-21T03:49:35.681 INFO:teuthology.orchestra.run.gibba043.stdout:pg_num: 1 2021-11-21T03:49:35.691 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd pool get rbd pg_num 2021-11-21T03:49:35.875 INFO:teuthology.orchestra.run.gibba043.stdout:pg_num: 8 2021-11-21T03:49:35.884 INFO:tasks.ceph:Waiting until cluster2 daemons up and pgs clean... 2021-11-21T03:49:35.884 INFO:tasks.ceph.ceph_manager.cluster2:waiting for mgr available 2021-11-21T03:49:35.885 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 mgr dump --format=json 2021-11-21T03:49:36.090 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:36.098 INFO:teuthology.orchestra.run.gibba043.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.122:6826","nonce":30125},{"type":"v1","addr":"172.21.2.122:6827","nonce":30125}]},"active_addr":"172.21.2.122:6827/30125","active_change":"2021-11-21T03:49:27.274411+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.122:0","nonce":2722119959}]},{"addrvec":[{"type":"v2","addr":"172.21.2.122:0","nonce":388663510}]},{"addrvec":[{"type":"v2","addr":"172.21.2.122:0","nonce":2510603848}]}]}} 2021-11-21T03:49:36.100 INFO:tasks.ceph.ceph_manager.cluster2:mgr available! 2021-11-21T03:49:36.101 INFO:tasks.ceph.ceph_manager.cluster2:waiting for all up 2021-11-21T03:49:36.101 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2021-11-21T03:49:36.282 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:36.282 INFO:teuthology.orchestra.run.gibba043.stdout:{"epoch":13,"fsid":"3cfc0544-020d-4e5b-8500-d522ef4891d9","created":"2021-11-21T03:49:25.211869+0000","modified":"2021-11-21T03:49:35.297728+0000","last_up_change":"2021-11-21T03:49:31.283309+0000","last_in_change":"2021-11-21T03:49:31.283309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-21T03:49:27.294703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-21T03:49:33.839618+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3d036e95-d872-42f7-89d9-9e0c745d69ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6800","nonce":29172},{"type":"v1","addr":"172.21.2.143:6801","nonce":29172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6802","nonce":29172},{"type":"v1","addr":"172.21.2.143:6803","nonce":29172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6806","nonce":29172},{"type":"v1","addr":"172.21.2.143:6807","nonce":29172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6804","nonce":29172},{"type":"v1","addr":"172.21.2.143:6805","nonce":29172}]},"public_addr":"172.21.2.143:6801/29172","cluster_addr":"172.21.2.143:6803/29172","heartbeat_back_addr":"172.21.2.143:6807/29172","heartbeat_front_addr":"172.21.2.143:6805/29172","state":["exists","up"]},{"osd":1,"uuid":"1005eb03-7c07-46ef-adcb-74b6c646af02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6809","nonce":29173},{"type":"v1","addr":"172.21.2.143:6811","nonce":29173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6813","nonce":29173},{"type":"v1","addr":"172.21.2.143:6814","nonce":29173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6820","nonce":29173},{"type":"v1","addr":"172.21.2.143:6822","nonce":29173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6816","nonce":29173},{"type":"v1","addr":"172.21.2.143:6818","nonce":29173}]},"public_addr":"172.21.2.143:6811/29173","cluster_addr":"172.21.2.143:6814/29173","heartbeat_back_addr":"172.21.2.143:6822/29173","heartbeat_front_addr":"172.21.2.143:6818/29173","state":["exists","up"]},{"osd":2,"uuid":"5e925b75-a733-4fe9-9b49-9c0afd8dc727","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6808","nonce":29174},{"type":"v1","addr":"172.21.2.143:6810","nonce":29174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6812","nonce":29174},{"type":"v1","addr":"172.21.2.143:6815","nonce":29174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6821","nonce":29174},{"type":"v1","addr":"172.21.2.143:6823","nonce":29174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6817","nonce":29174},{"type":"v1","addr":"172.21.2.143:6819","nonce":29174}]},"public_addr":"172.21.2.143:6810/29174","cluster_addr":"172.21.2.143:6815/29174","heartbeat_back_addr":"172.21.2.143:6823/29174","heartbeat_front_addr":"172.21.2.143:6819/29174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:29.352353+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:29.369920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:29.422284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-21T03:49:36.291 INFO:tasks.ceph.ceph_manager.cluster2:all up! 2021-11-21T03:49:36.292 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2021-11-21T03:49:36.472 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:36.473 INFO:teuthology.orchestra.run.gibba043.stdout:{"epoch":14,"fsid":"3cfc0544-020d-4e5b-8500-d522ef4891d9","created":"2021-11-21T03:49:25.211869+0000","modified":"2021-11-21T03:49:36.299789+0000","last_up_change":"2021-11-21T03:49:31.283309+0000","last_in_change":"2021-11-21T03:49:31.283309+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-21T03:49:27.294703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-21T03:49:33.839618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3d036e95-d872-42f7-89d9-9e0c745d69ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6800","nonce":29172},{"type":"v1","addr":"172.21.2.143:6801","nonce":29172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6802","nonce":29172},{"type":"v1","addr":"172.21.2.143:6803","nonce":29172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6806","nonce":29172},{"type":"v1","addr":"172.21.2.143:6807","nonce":29172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6804","nonce":29172},{"type":"v1","addr":"172.21.2.143:6805","nonce":29172}]},"public_addr":"172.21.2.143:6801/29172","cluster_addr":"172.21.2.143:6803/29172","heartbeat_back_addr":"172.21.2.143:6807/29172","heartbeat_front_addr":"172.21.2.143:6805/29172","state":["exists","up"]},{"osd":1,"uuid":"1005eb03-7c07-46ef-adcb-74b6c646af02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6809","nonce":29173},{"type":"v1","addr":"172.21.2.143:6811","nonce":29173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6813","nonce":29173},{"type":"v1","addr":"172.21.2.143:6814","nonce":29173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6820","nonce":29173},{"type":"v1","addr":"172.21.2.143:6822","nonce":29173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6816","nonce":29173},{"type":"v1","addr":"172.21.2.143:6818","nonce":29173}]},"public_addr":"172.21.2.143:6811/29173","cluster_addr":"172.21.2.143:6814/29173","heartbeat_back_addr":"172.21.2.143:6822/29173","heartbeat_front_addr":"172.21.2.143:6818/29173","state":["exists","up"]},{"osd":2,"uuid":"5e925b75-a733-4fe9-9b49-9c0afd8dc727","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6808","nonce":29174},{"type":"v1","addr":"172.21.2.143:6810","nonce":29174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6812","nonce":29174},{"type":"v1","addr":"172.21.2.143:6815","nonce":29174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6821","nonce":29174},{"type":"v1","addr":"172.21.2.143:6823","nonce":29174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.143:6817","nonce":29174},{"type":"v1","addr":"172.21.2.143:6819","nonce":29174}]},"public_addr":"172.21.2.143:6810/29174","cluster_addr":"172.21.2.143:6815/29174","heartbeat_back_addr":"172.21.2.143:6823/29174","heartbeat_front_addr":"172.21.2.143:6819/29174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:29.352353+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:29.369920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-21T03:49:29.422284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-21T03:49:36.481 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.0 flush_pg_stats 2021-11-21T03:49:36.581 INFO:teuthology.orchestra.run.gibba043.stdout:38654705666 2021-11-21T03:49:36.581 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.1 flush_pg_stats 2021-11-21T03:49:36.682 INFO:teuthology.orchestra.run.gibba043.stdout:38654705667 2021-11-21T03:49:36.683 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.2 flush_pg_stats 2021-11-21T03:49:36.784 INFO:teuthology.orchestra.run.gibba043.stdout:38654705668 2021-11-21T03:49:36.785 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.0 2021-11-21T03:49:36.966 INFO:teuthology.orchestra.run.gibba043.stdout:38654705665 2021-11-21T03:49:36.975 INFO:tasks.ceph.ceph_manager.cluster2:need seq 38654705666 got 38654705665 for osd.0 2021-11-21T03:49:37.977 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.0 2021-11-21T03:49:38.157 INFO:teuthology.orchestra.run.gibba043.stdout:38654705666 2021-11-21T03:49:38.166 INFO:tasks.ceph.ceph_manager.cluster2:need seq 38654705666 got 38654705666 for osd.0 2021-11-21T03:49:38.167 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.1 2021-11-21T03:49:38.352 INFO:teuthology.orchestra.run.gibba043.stdout:38654705667 2021-11-21T03:49:38.361 INFO:tasks.ceph.ceph_manager.cluster2:need seq 38654705667 got 38654705667 for osd.1 2021-11-21T03:49:38.362 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.2 2021-11-21T03:49:38.544 INFO:teuthology.orchestra.run.gibba043.stdout:38654705668 2021-11-21T03:49:38.553 INFO:tasks.ceph.ceph_manager.cluster2:need seq 38654705668 got 38654705668 for osd.2 2021-11-21T03:49:38.554 INFO:tasks.ceph.ceph_manager.cluster2:waiting for clean 2021-11-21T03:49:38.554 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2021-11-21T03:49:38.737 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:38.738 INFO:teuthology.orchestra.run.gibba043.stderr:dumped all 2021-11-21T03:49:38.744 INFO:teuthology.orchestra.run.gibba043.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-11-21T03:49:37.279724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146088,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969432,"statfs":{"total":289910292480,"available":286688698368,"internally_reserved":3221225472,"allocated":344064,"data_stored":97455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.304368+0000","last_change":"2021-11-21T03:49:35.303785+0000","last_active":"2021-11-21T03:49:35.304368+0000","last_peered":"2021-11-21T03:49:35.304368+0000","last_clean":"2021-11-21T03:49:35.304368+0000","last_became_active":"2021-11-21T03:49:35.303343+0000","last_became_peered":"2021-11-21T03:49:35.303343+0000","last_unstale":"2021-11-21T03:49:35.304368+0000","last_undegraded":"2021-11-21T03:49:35.304368+0000","last_fullsized":"2021-11-21T03:49:35.304368+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.304355+0000","last_change":"2021-11-21T03:49:35.303760+0000","last_active":"2021-11-21T03:49:35.304355+0000","last_peered":"2021-11-21T03:49:35.304355+0000","last_clean":"2021-11-21T03:49:35.304355+0000","last_became_active":"2021-11-21T03:49:35.303374+0000","last_became_peered":"2021-11-21T03:49:35.303374+0000","last_unstale":"2021-11-21T03:49:35.304355+0000","last_undegraded":"2021-11-21T03:49:35.304355+0000","last_fullsized":"2021-11-21T03:49:35.304355+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.304010+0000","last_change":"2021-11-21T03:49:35.303325+0000","last_active":"2021-11-21T03:49:35.304010+0000","last_peered":"2021-11-21T03:49:35.304010+0000","last_clean":"2021-11-21T03:49:35.304010+0000","last_became_active":"2021-11-21T03:49:35.303009+0000","last_became_peered":"2021-11-21T03:49:35.303009+0000","last_unstale":"2021-11-21T03:49:35.304010+0000","last_undegraded":"2021-11-21T03:49:35.304010+0000","last_fullsized":"2021-11-21T03:49:35.304010+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.303375+0000","last_change":"2021-11-21T03:49:35.303375+0000","last_active":"2021-11-21T03:49:35.303375+0000","last_peered":"2021-11-21T03:49:35.303375+0000","last_clean":"2021-11-21T03:49:35.303375+0000","last_became_active":"2021-11-21T03:49:35.303133+0000","last_became_peered":"2021-11-21T03:49:35.303133+0000","last_unstale":"2021-11-21T03:49:35.303375+0000","last_undegraded":"2021-11-21T03:49:35.303375+0000","last_fullsized":"2021-11-21T03:49:35.303375+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'1","reported_seq":13,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.302514+0000","last_change":"2021-11-21T03:49:32.511488+0000","last_active":"2021-11-21T03:49:35.302514+0000","last_peered":"2021-11-21T03:49:35.302514+0000","last_clean":"2021-11-21T03:49:35.302514+0000","last_became_active":"2021-11-21T03:49:32.511148+0000","last_became_peered":"2021-11-21T03:49:32.511148+0000","last_unstale":"2021-11-21T03:49:35.302514+0000","last_undegraded":"2021-11-21T03:49:35.302514+0000","last_fullsized":"2021-11-21T03:49:35.302514+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:28.275764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:28.275764+0000","last_clean_scrub_stamp":"2021-11-21T03:49:28.275764+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.303995+0000","last_change":"2021-11-21T03:49:35.303252+0000","last_active":"2021-11-21T03:49:35.303995+0000","last_peered":"2021-11-21T03:49:35.303995+0000","last_clean":"2021-11-21T03:49:35.303995+0000","last_became_active":"2021-11-21T03:49:35.302949+0000","last_became_peered":"2021-11-21T03:49:35.302949+0000","last_unstale":"2021-11-21T03:49:35.303995+0000","last_undegraded":"2021-11-21T03:49:35.303995+0000","last_fullsized":"2021-11-21T03:49:35.303995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.303793+0000","last_change":"2021-11-21T03:49:35.303793+0000","last_active":"2021-11-21T03:49:35.303793+0000","last_peered":"2021-11-21T03:49:35.303793+0000","last_clean":"2021-11-21T03:49:35.303793+0000","last_became_active":"2021-11-21T03:49:35.303600+0000","last_became_peered":"2021-11-21T03:49:35.303600+0000","last_unstale":"2021-11-21T03:49:35.303793+0000","last_undegraded":"2021-11-21T03:49:35.303793+0000","last_fullsized":"2021-11-21T03:49:35.303793+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.303540+0000","last_change":"2021-11-21T03:49:35.303540+0000","last_active":"2021-11-21T03:49:35.303540+0000","last_peered":"2021-11-21T03:49:35.303540+0000","last_clean":"2021-11-21T03:49:35.303540+0000","last_became_active":"2021-11-21T03:49:35.303298+0000","last_became_peered":"2021-11-21T03:49:35.303298+0000","last_unstale":"2021-11-21T03:49:35.303540+0000","last_undegraded":"2021-11-21T03:49:35.303540+0000","last_fullsized":"2021-11-21T03:49:35.303540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.304005+0000","last_change":"2021-11-21T03:49:35.303286+0000","last_active":"2021-11-21T03:49:35.304005+0000","last_peered":"2021-11-21T03:49:35.304005+0000","last_clean":"2021-11-21T03:49:35.304005+0000","last_became_active":"2021-11-21T03:49:35.302998+0000","last_became_peered":"2021-11-21T03:49:35.302998+0000","last_unstale":"2021-11-21T03:49:35.304005+0000","last_undegraded":"2021-11-21T03:49:35.304005+0000","last_fullsized":"2021-11-21T03:49:35.304005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323144,"statfs":{"total":96636764160,"available":95562899456,"internally_reserved":1073741824,"allocated":114688,"data_stored":31700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048692,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323148,"statfs":{"total":96636764160,"available":95562903552,"internally_reserved":1073741824,"allocated":110592,"data_stored":31122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.187}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048700,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323140,"statfs":{"total":96636764160,"available":95562895360,"internally_reserved":1073741824,"allocated":118784,"data_stored":34633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]}]}]}} 2021-11-21T03:49:38.746 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2021-11-21T03:49:38.926 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:38.927 INFO:teuthology.orchestra.run.gibba043.stderr:dumped all 2021-11-21T03:49:38.935 INFO:teuthology.orchestra.run.gibba043.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-11-21T03:49:37.279724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146088,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969432,"statfs":{"total":289910292480,"available":286688698368,"internally_reserved":3221225472,"allocated":344064,"data_stored":97455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.304368+0000","last_change":"2021-11-21T03:49:35.303785+0000","last_active":"2021-11-21T03:49:35.304368+0000","last_peered":"2021-11-21T03:49:35.304368+0000","last_clean":"2021-11-21T03:49:35.304368+0000","last_became_active":"2021-11-21T03:49:35.303343+0000","last_became_peered":"2021-11-21T03:49:35.303343+0000","last_unstale":"2021-11-21T03:49:35.304368+0000","last_undegraded":"2021-11-21T03:49:35.304368+0000","last_fullsized":"2021-11-21T03:49:35.304368+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.304355+0000","last_change":"2021-11-21T03:49:35.303760+0000","last_active":"2021-11-21T03:49:35.304355+0000","last_peered":"2021-11-21T03:49:35.304355+0000","last_clean":"2021-11-21T03:49:35.304355+0000","last_became_active":"2021-11-21T03:49:35.303374+0000","last_became_peered":"2021-11-21T03:49:35.303374+0000","last_unstale":"2021-11-21T03:49:35.304355+0000","last_undegraded":"2021-11-21T03:49:35.304355+0000","last_fullsized":"2021-11-21T03:49:35.304355+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.304010+0000","last_change":"2021-11-21T03:49:35.303325+0000","last_active":"2021-11-21T03:49:35.304010+0000","last_peered":"2021-11-21T03:49:35.304010+0000","last_clean":"2021-11-21T03:49:35.304010+0000","last_became_active":"2021-11-21T03:49:35.303009+0000","last_became_peered":"2021-11-21T03:49:35.303009+0000","last_unstale":"2021-11-21T03:49:35.304010+0000","last_undegraded":"2021-11-21T03:49:35.304010+0000","last_fullsized":"2021-11-21T03:49:35.304010+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.303375+0000","last_change":"2021-11-21T03:49:35.303375+0000","last_active":"2021-11-21T03:49:35.303375+0000","last_peered":"2021-11-21T03:49:35.303375+0000","last_clean":"2021-11-21T03:49:35.303375+0000","last_became_active":"2021-11-21T03:49:35.303133+0000","last_became_peered":"2021-11-21T03:49:35.303133+0000","last_unstale":"2021-11-21T03:49:35.303375+0000","last_undegraded":"2021-11-21T03:49:35.303375+0000","last_fullsized":"2021-11-21T03:49:35.303375+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'1","reported_seq":13,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.302514+0000","last_change":"2021-11-21T03:49:32.511488+0000","last_active":"2021-11-21T03:49:35.302514+0000","last_peered":"2021-11-21T03:49:35.302514+0000","last_clean":"2021-11-21T03:49:35.302514+0000","last_became_active":"2021-11-21T03:49:32.511148+0000","last_became_peered":"2021-11-21T03:49:32.511148+0000","last_unstale":"2021-11-21T03:49:35.302514+0000","last_undegraded":"2021-11-21T03:49:35.302514+0000","last_fullsized":"2021-11-21T03:49:35.302514+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:28.275764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:28.275764+0000","last_clean_scrub_stamp":"2021-11-21T03:49:28.275764+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.303995+0000","last_change":"2021-11-21T03:49:35.303252+0000","last_active":"2021-11-21T03:49:35.303995+0000","last_peered":"2021-11-21T03:49:35.303995+0000","last_clean":"2021-11-21T03:49:35.303995+0000","last_became_active":"2021-11-21T03:49:35.302949+0000","last_became_peered":"2021-11-21T03:49:35.302949+0000","last_unstale":"2021-11-21T03:49:35.303995+0000","last_undegraded":"2021-11-21T03:49:35.303995+0000","last_fullsized":"2021-11-21T03:49:35.303995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.303793+0000","last_change":"2021-11-21T03:49:35.303793+0000","last_active":"2021-11-21T03:49:35.303793+0000","last_peered":"2021-11-21T03:49:35.303793+0000","last_clean":"2021-11-21T03:49:35.303793+0000","last_became_active":"2021-11-21T03:49:35.303600+0000","last_became_peered":"2021-11-21T03:49:35.303600+0000","last_unstale":"2021-11-21T03:49:35.303793+0000","last_undegraded":"2021-11-21T03:49:35.303793+0000","last_fullsized":"2021-11-21T03:49:35.303793+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.303540+0000","last_change":"2021-11-21T03:49:35.303540+0000","last_active":"2021-11-21T03:49:35.303540+0000","last_peered":"2021-11-21T03:49:35.303540+0000","last_clean":"2021-11-21T03:49:35.303540+0000","last_became_active":"2021-11-21T03:49:35.303298+0000","last_became_peered":"2021-11-21T03:49:35.303298+0000","last_unstale":"2021-11-21T03:49:35.303540+0000","last_undegraded":"2021-11-21T03:49:35.303540+0000","last_fullsized":"2021-11-21T03:49:35.303540+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-11-21T03:49:35.304005+0000","last_change":"2021-11-21T03:49:35.303286+0000","last_active":"2021-11-21T03:49:35.304005+0000","last_peered":"2021-11-21T03:49:35.304005+0000","last_clean":"2021-11-21T03:49:35.304005+0000","last_became_active":"2021-11-21T03:49:35.302998+0000","last_became_peered":"2021-11-21T03:49:35.302998+0000","last_unstale":"2021-11-21T03:49:35.304005+0000","last_undegraded":"2021-11-21T03:49:35.304005+0000","last_fullsized":"2021-11-21T03:49:35.304005+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-21T03:49:34.294388+0000","last_clean_scrub_stamp":"2021-11-21T03:49:34.294388+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323144,"statfs":{"total":96636764160,"available":95562899456,"internally_reserved":1073741824,"allocated":114688,"data_stored":31700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048692,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323148,"statfs":{"total":96636764160,"available":95562903552,"internally_reserved":1073741824,"allocated":110592,"data_stored":31122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.187}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048700,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323140,"statfs":{"total":96636764160,"available":95562895360,"internally_reserved":1073741824,"allocated":118784,"data_stored":34633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]}]}]}} 2021-11-21T03:49:38.937 INFO:tasks.ceph.ceph_manager.cluster2:clean! 2021-11-21T03:49:38.938 INFO:tasks.ceph:Waiting until ceph cluster cluster2 is healthy... 2021-11-21T03:49:38.939 INFO:tasks.ceph.ceph_manager.cluster2:wait_until_healthy 2021-11-21T03:49:38.940 DEBUG:teuthology.orchestra.run.gibba043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 health --format=json 2021-11-21T03:49:39.156 INFO:teuthology.orchestra.run.gibba043.stdout: 2021-11-21T03:49:39.234 INFO:teuthology.orchestra.run.gibba043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-11-21T03:49:39.234 INFO:tasks.ceph.ceph_manager.cluster2:wait_until_healthy done 2021-11-21T03:49:39.235 INFO:teuthology.run_tasks:Running task exec... 2021-11-21T03:49:39.249 INFO:teuthology.task.exec:Executing custom commands... 2021-11-21T03:49:39.250 INFO:teuthology.task.exec:Running commands on role cluster1.client.mirror.0 host ubuntu@gibba043.front.sepia.ceph.com 2021-11-21T03:49:39.251 DEBUG:teuthology.orchestra.run.gibba043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror mon '"'"'profile rbd-mirror-peer'"'"' osd '"'"'profile rbd'"'"'' 2021-11-21T03:49:39.487 INFO:teuthology.orchestra.run.gibba043.stderr:updated caps for client.mirror 2021-11-21T03:49:39.495 DEBUG:teuthology.orchestra.run.gibba043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.0 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-21T03:49:39.728 INFO:teuthology.orchestra.run.gibba043.stderr:updated caps for client.mirror.0 2021-11-21T03:49:39.735 DEBUG:teuthology.orchestra.run.gibba043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.1 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-21T03:49:39.965 INFO:teuthology.orchestra.run.gibba043.stderr:updated caps for client.mirror.1 2021-11-21T03:49:39.973 DEBUG:teuthology.orchestra.run.gibba043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.2 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-21T03:49:40.203 INFO:teuthology.orchestra.run.gibba043.stderr:updated caps for client.mirror.2 2021-11-21T03:49:40.212 DEBUG:teuthology.orchestra.run.gibba043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.3 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-21T03:49:40.440 INFO:teuthology.orchestra.run.gibba043.stderr:updated caps for client.mirror.3 2021-11-21T03:49:40.448 DEBUG:teuthology.orchestra.run.gibba043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror mon '"'"'profile rbd-mirror-peer'"'"' osd '"'"'profile rbd'"'"'' 2021-11-21T03:49:40.677 INFO:teuthology.orchestra.run.gibba043.stderr:updated caps for client.mirror 2021-11-21T03:49:40.685 DEBUG:teuthology.orchestra.run.gibba043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.0 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-21T03:49:40.911 INFO:teuthology.orchestra.run.gibba043.stderr:updated caps for client.mirror.0 2021-11-21T03:49:40.919 DEBUG:teuthology.orchestra.run.gibba043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.1 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-21T03:49:41.149 INFO:teuthology.orchestra.run.gibba043.stderr:updated caps for client.mirror.1 2021-11-21T03:49:41.157 DEBUG:teuthology.orchestra.run.gibba043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.2 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-21T03:49:41.388 INFO:teuthology.orchestra.run.gibba043.stderr:updated caps for client.mirror.2 2021-11-21T03:49:41.395 DEBUG:teuthology.orchestra.run.gibba043:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.3 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-21T03:49:41.623 INFO:teuthology.orchestra.run.gibba043.stderr:updated caps for client.mirror.3 2021-11-21T03:49:41.635 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-21T03:49:41.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Restarting daemon 2021-11-21T03:49:41.648 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 2021-11-21T03:49:41.656 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Started 2021-11-21T03:49:41.656 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-21T03:49:41.729 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2021-11-21T03:49:41.729 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2021-11-21T03:49:41.733 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2021-11-21T03:49:41.734 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-21T03:49:41.793 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Restarting daemon 2021-11-21T03:49:41.794 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 2021-11-21T03:49:41.797 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Started 2021-11-21T03:49:41.797 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-21T03:49:41.860 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Restarting daemon 2021-11-21T03:49:41.861 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.3 2021-11-21T03:49:41.864 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Started 2021-11-21T03:49:41.864 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-21T03:49:41.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2021-11-21T03:49:41.944 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2021-11-21T03:49:41.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2021-11-21T03:49:41.948 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-21T03:49:42.019 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2021-11-21T03:49:42.019 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2021-11-21T03:49:42.022 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2021-11-21T03:49:42.022 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-21T03:49:42.094 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Restarting daemon 2021-11-21T03:49:42.095 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 2021-11-21T03:49:42.097 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Started 2021-11-21T03:49:42.098 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-21T03:49:42.191 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Restarting daemon 2021-11-21T03:49:42.192 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.3 2021-11-21T03:49:42.195 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Started 2021-11-21T03:49:42.195 INFO:teuthology.run_tasks:Running task rbd-mirror-thrash... 2021-11-21T03:49:42.282 INFO:tasks.rbd_mirror_thrash:rbd_mirror_thrash using random seed: 1637466582 2021-11-21T03:49:42.283 DEBUG:tasks.rbd_mirror_thrash:Yielding 2021-11-21T03:49:42.283 INFO:teuthology.run_tasks:Running task rbd-mirror-thrash... 2021-11-21T03:49:42.356 INFO:tasks.rbd_mirror_thrash:rbd_mirror_thrash using random seed: 1637466582 2021-11-21T03:49:42.356 DEBUG:tasks.rbd_mirror_thrash:Yielding 2021-11-21T03:49:42.357 INFO:teuthology.run_tasks:Running task workunit... 2021-11-21T03:49:42.449 INFO:tasks.workunit:Pulling workunits from ref b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-21T03:49:42.451 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-11-21T03:49:42.452 DEBUG:teuthology.orchestra.run.gibba043:> stat -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2021-11-21T03:49:42.452 INFO:tasks.rbd_mirror_thrash:starting thrash for cluster cluster1 2021-11-21T03:49:42.453 INFO:tasks.rbd_mirror_thrash:waiting for 115 secs before thrashing 2021-11-21T03:49:42.453 INFO:tasks.rbd_mirror_thrash:starting thrash for cluster cluster2 2021-11-21T03:49:42.453 INFO:tasks.rbd_mirror_thrash:waiting for 101 secs before thrashing 2021-11-21T03:49:42.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T03:49:42.467 INFO:teuthology.orchestra.run.gibba043.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.cluster1.mirror': No such file or directory 2021-11-21T03:49:42.467 DEBUG:teuthology.orchestra.run.gibba043:> mkdir -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2021-11-21T03:49:42.520 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.cluster1.mirror 2021-11-21T03:49:42.520 DEBUG:teuthology.orchestra.run.gibba043:> cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror && mkdir -- client.mirror 2021-11-21T03:49:42.572 INFO:tasks.workunit:timeout=6h 2021-11-21T03:49:42.572 INFO:tasks.workunit:cleanup=True 2021-11-21T03:49:42.573 DEBUG:teuthology.orchestra.run.gibba043:> rm -rf /home/ubuntu/cephtest/clone.cluster1.client.mirror && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.cluster1.client.mirror && cd /home/ubuntu/cephtest/clone.cluster1.client.mirror && git checkout b0aaed0fe8cdfe99c82a70b230004934b51091ff 2021-11-21T03:49:42.625 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Cloning into '/home/ubuntu/cephtest/clone.cluster1.client.mirror'... 2021-11-21T03:50:34.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Note: switching to 'b0aaed0fe8cdfe99c82a70b230004934b51091ff'. 2021-11-21T03:50:34.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:50:34.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-11-21T03:50:34.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:changes and commit them, and you can discard any commits you make in this 2021-11-21T03:50:34.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:state without impacting any branches by switching back to a branch. 2021-11-21T03:50:34.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:50:34.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:If you want to create a new branch to retain commits you create, you may 2021-11-21T03:50:34.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:do so (now or later) by using -c with the switch command. Example: 2021-11-21T03:50:34.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:50:34.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: git switch -c 2021-11-21T03:50:34.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:50:34.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Or undo this operation with: 2021-11-21T03:50:34.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:50:34.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: git switch - 2021-11-21T03:50:34.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:50:34.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-11-21T03:50:34.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:50:34.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:HEAD is now at b0aaed0fe8c Merge pull request #43747 from mfoliveira/wip-53100-octopus 2021-11-21T03:50:34.647 DEBUG:teuthology.orchestra.run.gibba043:> cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror 2021-11-21T03:50:34.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-11-21T03:50:34.720 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/direct_io' 2021-11-21T03:50:34.721 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-11-21T03:50:35.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-11-21T03:50:35.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-11-21T03:50:35.676 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/direct_io' 2021-11-21T03:50:35.676 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/fs' 2021-11-21T03:50:35.677 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-11-21T03:50:35.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/fs' 2021-11-21T03:50:35.759 DEBUG:teuthology.orchestra.remote:gibba043:/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror is 4KB 2021-11-21T03:50:35.809 INFO:tasks.workunit:Running workunits matching rbd/rbd_mirror_stress.sh on cluster1.client.mirror... 2021-11-21T03:50:35.809 INFO:tasks.workunit:Running workunit rbd/rbd_mirror_stress.sh... 2021-11-21T03:50:35.810 DEBUG:teuthology.orchestra.run.gibba043:workunit test rbd/rbd_mirror_stress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0aaed0fe8cdfe99c82a70b230004934b51091ff TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ARGS='' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh 2021-11-21T03:50:35.824 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ IMAGE_COUNT=50 2021-11-21T03:50:35.824 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ export LOCKDEP=0 2021-11-21T03:50:35.825 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ LOCKDEP=0 2021-11-21T03:50:35.825 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ dirname /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh 2021-11-21T03:50:35.827 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ . /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_helpers.sh 2021-11-21T03:50:35.828 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ type xmlstarlet 2021-11-21T03:50:35.828 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ XMLSTARLET=xmlstarlet 2021-11-21T03:50:35.828 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ RBD_MIRROR_INSTANCES=4 2021-11-21T03:50:35.828 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CLUSTER1=cluster1 2021-11-21T03:50:35.829 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CLUSTER2=cluster2 2021-11-21T03:50:35.829 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ PEER_CLUSTER_SUFFIX= 2021-11-21T03:50:35.829 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ POOL=mirror 2021-11-21T03:50:35.829 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ PARENT_POOL=mirror_parent 2021-11-21T03:50:35.829 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ NS1=ns1 2021-11-21T03:50:35.830 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ NS2=ns2 2021-11-21T03:50:35.830 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ TEMPDIR= 2021-11-21T03:50:35.830 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ID=mirror 2021-11-21T03:50:35.830 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff 2021-11-21T03:50:35.831 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ MIRROR_USER_ID_PREFIX=mirror. 2021-11-21T03:50:35.831 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ MIRROR_POOL_MODE=image 2021-11-21T03:50:35.831 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ MIRROR_IMAGE_MODE=snapshot 2021-11-21T03:50:35.831 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ export 'CEPH_ARGS=--id mirror' 2021-11-21T03:50:35.831 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ARGS='--id mirror' 2021-11-21T03:50:35.832 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ LAST_MIRROR_INSTANCE=3 2021-11-21T03:50:35.832 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ dirname /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh 2021-11-21T03:50:35.832 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ readlink -f /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/../../../src 2021-11-21T03:50:35.832 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror/src 2021-11-21T03:50:35.833 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_BIN=. 2021-11-21T03:50:35.833 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_SRC=. 2021-11-21T03:50:35.833 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' -e CMakeCache.txt ']' 2021-11-21T03:50:35.834 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 -gt 0 ']' 2021-11-21T03:50:35.834 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ setup 2021-11-21T03:50:35.834 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local c 2021-11-21T03:50:35.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ trap 'cleanup $?' INT TERM EXIT 2021-11-21T03:50:35.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ setup_tempdir 2021-11-21T03:50:35.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:50:35.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mktemp -d 2021-11-21T03:50:35.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ TEMPDIR=/tmp/tmp.5VD92ZyI1X 2021-11-21T03:50:35.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -z 1 ']' 2021-11-21T03:50:35.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ setup_pools cluster1 cluster2 2021-11-21T03:50:35.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:50:35.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local remote_cluster=cluster2 2021-11-21T03:50:35.837 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mon_map_file 2021-11-21T03:50:35.837 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mon_addr 2021-11-21T03:50:35.837 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local admin_key_file 2021-11-21T03:50:35.837 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local uuid 2021-11-21T03:50:35.837 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:50:35.838 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ ceph --cluster cluster1 osd pool create mirror 64 64 2021-11-21T03:50:36.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:pool 'mirror' already exists 2021-11-21T03:50:36.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:50:36.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ ceph --cluster cluster1 osd pool create mirror_parent 64 64 2021-11-21T03:50:37.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:pool 'mirror_parent' already exists 2021-11-21T03:50:37.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:50:37.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 pool init mirror 2021-11-21T03:50:40.365 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:50:40.366 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 pool init mirror_parent 2021-11-21T03:50:43.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:50:43.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:50:43.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool enable --site-name cluster1 mirror image 2021-11-21T03:50:43.405 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool enable mirror_parent image 2021-11-21T03:50:43.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 namespace create mirror/ns1 2021-11-21T03:50:43.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 namespace create mirror/ns2 2021-11-21T03:50:43.473 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool enable mirror/ns1 image 2021-11-21T03:50:43.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool enable mirror/ns2 image 2021-11-21T03:50:43.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -z ']' 2021-11-21T03:50:43.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -z ']' 2021-11-21T03:50:43.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ peer_add cluster1 mirror cluster2 2021-11-21T03:50:43.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:50:43.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:43.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:50:43.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:43.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local client_cluster=cluster2 2021-11-21T03:50:43.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:43.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local remote_cluster=cluster2 2021-11-21T03:50:43.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local uuid_var_name 2021-11-21T03:50:43.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:50:43.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local error_code 2021-11-21T03:50:43.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local peer_uuid 2021-11-21T03:50:43.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 16 32 2021-11-21T03:50:43.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T03:50:43.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 mirror pool peer add mirror cluster2 2021-11-21T03:50:43.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ peer_uuid=b641d402-21f7-4f5f-849e-57795b161e6b 2021-11-21T03:50:43.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=0 2021-11-21T03:50:43.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T03:50:43.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 0 -eq 17 ']' 2021-11-21T03:50:43.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 0 -eq 0 2021-11-21T03:50:43.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:50:43.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:50:43.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ peer_add cluster1 mirror_parent cluster2 2021-11-21T03:50:43.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:50:43.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:43.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror_parent 2021-11-21T03:50:43.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:43.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local client_cluster=cluster2 2021-11-21T03:50:43.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:43.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local remote_cluster=cluster2 2021-11-21T03:50:43.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local uuid_var_name 2021-11-21T03:50:43.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:50:43.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local error_code 2021-11-21T03:50:43.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local peer_uuid 2021-11-21T03:50:43.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 16 32 2021-11-21T03:50:43.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T03:50:43.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 mirror pool peer add mirror_parent cluster2 2021-11-21T03:50:43.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ peer_uuid=c6f0d615-2791-47d9-b665-37e6e63dc576 2021-11-21T03:50:43.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=0 2021-11-21T03:50:43.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T03:50:43.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 0 -eq 17 ']' 2021-11-21T03:50:43.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 0 -eq 0 2021-11-21T03:50:43.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:50:43.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:50:43.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ setup_pools cluster2 cluster1 2021-11-21T03:50:43.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:50:43.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local remote_cluster=cluster1 2021-11-21T03:50:43.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mon_map_file 2021-11-21T03:50:43.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mon_addr 2021-11-21T03:50:43.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local admin_key_file 2021-11-21T03:50:43.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local uuid 2021-11-21T03:50:43.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:50:43.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ ceph --cluster cluster2 osd pool create mirror 64 64 2021-11-21T03:50:44.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:pool 'mirror' already exists 2021-11-21T03:50:44.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:50:44.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ ceph --cluster cluster2 osd pool create mirror_parent 64 64 2021-11-21T03:50:45.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:pool 'mirror_parent' already exists 2021-11-21T03:50:45.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:50:45.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 pool init mirror 2021-11-21T03:50:48.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:50:48.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 pool init mirror_parent 2021-11-21T03:50:51.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:50:51.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:50:51.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror pool enable --site-name cluster2 mirror image 2021-11-21T03:50:51.413 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror pool enable mirror_parent image 2021-11-21T03:50:51.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 namespace create mirror/ns1 2021-11-21T03:50:51.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 namespace create mirror/ns2 2021-11-21T03:50:51.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror pool enable mirror/ns1 image 2021-11-21T03:50:51.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror pool enable mirror/ns2 image 2021-11-21T03:50:51.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -z ']' 2021-11-21T03:50:51.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -z ']' 2021-11-21T03:50:51.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ peer_add cluster2 mirror cluster1 2021-11-21T03:50:51.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:50:51.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:50:51.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local client_cluster=cluster1 2021-11-21T03:50:51.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local remote_cluster=cluster1 2021-11-21T03:50:51.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local uuid_var_name 2021-11-21T03:50:51.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:50:51.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local error_code 2021-11-21T03:50:51.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local peer_uuid 2021-11-21T03:50:51.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 16 32 2021-11-21T03:50:51.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T03:50:51.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster2 mirror pool peer add mirror cluster1 2021-11-21T03:50:51.546 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ peer_uuid=7a7ca160-f974-4a5f-945c-1027dc727af9 2021-11-21T03:50:51.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=0 2021-11-21T03:50:51.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T03:50:51.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 0 -eq 17 ']' 2021-11-21T03:50:51.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 0 -eq 0 2021-11-21T03:50:51.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:50:51.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:50:51.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ peer_add cluster2 mirror_parent cluster1 2021-11-21T03:50:51.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:50:51.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror_parent 2021-11-21T03:50:51.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local client_cluster=cluster1 2021-11-21T03:50:51.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local remote_cluster=cluster1 2021-11-21T03:50:51.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local uuid_var_name 2021-11-21T03:50:51.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:50:51.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local error_code 2021-11-21T03:50:51.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local peer_uuid 2021-11-21T03:50:51.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 16 32 2021-11-21T03:50:51.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T03:50:51.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster2 mirror pool peer add mirror_parent cluster1 2021-11-21T03:50:51.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ peer_uuid=522719a8-81ee-4d69-ab53-6b4a769ba4d9 2021-11-21T03:50:51.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=0 2021-11-21T03:50:51.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T03:50:51.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 0 -eq 17 ']' 2021-11-21T03:50:51.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 0 -eq 0 2021-11-21T03:50:51.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:50:51.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:50:51.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:50:51.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ start_mirrors cluster1 2021-11-21T03:50:51.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:50:51.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ seq 0 3 2021-11-21T03:50:51.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:51.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ start_mirror cluster1:0 2021-11-21T03:50:51.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1:0 2021-11-21T03:50:51.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance 2021-11-21T03:50:51.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:50:51.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local val=cluster1:0 2021-11-21T03:50:51.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster_var_name=cluster 2021-11-21T03:50:51.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance_var_name=instance 2021-11-21T03:50:51.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cluster=cluster1 2021-11-21T03:50:51.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ instance=0 2021-11-21T03:50:51.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 0 = cluster1:0 ']' 2021-11-21T03:50:51.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval cluster=cluster1 2021-11-21T03:50:51.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:51.599 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval instance=0 2021-11-21T03:50:51.599 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:50:51.599 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test -n 1 2021-11-21T03:50:51.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 2021-11-21T03:50:51.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:51.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ start_mirror cluster1:1 2021-11-21T03:50:51.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1:1 2021-11-21T03:50:51.601 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance 2021-11-21T03:50:51.601 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:50:51.601 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local val=cluster1:1 2021-11-21T03:50:51.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster_var_name=cluster 2021-11-21T03:50:51.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance_var_name=instance 2021-11-21T03:50:51.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cluster=cluster1 2021-11-21T03:50:51.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ instance=1 2021-11-21T03:50:51.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 1 = cluster1:1 ']' 2021-11-21T03:50:51.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval cluster=cluster1 2021-11-21T03:50:51.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:51.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval instance=1 2021-11-21T03:50:51.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:50:51.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test -n 1 2021-11-21T03:50:51.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 2021-11-21T03:50:51.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:51.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ start_mirror cluster1:2 2021-11-21T03:50:51.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1:2 2021-11-21T03:50:51.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance 2021-11-21T03:50:51.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:50:51.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local val=cluster1:2 2021-11-21T03:50:51.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster_var_name=cluster 2021-11-21T03:50:51.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance_var_name=instance 2021-11-21T03:50:51.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cluster=cluster1 2021-11-21T03:50:51.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ instance=2 2021-11-21T03:50:51.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 2 = cluster1:2 ']' 2021-11-21T03:50:51.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval cluster=cluster1 2021-11-21T03:50:51.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:51.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval instance=2 2021-11-21T03:50:51.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:50:51.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test -n 1 2021-11-21T03:50:51.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 2021-11-21T03:50:51.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:51.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ start_mirror cluster1:3 2021-11-21T03:50:51.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1:3 2021-11-21T03:50:51.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance 2021-11-21T03:50:51.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:50:51.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local val=cluster1:3 2021-11-21T03:50:51.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster_var_name=cluster 2021-11-21T03:50:51.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance_var_name=instance 2021-11-21T03:50:51.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cluster=cluster1 2021-11-21T03:50:51.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ instance=3 2021-11-21T03:50:51.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 3 = cluster1:3 ']' 2021-11-21T03:50:51.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval cluster=cluster1 2021-11-21T03:50:51.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:51.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval instance=3 2021-11-21T03:50:51.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:50:51.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test -n 1 2021-11-21T03:50:51.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 2021-11-21T03:50:51.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ start_mirrors cluster2 2021-11-21T03:50:51.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:50:51.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ seq 0 3 2021-11-21T03:50:51.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:51.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ start_mirror cluster2:0 2021-11-21T03:50:51.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2:0 2021-11-21T03:50:51.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance 2021-11-21T03:50:51.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set_cluster_instance cluster2:0 cluster instance 2021-11-21T03:50:51.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local val=cluster2:0 2021-11-21T03:50:51.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster_var_name=cluster 2021-11-21T03:50:51.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance_var_name=instance 2021-11-21T03:50:51.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cluster=cluster2 2021-11-21T03:50:51.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ instance=0 2021-11-21T03:50:51.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 0 = cluster2:0 ']' 2021-11-21T03:50:51.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval cluster=cluster2 2021-11-21T03:50:51.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster2 2021-11-21T03:50:51.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval instance=0 2021-11-21T03:50:51.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:50:51.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test -n 1 2021-11-21T03:50:51.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 2021-11-21T03:50:51.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:51.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ start_mirror cluster2:1 2021-11-21T03:50:51.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2:1 2021-11-21T03:50:51.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance 2021-11-21T03:50:51.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set_cluster_instance cluster2:1 cluster instance 2021-11-21T03:50:51.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local val=cluster2:1 2021-11-21T03:50:51.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster_var_name=cluster 2021-11-21T03:50:51.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance_var_name=instance 2021-11-21T03:50:51.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cluster=cluster2 2021-11-21T03:50:51.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ instance=1 2021-11-21T03:50:51.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 1 = cluster2:1 ']' 2021-11-21T03:50:51.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval cluster=cluster2 2021-11-21T03:50:51.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster2 2021-11-21T03:50:51.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval instance=1 2021-11-21T03:50:51.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:50:51.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test -n 1 2021-11-21T03:50:51.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 2021-11-21T03:50:51.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:51.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ start_mirror cluster2:2 2021-11-21T03:50:51.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2:2 2021-11-21T03:50:51.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance 2021-11-21T03:50:51.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set_cluster_instance cluster2:2 cluster instance 2021-11-21T03:50:51.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local val=cluster2:2 2021-11-21T03:50:51.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster_var_name=cluster 2021-11-21T03:50:51.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance_var_name=instance 2021-11-21T03:50:51.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cluster=cluster2 2021-11-21T03:50:51.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ instance=2 2021-11-21T03:50:51.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 2 = cluster2:2 ']' 2021-11-21T03:50:51.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval cluster=cluster2 2021-11-21T03:50:51.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster2 2021-11-21T03:50:51.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval instance=2 2021-11-21T03:50:51.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:50:51.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test -n 1 2021-11-21T03:50:51.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 2021-11-21T03:50:51.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:51.625 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ start_mirror cluster2:3 2021-11-21T03:50:51.625 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2:3 2021-11-21T03:50:51.625 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance 2021-11-21T03:50:51.625 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set_cluster_instance cluster2:3 cluster instance 2021-11-21T03:50:51.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local val=cluster2:3 2021-11-21T03:50:51.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster_var_name=cluster 2021-11-21T03:50:51.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local instance_var_name=instance 2021-11-21T03:50:51.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cluster=cluster2 2021-11-21T03:50:51.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ instance=3 2021-11-21T03:50:51.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 3 = cluster2:3 ']' 2021-11-21T03:50:51.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval cluster=cluster2 2021-11-21T03:50:51.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster2 2021-11-21T03:50:51.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ eval instance=3 2021-11-21T03:50:51.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:50:51.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test -n 1 2021-11-21T03:50:51.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 2021-11-21T03:50:51.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ testlog 'TEST: add image and test replay after client crashes' 2021-11-21T03:50:51.629 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ tee -a /tmp/tmp.5VD92ZyI1X/rbd-mirror.test.log 2021-11-21T03:50:51.629 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ date '+%F %T' 2021-11-21T03:50:51.629 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo 2021-11-21 03:50:51 TEST: add image and test replay after client crashes 2021-11-21T03:50:51.629 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:2021-11-21 03:50:51 TEST: add image and test replay after client crashes 2021-11-21T03:50:51.629 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=test 2021-11-21T03:50:51.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror test snapshot 512M 2021-11-21T03:50:51.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:50:51.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:50:51.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:50:51.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T03:50:51.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T03:50:51.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror test 512M 2021-11-21T03:50:51.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:50:51.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:50:51.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:50:51.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T03:50:51.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 512M ']' 2021-11-21T03:50:51.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=512M 2021-11-21T03:50:51.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T03:50:51.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 512M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/test 2021-11-21T03:50:51.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T03:50:51.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror test snapshot 2021-11-21T03:50:51.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:50:51.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:50:51.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:50:51.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T03:50:51.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/test snapshot 2021-11-21T03:50:52.427 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T03:50:52.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-21T03:50:52.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:50:52.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:50:52.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:50:52.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-21T03:50:52.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:50:52.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:50:52.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:50:52.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state=started 2021-11-21T03:50:52.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:50:52.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:50:52.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:50:53.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-21T03:50:53.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:50:53.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:50:53.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:50:53.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=started 2021-11-21T03:50:53.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_result 2021-11-21T03:50:53.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=stopped 2021-11-21T03:50:53.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-21T03:50:53.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_instance=cluster1 2021-11-21T03:50:53.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ grep -i state 2021-11-21T03:50:53.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:50:53.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T03:50:53.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance=cluster1 2021-11-21T03:50:53.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local loop_instance 2021-11-21T03:50:53.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:50:53.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 0 2021-11-21T03:50:53.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:50:53.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:50:53.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:53.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:50:53.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:50:53.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:50:53.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:50:53.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:50:53.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:50:53.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:50:53.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:50:53.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:53.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:50:53.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:50:53.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:50:53.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:53.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:50:53.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:50:53.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:50:53.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:50:53.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:50:53.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:50:53.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:50:53.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:50:53.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:50:53.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:50:53.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:53.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:50:53.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:50:53.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:50:53.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:50:53.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:50:53.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:50:53.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:50:53.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:50:53.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:50:53.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:50:53.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:50:53.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:50:53.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:50:53.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:50:53.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:53.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:50:53.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:50:53.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:50:53.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:50:53.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:50:53.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:50:53.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:50:53.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:50:53.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:53.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:50:53.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:50:53.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:50:53.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:53.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:50:53.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:50:53.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:50:53.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:50:53.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:50:53.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:50:53.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:50:53.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:50:53.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:50:53.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:50:53.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:53.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:50:53.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:50:53.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:50:53.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:50:53.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:50:53.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:50:53.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:50:53.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:50:53.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:50:53.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:50:53.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:50:53.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:50:53.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:50:53.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:50:53.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:53.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:50:53.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:50:53.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:50:53.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:50:53.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:50:53.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:50:53.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:50:53.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:50:53.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:53.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:50:53.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:50:53.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:50:53.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:53.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:50:53.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:50:53.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:50:53.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:50:53.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:50:53.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:50:53.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:50:53.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:50:53.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:50:53.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:50:53.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:53.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:50:53.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:50:53.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:50:53.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:50:53.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:50:53.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:50:53.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:50:53.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:50:53.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:50:53.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:50:53.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:50:53.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:50:53.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:50:53.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:50:53.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:53.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:50:53.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:50:53.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:50:53.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:50:53.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:50:53.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:50:53.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:50:53.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:50:53.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:53.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:50:53.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:50:53.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:50:53.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:53.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:50:53.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:50:53.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:50:53.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:50:53.641 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:50:53.641 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:50:53.641 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:50:53.641 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:50:53.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:50:53.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:50:53.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:53.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:50:53.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:50:53.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:50:53.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:50:53.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:50:53.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:50:53.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:50:53.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:50:53.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:50:53.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:50:53.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:50:53.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:50:53.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:50:53.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:50:53.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:50:53.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 1 2021-11-21T03:50:54.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:50:54.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:50:54.706 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:54.707 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:50:54.707 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:50:54.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:50:54.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:50:54.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:50:54.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:50:54.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:50:54.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:50:54.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:54.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:50:54.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:50:54.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:50:54.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:54.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:50:54.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:50:54.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:50:54.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:50:54.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:50:54.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:50:54.715 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:50:54.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:50:54.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:50:54.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:50:54.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:54.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:50:54.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:50:54.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:50:54.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:50:54.720 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:50:54.720 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:50:54.721 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:50:54.722 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:50:54.723 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:50:54.723 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:50:54.723 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:50:54.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:50:54.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:50:54.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:50:54.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:54.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:50:54.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:50:54.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:50:54.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:50:54.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:50:54.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:50:54.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:50:54.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:50:54.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:54.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:50:54.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:50:54.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:50:54.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:54.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:50:54.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:50:54.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:50:54.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:50:54.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:50:54.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:50:54.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:50:54.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:50:54.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:50:54.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:50:54.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:54.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:50:54.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:50:54.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:50:54.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:50:54.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:50:54.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:50:54.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:50:54.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:50:54.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:50:54.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:50:54.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:50:54.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:50:54.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:50:54.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:50:54.838 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:54.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:50:54.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:50:54.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:50:54.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:50:54.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:50:54.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:50:54.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:50:54.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:50:54.841 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:54.841 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:50:54.841 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:50:54.841 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:50:54.841 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:54.842 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:50:54.842 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:50:54.842 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:50:54.842 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:50:54.843 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:50:54.843 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:50:54.843 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:50:54.843 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:50:54.843 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:50:54.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:50:54.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:54.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:50:54.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:50:54.845 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:50:54.845 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:50:54.845 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:50:54.845 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:50:54.846 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:50:54.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:50:54.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:50:54.848 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:50:54.848 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:50:54.901 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:50:54.901 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:50:54.901 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:50:54.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:54.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:50:54.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:50:54.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:50:54.906 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:50:54.906 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:50:54.906 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:50:54.906 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:50:54.907 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:50:54.907 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:54.907 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:50:54.907 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:50:54.908 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:50:54.908 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:54.908 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:50:54.908 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:50:54.908 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:50:54.909 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:50:54.909 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:50:54.909 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:50:54.909 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:50:54.910 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:50:54.910 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:50:54.910 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:50:54.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:54.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:50:54.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:50:54.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:50:54.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:50:54.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:50:54.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:50:54.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:50:54.913 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:50:54.913 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:50:54.914 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:50:54.914 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:50:54.966 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:50:54.966 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:50:54.967 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:50:54.967 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:50:54.967 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 2 2021-11-21T03:50:56.968 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:50:56.968 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:50:56.971 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:56.971 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:50:56.971 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:50:56.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:50:56.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:50:56.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:50:56.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:50:56.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:50:56.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:50:56.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:56.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:50:56.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:50:56.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:50:56.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:56.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:50:56.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:50:56.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:50:56.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:50:56.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:50:56.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:50:56.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:50:56.976 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:50:56.976 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:50:56.976 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:50:56.976 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:56.977 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:50:56.977 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:50:56.977 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:50:56.977 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:50:56.977 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:50:56.978 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:50:56.978 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:50:56.980 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:50:56.981 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:50:56.981 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:50:56.981 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:50:57.034 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:50:57.035 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:50:57.035 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:50:57.040 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:57.040 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:50:57.040 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:50:57.041 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:50:57.041 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:50:57.041 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:50:57.041 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:50:57.041 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:50:57.042 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:50:57.042 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:57.042 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:50:57.042 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:50:57.043 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:50:57.043 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:57.043 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:50:57.043 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:50:57.043 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:50:57.044 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:50:57.044 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:50:57.044 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:50:57.044 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:50:57.045 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:50:57.045 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:50:57.045 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:50:57.045 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:57.045 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:50:57.046 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:50:57.046 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:50:57.046 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:50:57.046 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:50:57.047 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:50:57.047 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:50:57.048 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:50:57.048 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:50:57.048 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:50:57.048 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:50:57.102 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:50:57.102 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:50:57.102 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:50:57.105 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:57.105 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:50:57.106 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:50:57.106 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:50:57.106 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:50:57.106 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:50:57.107 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:50:57.107 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:50:57.107 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:50:57.107 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:57.108 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:50:57.108 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:50:57.108 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:50:57.108 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:57.108 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:50:57.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:50:57.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:50:57.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:50:57.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:50:57.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:50:57.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:50:57.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:50:57.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:50:57.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:50:57.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:57.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:50:57.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:50:57.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:50:57.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:50:57.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:50:57.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:50:57.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:50:57.114 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:50:57.115 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:50:57.115 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:50:57.115 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:50:57.169 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:50:57.169 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:50:57.169 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:50:57.172 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:50:57.172 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:50:57.173 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:50:57.173 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:50:57.173 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:50:57.173 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:50:57.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:50:57.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:50:57.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:50:57.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:50:57.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:50:57.175 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:50:57.175 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:50:57.175 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:57.175 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:50:57.176 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:50:57.176 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:50:57.176 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:50:57.176 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:50:57.177 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:50:57.177 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:50:57.177 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:50:57.177 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:50:57.177 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:50:57.178 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:50:57.178 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:50:57.178 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:50:57.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:50:57.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:50:57.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:50:57.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:50:57.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:50:57.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:50:57.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:50:57.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:50:57.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:50:57.235 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:50:57.235 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:50:57.236 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:50:57.236 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:50:57.236 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 4 2021-11-21T03:51:01.237 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:51:01.237 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:51:01.243 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:51:01.243 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:51:01.243 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:51:01.243 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:51:01.244 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:51:01.244 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:51:01.244 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:51:01.244 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:51:01.245 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:51:01.245 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:51:01.245 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:51:01.245 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:51:01.246 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:51:01.246 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:01.246 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:51:01.246 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:51:01.246 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:51:01.247 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:51:01.247 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:51:01.248 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:51:01.248 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:51:01.249 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:51:01.249 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:51:01.249 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:51:01.250 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:01.250 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:51:01.251 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:51:01.251 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:51:01.251 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:51:01.252 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:51:01.252 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:51:01.252 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:51:01.253 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:51:01.253 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:51:01.254 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:51:01.254 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:51:01.303 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:51:01.304 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:51:01.304 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:51:01.307 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:51:01.307 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:51:01.308 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:51:01.308 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:51:01.308 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:51:01.308 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:51:01.309 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:51:01.309 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:51:01.309 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:51:01.309 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:51:01.310 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:51:01.310 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:51:01.310 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:51:01.310 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:01.310 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:51:01.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:51:01.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:51:01.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:51:01.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:51:01.312 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:51:01.312 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:51:01.312 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:51:01.312 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:51:01.312 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:51:01.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:01.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:51:01.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:51:01.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:51:01.314 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:51:01.314 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:51:01.314 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:51:01.314 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:51:01.315 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:51:01.315 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:51:01.316 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:51:01.316 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:51:01.369 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:51:01.370 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:51:01.370 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:51:01.373 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:51:01.373 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:51:01.373 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:51:01.373 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:51:01.374 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:51:01.374 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:51:01.374 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:51:01.374 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:51:01.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:51:01.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:51:01.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:51:01.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:51:01.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:51:01.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:01.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:51:01.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:51:01.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:51:01.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:51:01.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:51:01.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:51:01.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:51:01.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:51:01.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:51:01.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:51:01.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:01.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:51:01.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:51:01.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:51:01.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:51:01.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:51:01.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:51:01.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:51:01.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:51:01.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:51:01.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:51:01.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:51:01.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:51:01.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:51:01.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:51:01.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:51:01.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:51:01.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:51:01.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:51:01.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:51:01.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:51:01.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:51:01.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:51:01.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:51:01.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:51:01.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:51:01.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:51:01.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:51:01.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:01.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:51:01.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:51:01.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:51:01.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:51:01.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:51:01.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:51:01.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:51:01.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:51:01.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:51:01.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:51:01.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:01.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:51:01.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:51:01.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:51:01.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:51:01.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:51:01.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:51:01.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:51:01.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:51:01.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:51:01.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:51:01.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:51:01.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:51:01.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:51:01.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:51:01.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:51:01.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 8 2021-11-21T03:51:09.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:51:09.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:51:09.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:51:09.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:51:09.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:51:09.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:51:09.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:51:09.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:51:09.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:51:09.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:51:09.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:51:09.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:51:09.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:51:09.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:51:09.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:51:09.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:09.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:51:09.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:51:09.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:51:09.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:51:09.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:51:09.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:51:09.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:51:09.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:51:09.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:51:09.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:51:09.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:09.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:51:09.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:51:09.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:51:09.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:51:09.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:51:09.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:51:09.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:51:09.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:51:09.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:51:09.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:51:09.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:51:09.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:51:09.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:51:09.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:51:09.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:51:09.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:51:09.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:51:09.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:51:09.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:51:09.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:51:09.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:51:09.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:51:09.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:51:09.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:51:09.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:51:09.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:51:09.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:51:09.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:09.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:51:09.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:51:09.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:51:09.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:51:09.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:51:09.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:51:09.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:51:09.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:51:09.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:51:09.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:51:09.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:09.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:51:09.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:51:09.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:51:09.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:51:09.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:51:09.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:51:09.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:51:09.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:51:09.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:51:09.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:51:09.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:51:09.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:51:09.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:51:09.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:51:09.641 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:51:09.641 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:51:09.641 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:51:09.641 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:51:09.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:51:09.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:51:09.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:51:09.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:51:09.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:51:09.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:51:09.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:51:09.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:51:09.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:51:09.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:09.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:51:09.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:51:09.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:51:09.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:51:09.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:51:09.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:51:09.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:51:09.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:51:09.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:51:09.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:51:09.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:09.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:51:09.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:51:09.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:51:09.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:51:09.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:51:09.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:51:09.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:51:09.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:51:09.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:51:09.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:51:09.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:51:09.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:51:09.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:51:09.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:51:09.707 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:51:09.707 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:51:09.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:51:09.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:51:09.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:51:09.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:51:09.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:51:09.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:51:09.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:51:09.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:51:09.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:51:09.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:51:09.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:51:09.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:09.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:51:09.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:51:09.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:51:09.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:51:09.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:51:09.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:51:09.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:51:09.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:51:09.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:51:09.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:51:09.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:09.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:51:09.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:51:09.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:51:09.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:51:09.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:51:09.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:51:09.715 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:51:09.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:51:09.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:51:09.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:51:09.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:51:09.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:51:09.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:51:09.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:51:09.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:51:09.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 8 2021-11-21T03:51:17.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:51:17.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:51:17.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:51:17.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:51:17.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:51:17.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:51:17.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:51:17.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:51:17.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:51:17.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:51:17.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:51:17.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:51:17.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:51:17.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:51:17.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:51:17.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:17.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:51:17.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:51:17.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:51:17.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:51:17.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:51:17.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:51:17.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:51:17.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:51:17.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:51:17.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:51:17.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:51:17.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:51:17.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:51:17.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:51:17.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:51:17.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:51:17.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:51:17.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:51:17.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:51:17.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:51:17.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:51:17.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:51:17.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ return 0 2021-11-21T03:51:17.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ status_result=' "state": "Replaying"' 2021-11-21T03:51:17.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo ' "state": "Replaying"' 2021-11-21T03:51:17.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep -i Replaying 2021-11-21T03:51:17.848 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "state": "Replaying" 2021-11-21T03:51:17.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_state=started 2021-11-21T03:51:17.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test started = started 2021-11-21T03:51:17.850 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:51:17.850 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ clean_snap_name= 2021-11-21T03:51:17.850 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ seq 1 10 2021-11-21T03:51:17.850 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T03:51:17.850 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror test 2021-11-21T03:51:17.851 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:51:17.851 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:51:17.851 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:51:17.851 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T03:51:17.852 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=14 2021-11-21T03:51:17.852 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T03:51:17.852 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 14s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-21T03:51:18.067 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 102580224 bytes 2021-11-21T03:51:18.103 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 108745728 bytes 2021-11-21T03:51:18.152 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 144490496 bytes 2021-11-21T03:51:18.196 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 167358464 bytes 2021-11-21T03:51:18.257 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 214765568 bytes 2021-11-21T03:51:18.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 234338304 bytes 2021-11-21T03:51:18.341 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 272305152 bytes 2021-11-21T03:51:18.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 299916288 bytes 2021-11-21T03:51:18.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 332099584 bytes 2021-11-21T03:51:18.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 381323264 bytes 2021-11-21T03:51:18.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 416857088 bytes 2021-11-21T03:51:18.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 463972352 bytes 2021-11-21T03:51:18.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 492595200 bytes 2021-11-21T03:51:18.696 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 512128000 bytes 2021-11-21T03:51:18.724 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 512736256 bytes 2021-11-21T03:51:18.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 540320768 bytes 2021-11-21T03:51:18.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 592560128 bytes 2021-11-21T03:51:18.899 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 638714880 bytes 2021-11-21T03:51:18.949 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 673576960 bytes 2021-11-21T03:51:19.032 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 743549952 bytes 2021-11-21T03:51:19.090 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 779328512 bytes 2021-11-21T03:51:19.146 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 824409088 bytes 2021-11-21T03:51:19.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 877574144 bytes 2021-11-21T03:51:19.290 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 923544576 bytes 2021-11-21T03:51:19.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 945643520 bytes 2021-11-21T03:51:19.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 981052416 bytes 2021-11-21T03:51:19.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1044306944 bytes 2021-11-21T03:51:19.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1084633088 bytes 2021-11-21T03:51:19.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1087895552 bytes 2021-11-21T03:51:19.585 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1122502656 bytes 2021-11-21T03:51:19.693 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1215298560 bytes 2021-11-21T03:51:19.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1241548800 bytes 2021-11-21T03:51:19.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1256130560 bytes 2021-11-21T03:51:19.825 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1294009344 bytes 2021-11-21T03:51:19.872 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1343380480 bytes 2021-11-21T03:51:19.977 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1432130560 bytes 2021-11-21T03:51:20.052 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1485685760 bytes 2021-11-21T03:51:20.121 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1528601600 bytes 2021-11-21T03:51:20.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1547299840 bytes 2021-11-21T03:51:20.200 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1571419136 bytes 2021-11-21T03:51:20.242 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1595802624 bytes 2021-11-21T03:51:20.270 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1604055040 bytes 2021-11-21T03:51:20.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1632425984 bytes 2021-11-21T03:51:20.374 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1671933952 bytes 2021-11-21T03:51:20.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1704665088 bytes 2021-11-21T03:51:20.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1727708160 bytes 2021-11-21T03:51:20.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1773092864 bytes 2021-11-21T03:51:20.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 1799163904 bytes 2021-11-21T03:51:20.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 1818027008 bytes 2021-11-21T03:51:20.693 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 1881042944 bytes 2021-11-21T03:51:20.726 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 1894600704 bytes 2021-11-21T03:51:20.760 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 1909556224 bytes 2021-11-21T03:51:20.793 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 1923659776 bytes 2021-11-21T03:51:20.854 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 1972488192 bytes 2021-11-21T03:51:20.896 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2013680640 bytes 2021-11-21T03:51:20.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2064962560 bytes 2021-11-21T03:51:21.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2084980736 bytes 2021-11-21T03:51:21.050 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2136572928 bytes 2021-11-21T03:51:21.169 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2200760320 bytes 2021-11-21T03:51:21.198 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2210724864 bytes 2021-11-21T03:51:21.266 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2262914048 bytes 2021-11-21T03:51:21.305 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2282978304 bytes 2021-11-21T03:51:21.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2293738496 bytes 2021-11-21T03:51:21.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2328925184 bytes 2021-11-21T03:51:21.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2392035328 bytes 2021-11-21T03:51:21.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2488840192 bytes 2021-11-21T03:51:21.664 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2560190464 bytes 2021-11-21T03:51:21.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2587755520 bytes 2021-11-21T03:51:21.818 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2679385088 bytes 2021-11-21T03:51:21.853 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2694172672 bytes 2021-11-21T03:51:21.891 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 2714513408 bytes 2021-11-21T03:51:21.942 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 2748500992 bytes 2021-11-21T03:51:21.969 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 2754356224 bytes 2021-11-21T03:51:22.078 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 2844371968 bytes 2021-11-21T03:51:22.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 2927766528 bytes 2021-11-21T03:51:22.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 2959956992 bytes 2021-11-21T03:51:22.285 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 2996618240 bytes 2021-11-21T03:51:22.306 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 2997226496 bytes 2021-11-21T03:51:22.365 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3035428864 bytes 2021-11-21T03:51:22.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3080522752 bytes 2021-11-21T03:51:22.474 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3103144960 bytes 2021-11-21T03:51:22.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3122145280 bytes 2021-11-21T03:51:22.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3217362944 bytes 2021-11-21T03:51:22.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3222585344 bytes 2021-11-21T03:51:22.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3306746880 bytes 2021-11-21T03:51:22.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3322472448 bytes 2021-11-21T03:51:22.845 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3367350272 bytes 2021-11-21T03:51:22.886 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3388667904 bytes 2021-11-21T03:51:22.935 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3418678272 bytes 2021-11-21T03:51:23.001 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3465977856 bytes 2021-11-21T03:51:23.090 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3537769472 bytes 2021-11-21T03:51:23.248 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3678865408 bytes 2021-11-21T03:51:23.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 3753395200 bytes 2021-11-21T03:51:23.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 3819729920 bytes 2021-11-21T03:51:23.454 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.5553126889339602) > weight (0.25) 2021-11-21T03:51:23.455 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.36372137855475817) > weight (0.25) 2021-11-21T03:51:23.455 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.2 with skip (0.27784974112081984) > weight (0.25) 2021-11-21T03:51:23.456 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.3 2021-11-21T03:51:23.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Sent signal 15 2021-11-21T03:51:23.458 INFO:tasks.rbd_mirror_thrash:waiting for 7 secs before reviving daemons 2021-11-21T03:51:23.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.gibba043.stderr:2021-11-21T03:51:23.459+0000 7f9191459700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.3 (PID: 31189) UID: 1000 2021-11-21T03:51:23.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 3860489216 bytes 2021-11-21T03:51:23.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 3866323968 bytes 2021-11-21T03:51:23.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 3911617536 bytes 2021-11-21T03:51:23.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 3985781760 bytes 2021-11-21T03:51:23.658 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.gibba043.stderr:daemon-helper: command failed with exit status 1 2021-11-21T03:51:23.721 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 4027408384 bytes 2021-11-21T03:51:23.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 4067485696 bytes 2021-11-21T03:51:23.812 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4081196032 bytes 2021-11-21T03:51:23.885 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4138917888 bytes 2021-11-21T03:51:23.943 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4191495168 bytes 2021-11-21T03:51:24.004 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4220579840 bytes 2021-11-21T03:51:24.101 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4303467520 bytes 2021-11-21T03:51:24.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4354855936 bytes 2021-11-21T03:51:24.191 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4355483648 bytes 2021-11-21T03:51:24.242 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4388865024 bytes 2021-11-21T03:51:24.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4415301632 bytes 2021-11-21T03:51:24.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4457191424 bytes 2021-11-21T03:51:24.370 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 4459594752 bytes 2021-11-21T03:51:24.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 4502086656 bytes 2021-11-21T03:51:24.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 4519218176 bytes 2021-11-21T03:51:24.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 4561033216 bytes 2021-11-21T03:51:24.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 4595877888 bytes 2021-11-21T03:51:24.667 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 4666638336 bytes 2021-11-21T03:51:24.715 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 4698606592 bytes 2021-11-21T03:51:24.799 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 4762703872 bytes 2021-11-21T03:51:24.875 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 4821366784 bytes 2021-11-21T03:51:24.924 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 4851511296 bytes 2021-11-21T03:51:24.992 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 4900945920 bytes 2021-11-21T03:51:25.044 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 4939059200 bytes 2021-11-21T03:51:25.103 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 4978719744 bytes 2021-11-21T03:51:25.168 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 5021038592 bytes 2021-11-21T03:51:25.195 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 5039272960 bytes 2021-11-21T03:51:25.266 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12600 IOs, 5075601408 bytes 2021-11-21T03:51:25.345 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12700 IOs, 5135108096 bytes 2021-11-21T03:51:25.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12800 IOs, 5149377536 bytes 2021-11-21T03:51:25.473 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12900 IOs, 5231291392 bytes 2021-11-21T03:51:25.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13000 IOs, 5237642240 bytes 2021-11-21T03:51:25.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13100 IOs, 5296735232 bytes 2021-11-21T03:51:25.662 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13200 IOs, 5364374528 bytes 2021-11-21T03:51:25.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13300 IOs, 5388152832 bytes 2021-11-21T03:51:25.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13400 IOs, 5436898304 bytes 2021-11-21T03:51:25.794 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13500 IOs, 5440009216 bytes 2021-11-21T03:51:25.878 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13600 IOs, 5503651840 bytes 2021-11-21T03:51:25.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13700 IOs, 5514878976 bytes 2021-11-21T03:51:25.977 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13800 IOs, 5561452544 bytes 2021-11-21T03:51:26.041 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13900 IOs, 5605445632 bytes 2021-11-21T03:51:26.148 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14000 IOs, 5696039936 bytes 2021-11-21T03:51:26.237 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14100 IOs, 5770986496 bytes 2021-11-21T03:51:26.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14200 IOs, 5836995584 bytes 2021-11-21T03:51:26.364 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14300 IOs, 5861051392 bytes 2021-11-21T03:51:26.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14400 IOs, 5874453504 bytes 2021-11-21T03:51:26.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14500 IOs, 5958853632 bytes 2021-11-21T03:51:26.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14600 IOs, 5999155200 bytes 2021-11-21T03:51:26.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14700 IOs, 6009245696 bytes 2021-11-21T03:51:26.721 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14800 IOs, 6092906496 bytes 2021-11-21T03:51:26.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14900 IOs, 6130380800 bytes 2021-11-21T03:51:26.834 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15000 IOs, 6167452672 bytes 2021-11-21T03:51:26.944 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15100 IOs, 6257123328 bytes 2021-11-21T03:51:27.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15200 IOs, 6318154752 bytes 2021-11-21T03:51:27.070 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15300 IOs, 6347187200 bytes 2021-11-21T03:51:27.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15400 IOs, 6380604416 bytes 2021-11-21T03:51:27.170 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15500 IOs, 6405676032 bytes 2021-11-21T03:51:27.235 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15600 IOs, 6448944128 bytes 2021-11-21T03:51:27.281 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15700 IOs, 6475564032 bytes 2021-11-21T03:51:27.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15800 IOs, 6500720640 bytes 2021-11-21T03:51:27.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15900 IOs, 6551390208 bytes 2021-11-21T03:51:27.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16000 IOs, 6583226368 bytes 2021-11-21T03:51:27.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16100 IOs, 6628900864 bytes 2021-11-21T03:51:27.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16200 IOs, 6651614208 bytes 2021-11-21T03:51:27.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16300 IOs, 6652224512 bytes 2021-11-21T03:51:27.599 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16400 IOs, 6652831744 bytes 2021-11-21T03:51:27.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16500 IOs, 6665159680 bytes 2021-11-21T03:51:27.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16600 IOs, 6698016768 bytes 2021-11-21T03:51:27.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16700 IOs, 6698620928 bytes 2021-11-21T03:51:27.759 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16800 IOs, 6729243648 bytes 2021-11-21T03:51:27.819 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16900 IOs, 6778912768 bytes 2021-11-21T03:51:27.976 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17000 IOs, 6907523072 bytes 2021-11-21T03:51:28.058 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17100 IOs, 6986724352 bytes 2021-11-21T03:51:28.145 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17200 IOs, 7041216512 bytes 2021-11-21T03:51:28.227 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17300 IOs, 7095568384 bytes 2021-11-21T03:51:28.274 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17400 IOs, 7130976256 bytes 2021-11-21T03:51:28.330 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17500 IOs, 7155507200 bytes 2021-11-21T03:51:28.366 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17600 IOs, 7170203648 bytes 2021-11-21T03:51:28.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17700 IOs, 7266789376 bytes 2021-11-21T03:51:28.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17800 IOs, 7332573184 bytes 2021-11-21T03:51:28.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17900 IOs, 7365393408 bytes 2021-11-21T03:51:28.688 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18000 IOs, 7401631744 bytes 2021-11-21T03:51:28.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18100 IOs, 7413138432 bytes 2021-11-21T03:51:28.848 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18200 IOs, 7475593216 bytes 2021-11-21T03:51:28.870 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18300 IOs, 7476196352 bytes 2021-11-21T03:51:28.941 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18400 IOs, 7528216576 bytes 2021-11-21T03:51:28.993 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18500 IOs, 7560980480 bytes 2021-11-21T03:51:29.060 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18600 IOs, 7608357888 bytes 2021-11-21T03:51:29.108 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18700 IOs, 7641444352 bytes 2021-11-21T03:51:29.190 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18800 IOs, 7708192768 bytes 2021-11-21T03:51:29.240 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18900 IOs, 7748963328 bytes 2021-11-21T03:51:29.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19000 IOs, 7818190848 bytes 2021-11-21T03:51:29.405 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19100 IOs, 7860631552 bytes 2021-11-21T03:51:29.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19200 IOs, 7916869632 bytes 2021-11-21T03:51:29.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19300 IOs, 7943398400 bytes 2021-11-21T03:51:29.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19400 IOs, 7967323136 bytes 2021-11-21T03:51:29.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19500 IOs, 8034484224 bytes 2021-11-21T03:51:29.695 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19600 IOs, 8050122752 bytes 2021-11-21T03:51:29.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19700 IOs, 8086315008 bytes 2021-11-21T03:51:29.794 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19800 IOs, 8090947584 bytes 2021-11-21T03:51:29.895 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19900 IOs, 8170010624 bytes 2021-11-21T03:51:29.925 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20000 IOs, 8178157568 bytes 2021-11-21T03:51:29.990 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20100 IOs, 8220028928 bytes 2021-11-21T03:51:30.038 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20200 IOs, 8261491712 bytes 2021-11-21T03:51:30.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20300 IOs, 8298346496 bytes 2021-11-21T03:51:30.156 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20400 IOs, 8324859904 bytes 2021-11-21T03:51:30.250 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20500 IOs, 8415745024 bytes 2021-11-21T03:51:30.298 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20600 IOs, 8428682240 bytes 2021-11-21T03:51:30.362 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20700 IOs, 8471047168 bytes 2021-11-21T03:51:30.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20800 IOs, 8519802880 bytes 2021-11-21T03:51:30.460 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.3 2021-11-21T03:51:30.460 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T03:51:30.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T03:51:30.461 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.3 2021-11-21T03:51:30.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Restarting daemon 2021-11-21T03:51:30.462 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.3 2021-11-21T03:51:30.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Started 2021-11-21T03:51:30.465 INFO:tasks.rbd_mirror_thrash:waiting for 83 secs before thrashing 2021-11-21T03:51:30.493 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20900 IOs, 8558083072 bytes 2021-11-21T03:51:30.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:21000 IOs, 8581029888 bytes 2021-11-21T03:51:30.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:21100 IOs, 8617516032 bytes 2021-11-21T03:51:30.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:21200 IOs, 8639874048 bytes 2021-11-21T03:51:30.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:21300 IOs, 8673448960 bytes 2021-11-21T03:51:30.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:21400 IOs, 8706010112 bytes 2021-11-21T03:51:30.855 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:21500 IOs, 8788418560 bytes 2021-11-21T03:51:30.895 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:21600 IOs, 8816775168 bytes 2021-11-21T03:51:30.965 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:21700 IOs, 8861085696 bytes 2021-11-21T03:51:31.010 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:21800 IOs, 8875475968 bytes 2021-11-21T03:51:31.081 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:21900 IOs, 8925270016 bytes 2021-11-21T03:51:31.128 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:22000 IOs, 8952156160 bytes 2021-11-21T03:51:31.214 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:22100 IOs, 9013748736 bytes 2021-11-21T03:51:31.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:22200 IOs, 9094794240 bytes 2021-11-21T03:51:31.351 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:22300 IOs, 9112467456 bytes 2021-11-21T03:51:31.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:22400 IOs, 9202678784 bytes 2021-11-21T03:51:31.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:22500 IOs, 9261285376 bytes 2021-11-21T03:51:31.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:22600 IOs, 9317127168 bytes 2021-11-21T03:51:31.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:22700 IOs, 9327932416 bytes 2021-11-21T03:51:31.691 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:22800 IOs, 9354177536 bytes 2021-11-21T03:51:31.733 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:22900 IOs, 9371650048 bytes 2021-11-21T03:51:31.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:23000 IOs, 9430045696 bytes 2021-11-21T03:51:31.854 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T03:51:31.855 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T03:51:31.855 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T03:51:31.855 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:51:31.856 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-21T03:51:31.856 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:51:31.856 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:51:31.856 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:51:31.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:51:31.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:51:31.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:51:31.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:51:31.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:51:32.855 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-21T03:51:32.855 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:51:32.856 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:51:32.856 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:51:32.856 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:51:32.856 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:51:32.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:51:32.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-21T03:51:32.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-21T03:51:32.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:51:32.858 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:51:32.858 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:51:32.859 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-21T03:51:32.859 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ tee /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:51:32.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:test: 2021-11-21T03:51:32.893 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: global_id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:51:32.893 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+replaying 2021-11-21T03:51:32.893 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"remote_snapshot_timestamp":1637466652,"replay_state":"idle"} 2021-11-21T03:51:32.893 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: service: mirror.0 on gibba043 2021-11-21T03:51:32.894 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:51:14 2021-11-21T03:51:32.894 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: peer_sites: 2021-11-21T03:51:32.895 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: name: cluster2 2021-11-21T03:51:32.895 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+stopped 2021-11-21T03:51:32.895 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: local image is primary 2021-11-21T03:51:32.896 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:51:14 2021-11-21T03:51:32.896 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:51:32.897 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T03:51:32.897 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ description: .*' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:51:32.898 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"remote_snapshot_timestamp":1637466652,"replay_state":"idle"} 2021-11-21T03:51:32.899 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:51:32.899 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:51:32.899 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^up+' 2021-11-21T03:51:32.899 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:51:32.900 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:51:32.900 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.0 on gibba043 2021-11-21T03:51:32.902 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:51:32.902 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'last_update=2021-11-21 03:51:14' 2021-11-21T03:51:32.902 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-21 03:51:14' 2021-11-21T03:51:32.902 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:51:32.903 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:51:32.903 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:51:32.903 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:51:32.903 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'prev_last_update=2021-11-21 03:51:14' 2021-11-21T03:51:32.903 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-21T03:51:32.904 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror.mirror_status 2021-11-21T03:51:32.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:51:32.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror.mirror_status 2021-11-21T03:51:32.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-21T03:51:32.923 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: failed to query services: (13) Permission denied 2021-11-21T03:51:32.943 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local last_update state 2021-11-21T03:51:32.943 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-21T03:51:33.340 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ last_update='2021-11-21 03:51:14' 2021-11-21T03:51:33.340 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-21T03:51:33.341 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ state=up+replaying 2021-11-21T03:51:33.342 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:51:33.342 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep up+replaying 2021-11-21T03:51:33.342 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:51:33.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:51:33.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:51:33.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap1 2021-11-21T03:51:33.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap1 2021-11-21T03:51:33.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:51:33.345 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:51:33.345 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:51:33.345 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap1 2021-11-21T03:51:33.345 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap1 --debug-rbd=20 --debug-journaler=20 2021-11-21T03:51:37.453 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.301911353888476) > weight (0.25) 2021-11-21T03:51:37.454 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.1 2021-11-21T03:51:37.455 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Sent signal 15 2021-11-21T03:51:37.455 INFO:tasks.rbd_mirror_thrash:waiting for 3 secs before reviving daemons 2021-11-21T03:51:37.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T03:51:37.457+0000 7fbf1011c700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 (PID: 30937) UID: 1000 2021-11-21T03:51:37.656 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:daemon-helper: command failed with exit status 1 2021-11-21T03:51:40.456 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.1 2021-11-21T03:51:40.457 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T03:51:40.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T03:51:40.457 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.1 2021-11-21T03:51:40.458 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2021-11-21T03:51:40.458 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2021-11-21T03:51:40.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2021-11-21T03:51:40.462 INFO:tasks.rbd_mirror_thrash:waiting for 75 secs before thrashing 2021-11-21T03:52:03.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-21T03:52:03.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:03.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:03.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:03.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-21T03:52:03.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:03.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:03.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:03.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state=started 2021-11-21T03:52:03.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:52:03.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:52:03.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:52:04.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-21T03:52:04.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:04.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:04.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:04.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=started 2021-11-21T03:52:04.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_result 2021-11-21T03:52:04.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=stopped 2021-11-21T03:52:04.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-21T03:52:04.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_instance=cluster1 2021-11-21T03:52:04.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:52:04.405 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ grep -i state 2021-11-21T03:52:04.405 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T03:52:04.405 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance=cluster1 2021-11-21T03:52:04.405 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local loop_instance 2021-11-21T03:52:04.406 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:52:04.406 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 0 2021-11-21T03:52:04.406 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:52:04.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:52:04.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:52:04.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:52:04.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:52:04.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:52:04.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:52:04.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:52:04.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:52:04.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:52:04.412 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:52:04.412 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:52:04.412 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:52:04.412 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:52:04.412 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:52:04.413 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:52:04.413 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:52:04.413 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:52:04.413 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:52:04.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:52:04.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:52:04.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:52:04.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:52:04.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:52:04.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:52:04.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:52:04.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:52:04.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:52:04.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:52:04.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:52:04.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:52:04.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:52:04.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:52:04.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:52:04.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:52:04.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:52:04.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:52:04.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:52:04.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ return 0 2021-11-21T03:52:04.478 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ status_result=' "state": "Replaying"' 2021-11-21T03:52:04.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo ' "state": "Replaying"' 2021-11-21T03:52:04.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep -i Replaying 2021-11-21T03:52:04.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "state": "Replaying" 2021-11-21T03:52:04.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_state=started 2021-11-21T03:52:04.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test started = started 2021-11-21T03:52:04.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:52:04.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-21T03:52:04.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:52:04.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:52:04.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:04.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:04.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = journal ']' 2021-11-21T03:52:04.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = snapshot ']' 2021-11-21T03:52:04.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-21T03:52:04.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:52:04.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:52:04.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:04.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:04.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster2-mirror-test.status 2021-11-21T03:52:04.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster2-mirror-test.status 2021-11-21T03:52:04.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:52:04.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:52:04.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.status 2021-11-21T03:52:04.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.status 2021-11-21T03:52:04.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:52:04.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:04.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-21T03:52:04.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:52:04.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:04.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:04.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-21T03:52:05.400 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Snapshot ID: 6 2021-11-21T03:52:05.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:52:05.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:52:05.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:05.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:05.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:52:05.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-21T03:52:05.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:52:05.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-21T03:52:05.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snapshot_id=6 2021-11-21T03:52:05.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:52:05.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:52:05.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.2 2021-11-21T03:52:05.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:05.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:05.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:05.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:05.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:05.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:52:05.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:52:05.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:52:05.671 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=4 2021-11-21T03:52:05.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 6 = 4 2021-11-21T03:52:05.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:52:05.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.4 2021-11-21T03:52:06.072 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:06.073 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:06.073 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:06.073 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:06.074 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:06.074 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:52:06.074 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:52:06.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:52:06.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=4 2021-11-21T03:52:06.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 6 = 4 2021-11-21T03:52:06.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:52:06.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.8 2021-11-21T03:52:06.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:06.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:06.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:06.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:06.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:06.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:52:06.913 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:52:06.944 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:52:06.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:52:06.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:52:06.946 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:52:06.946 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:52:06.946 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:52:06.946 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 6 = '' 2021-11-21T03:52:06.947 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:52:06.947 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1.6 2021-11-21T03:52:08.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:08.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:08.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:08.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:08.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:08.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:52:08.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:52:08.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:52:08.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=6 2021-11-21T03:52:08.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 6 = 6 2021-11-21T03:52:08.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:52:08.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snap_present cluster1 mirror test snap1 2021-11-21T03:52:08.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:08.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:08.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:08.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap1 2021-11-21T03:52:08.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:52:08.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-21T03:52:08.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:52:09.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 info mirror/test@snap1 2021-11-21T03:52:09.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'test': 2021-11-21T03:52:09.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 512 MiB in 128 objects 2021-11-21T03:52:09.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T03:52:09.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 2 2021-11-21T03:52:09.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 10a2324c201b 2021-11-21T03:52:09.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.10a2324c201b 2021-11-21T03:52:09.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T03:52:09.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T03:52:09.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T03:52:09.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T03:52:09.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:52:09.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:52:09.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:52:09.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: protected: False 2021-11-21T03:52:09.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T03:52:09.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T03:52:09.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:52:09.625 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T03:52:09.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:52:09.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:52:09.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap1 2021-11-21T03:52:09.629 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:09.629 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:09.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap1 2021-11-21T03:52:09.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:52:09.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:52:09.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:52:09.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:52:09.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap1 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:52:10.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:52:10.090 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap1 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:52:10.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:52:10.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:52:10.783 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:52:10.878 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:52:10.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ clean_snap_name=snap1-clean 2021-11-21T03:52:10.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap1-clean 2021-11-21T03:52:10.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:52:10.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:10.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:10.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap1-clean 2021-11-21T03:52:10.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap1-clean --debug-rbd=20 --debug-journaler=20 2021-11-21T03:52:11.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T03:52:11.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror test 2021-11-21T03:52:11.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:52:11.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:11.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:11.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T03:52:11.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=14 2021-11-21T03:52:11.412 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T03:52:11.412 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 14s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-21T03:52:11.557 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 18202624 bytes 2021-11-21T03:52:11.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 48456704 bytes 2021-11-21T03:52:11.698 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 95129600 bytes 2021-11-21T03:52:11.733 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 95745024 bytes 2021-11-21T03:52:11.796 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 134315008 bytes 2021-11-21T03:52:11.851 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 168155136 bytes 2021-11-21T03:52:11.939 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 238317568 bytes 2021-11-21T03:52:11.967 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 243301376 bytes 2021-11-21T03:52:12.002 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 255544320 bytes 2021-11-21T03:52:12.051 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 279640064 bytes 2021-11-21T03:52:12.077 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 288454656 bytes 2021-11-21T03:52:12.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 346269696 bytes 2021-11-21T03:52:12.207 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 372664320 bytes 2021-11-21T03:52:12.236 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 376782848 bytes 2021-11-21T03:52:12.306 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 423928832 bytes 2021-11-21T03:52:12.365 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 461116416 bytes 2021-11-21T03:52:12.389 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 461742080 bytes 2021-11-21T03:52:12.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 482465792 bytes 2021-11-21T03:52:12.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 490454016 bytes 2021-11-21T03:52:12.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 499116032 bytes 2021-11-21T03:52:12.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 577433600 bytes 2021-11-21T03:52:12.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 613384192 bytes 2021-11-21T03:52:12.734 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 673815552 bytes 2021-11-21T03:52:12.790 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 704566272 bytes 2021-11-21T03:52:12.871 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 757284864 bytes 2021-11-21T03:52:12.962 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 831331328 bytes 2021-11-21T03:52:13.001 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 847139840 bytes 2021-11-21T03:52:13.056 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 885425152 bytes 2021-11-21T03:52:13.125 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 922292224 bytes 2021-11-21T03:52:13.218 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 989438976 bytes 2021-11-21T03:52:13.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1020664832 bytes 2021-11-21T03:52:13.326 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1038466048 bytes 2021-11-21T03:52:13.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1141880832 bytes 2021-11-21T03:52:13.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1145755648 bytes 2021-11-21T03:52:13.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1178457088 bytes 2021-11-21T03:52:13.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1230990336 bytes 2021-11-21T03:52:13.675 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1274301440 bytes 2021-11-21T03:52:13.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1328045056 bytes 2021-11-21T03:52:13.797 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1387950080 bytes 2021-11-21T03:52:13.898 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1432433664 bytes 2021-11-21T03:52:13.941 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1450736640 bytes 2021-11-21T03:52:13.980 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1469551616 bytes 2021-11-21T03:52:14.009 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1475810304 bytes 2021-11-21T03:52:14.049 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1492275200 bytes 2021-11-21T03:52:14.129 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1549337600 bytes 2021-11-21T03:52:14.199 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1603898368 bytes 2021-11-21T03:52:14.274 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1658054656 bytes 2021-11-21T03:52:14.323 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 1683119104 bytes 2021-11-21T03:52:14.355 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 1693299712 bytes 2021-11-21T03:52:14.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 1708133376 bytes 2021-11-21T03:52:14.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 1745233920 bytes 2021-11-21T03:52:14.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 1772228608 bytes 2021-11-21T03:52:14.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 1832841216 bytes 2021-11-21T03:52:14.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 1865967616 bytes 2021-11-21T03:52:14.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 1872673792 bytes 2021-11-21T03:52:14.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 1949947904 bytes 2021-11-21T03:52:14.838 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 1981495296 bytes 2021-11-21T03:52:14.914 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2034643968 bytes 2021-11-21T03:52:14.979 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2078935040 bytes 2021-11-21T03:52:15.073 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2152594432 bytes 2021-11-21T03:52:15.135 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2203501568 bytes 2021-11-21T03:52:15.207 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2245479424 bytes 2021-11-21T03:52:15.312 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2322812928 bytes 2021-11-21T03:52:15.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2371525632 bytes 2021-11-21T03:52:15.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2436934656 bytes 2021-11-21T03:52:15.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2496437248 bytes 2021-11-21T03:52:15.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2531281920 bytes 2021-11-21T03:52:15.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2546193408 bytes 2021-11-21T03:52:15.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2580773888 bytes 2021-11-21T03:52:15.760 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2599717888 bytes 2021-11-21T03:52:15.820 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 2635167744 bytes 2021-11-21T03:52:15.890 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 2680912896 bytes 2021-11-21T03:52:15.918 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 2683529216 bytes 2021-11-21T03:52:15.967 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 2709236736 bytes 2021-11-21T03:52:16.049 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 2766509056 bytes 2021-11-21T03:52:16.121 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 2831749120 bytes 2021-11-21T03:52:16.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 2840412160 bytes 2021-11-21T03:52:16.256 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 2909320192 bytes 2021-11-21T03:52:16.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 2966881280 bytes 2021-11-21T03:52:16.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3037759488 bytes 2021-11-21T03:52:16.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3107010560 bytes 2021-11-21T03:52:16.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3167818752 bytes 2021-11-21T03:52:16.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3347713024 bytes 2021-11-21T03:52:16.870 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3375383552 bytes 2021-11-21T03:52:16.980 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3453796352 bytes 2021-11-21T03:52:17.054 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3504051200 bytes 2021-11-21T03:52:17.079 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3507348480 bytes 2021-11-21T03:52:17.121 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3534979072 bytes 2021-11-21T03:52:17.244 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3625828352 bytes 2021-11-21T03:52:17.354 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3715979264 bytes 2021-11-21T03:52:17.399 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3735687168 bytes 2021-11-21T03:52:17.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3749969920 bytes 2021-11-21T03:52:17.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 3767854080 bytes 2021-11-21T03:52:17.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 3782498304 bytes 2021-11-21T03:52:17.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 3845621760 bytes 2021-11-21T03:52:17.720 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 3938357248 bytes 2021-11-21T03:52:17.812 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 4024182784 bytes 2021-11-21T03:52:17.906 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 4072773632 bytes 2021-11-21T03:52:17.933 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 4078575616 bytes 2021-11-21T03:52:18.013 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 4149444608 bytes 2021-11-21T03:52:18.080 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4179148800 bytes 2021-11-21T03:52:18.126 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4205106176 bytes 2021-11-21T03:52:18.171 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4224236544 bytes 2021-11-21T03:52:18.218 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4269796352 bytes 2021-11-21T03:52:18.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4317600768 bytes 2021-11-21T03:52:18.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4373858304 bytes 2021-11-21T03:52:18.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4462103552 bytes 2021-11-21T03:52:18.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4513969152 bytes 2021-11-21T03:52:18.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4554059776 bytes 2021-11-21T03:52:18.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4600770560 bytes 2021-11-21T03:52:18.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 4628242432 bytes 2021-11-21T03:52:18.837 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 4653573120 bytes 2021-11-21T03:52:18.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 4671839232 bytes 2021-11-21T03:52:18.951 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 4718012416 bytes 2021-11-21T03:52:19.053 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 4782453760 bytes 2021-11-21T03:52:19.086 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 4791624704 bytes 2021-11-21T03:52:19.143 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 4843287552 bytes 2021-11-21T03:52:19.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 4888963072 bytes 2021-11-21T03:52:19.257 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 4896119808 bytes 2021-11-21T03:52:19.331 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 4937867264 bytes 2021-11-21T03:52:19.364 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 4944583680 bytes 2021-11-21T03:52:19.399 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 4954748928 bytes 2021-11-21T03:52:19.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 4968621056 bytes 2021-11-21T03:52:19.471 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 4987701248 bytes 2021-11-21T03:52:19.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 5003627520 bytes 2021-11-21T03:52:19.601 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12600 IOs, 5059654656 bytes 2021-11-21T03:52:19.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12700 IOs, 5100064768 bytes 2021-11-21T03:52:19.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12800 IOs, 5154941952 bytes 2021-11-21T03:52:19.798 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12900 IOs, 5182220288 bytes 2021-11-21T03:52:19.854 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13000 IOs, 5226994688 bytes 2021-11-21T03:52:19.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13100 IOs, 5246216192 bytes 2021-11-21T03:52:19.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13200 IOs, 5282653184 bytes 2021-11-21T03:52:20.039 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13300 IOs, 5323374592 bytes 2021-11-21T03:52:20.079 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13400 IOs, 5336884224 bytes 2021-11-21T03:52:20.142 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13500 IOs, 5376397312 bytes 2021-11-21T03:52:20.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13600 IOs, 5434151936 bytes 2021-11-21T03:52:20.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13700 IOs, 5477548032 bytes 2021-11-21T03:52:20.423 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13800 IOs, 5602504704 bytes 2021-11-21T03:52:20.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13900 IOs, 5641998336 bytes 2021-11-21T03:52:20.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14000 IOs, 5664429056 bytes 2021-11-21T03:52:20.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14100 IOs, 5703457792 bytes 2021-11-21T03:52:20.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14200 IOs, 5732618240 bytes 2021-11-21T03:52:20.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14300 IOs, 5753248768 bytes 2021-11-21T03:52:20.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14400 IOs, 5801314304 bytes 2021-11-21T03:52:20.873 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14500 IOs, 5849417728 bytes 2021-11-21T03:52:20.957 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14600 IOs, 5910296576 bytes 2021-11-21T03:52:20.989 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14700 IOs, 5940237312 bytes 2021-11-21T03:52:21.124 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14800 IOs, 6027756544 bytes 2021-11-21T03:52:21.175 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14900 IOs, 6072079360 bytes 2021-11-21T03:52:21.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15000 IOs, 6076717056 bytes 2021-11-21T03:52:21.290 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15100 IOs, 6125158400 bytes 2021-11-21T03:52:21.350 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15200 IOs, 6146872320 bytes 2021-11-21T03:52:21.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15300 IOs, 6186501120 bytes 2021-11-21T03:52:21.473 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15400 IOs, 6222625792 bytes 2021-11-21T03:52:21.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15500 IOs, 6234219520 bytes 2021-11-21T03:52:21.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15600 IOs, 6240195584 bytes 2021-11-21T03:52:21.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15700 IOs, 6277008384 bytes 2021-11-21T03:52:21.676 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15800 IOs, 6324708352 bytes 2021-11-21T03:52:21.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15900 IOs, 6374623232 bytes 2021-11-21T03:52:21.801 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16000 IOs, 6391157760 bytes 2021-11-21T03:52:21.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16100 IOs, 6445129728 bytes 2021-11-21T03:52:21.952 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16200 IOs, 6494980096 bytes 2021-11-21T03:52:22.077 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16300 IOs, 6615389184 bytes 2021-11-21T03:52:22.150 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16400 IOs, 6639086592 bytes 2021-11-21T03:52:22.204 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16500 IOs, 6666132480 bytes 2021-11-21T03:52:22.277 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16600 IOs, 6714048512 bytes 2021-11-21T03:52:22.305 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16700 IOs, 6720575488 bytes 2021-11-21T03:52:22.367 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16800 IOs, 6750709760 bytes 2021-11-21T03:52:22.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16900 IOs, 6787086336 bytes 2021-11-21T03:52:22.494 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17000 IOs, 6831064064 bytes 2021-11-21T03:52:22.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17100 IOs, 6835811328 bytes 2021-11-21T03:52:22.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17200 IOs, 6883644416 bytes 2021-11-21T03:52:22.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17300 IOs, 6919633920 bytes 2021-11-21T03:52:22.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17400 IOs, 6972921856 bytes 2021-11-21T03:52:22.837 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17500 IOs, 7036311552 bytes 2021-11-21T03:52:22.883 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17600 IOs, 7064211456 bytes 2021-11-21T03:52:22.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17700 IOs, 7142821888 bytes 2021-11-21T03:52:23.056 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17800 IOs, 7180236800 bytes 2021-11-21T03:52:23.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17900 IOs, 7195948032 bytes 2021-11-21T03:52:23.145 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18000 IOs, 7220447232 bytes 2021-11-21T03:52:23.202 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18100 IOs, 7252591616 bytes 2021-11-21T03:52:23.271 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18200 IOs, 7294973952 bytes 2021-11-21T03:52:23.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18300 IOs, 7377022976 bytes 2021-11-21T03:52:23.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18400 IOs, 7441379328 bytes 2021-11-21T03:52:23.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18500 IOs, 7478345728 bytes 2021-11-21T03:52:23.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18600 IOs, 7531747328 bytes 2021-11-21T03:52:23.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18700 IOs, 7602831360 bytes 2021-11-21T03:52:23.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18800 IOs, 7683790848 bytes 2021-11-21T03:52:23.887 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:18900 IOs, 7730839552 bytes 2021-11-21T03:52:23.944 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19000 IOs, 7771798528 bytes 2021-11-21T03:52:24.036 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19100 IOs, 7829940224 bytes 2021-11-21T03:52:24.136 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19200 IOs, 7880979456 bytes 2021-11-21T03:52:24.215 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19300 IOs, 7925953536 bytes 2021-11-21T03:52:24.261 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19400 IOs, 7947100160 bytes 2021-11-21T03:52:24.299 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19500 IOs, 7989666816 bytes 2021-11-21T03:52:24.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19600 IOs, 8042889216 bytes 2021-11-21T03:52:24.494 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19700 IOs, 8101847040 bytes 2021-11-21T03:52:24.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19800 IOs, 8184413184 bytes 2021-11-21T03:52:24.657 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:19900 IOs, 8207407104 bytes 2021-11-21T03:52:24.725 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20000 IOs, 8251855872 bytes 2021-11-21T03:52:24.759 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20100 IOs, 8260372480 bytes 2021-11-21T03:52:24.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20200 IOs, 8366812160 bytes 2021-11-21T03:52:24.980 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20300 IOs, 8440010752 bytes 2021-11-21T03:52:25.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20400 IOs, 8545295360 bytes 2021-11-21T03:52:25.137 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20500 IOs, 8546850816 bytes 2021-11-21T03:52:25.220 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20600 IOs, 8604915712 bytes 2021-11-21T03:52:25.290 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20700 IOs, 8655864832 bytes 2021-11-21T03:52:25.358 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20800 IOs, 8690006016 bytes 2021-11-21T03:52:25.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:20900 IOs, 8713689088 bytes 2021-11-21T03:52:25.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T03:52:25.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T03:52:25.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T03:52:25.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:52:25.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-21T03:52:25.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:25.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:25.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:25.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:52:25.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:52:25.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:52:25.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:52:25.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:52:26.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-21T03:52:26.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:26.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:26.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:26.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:52:26.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:52:26.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:52:26.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-21T03:52:26.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-21T03:52:26.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:52:26.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:52:26.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:52:26.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-21T03:52:26.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ tee /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:52:26.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:test: 2021-11-21T03:52:26.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: global_id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:52:26.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+replaying 2021-11-21T03:52:26.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: replaying, {"bytes_per_second":17885866.67,"bytes_per_snapshot":268288000.0,"local_snapshot_timestamp":1637466725,"remote_snapshot_timestamp":1637466725,"replay_state":"idle"} 2021-11-21T03:52:26.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: service: mirror.0 on gibba043 2021-11-21T03:52:26.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:52:11 2021-11-21T03:52:26.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: peer_sites: 2021-11-21T03:52:26.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: name: cluster2 2021-11-21T03:52:26.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+stopped 2021-11-21T03:52:26.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: local image is primary 2021-11-21T03:52:26.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:52:12 2021-11-21T03:52:26.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:52:26.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T03:52:26.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ description: .*' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:52:26.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":17885866.67,"bytes_per_snapshot":268288000.0,"local_snapshot_timestamp":1637466725,"remote_snapshot_timestamp":1637466725,"replay_state":"idle"} 2021-11-21T03:52:26.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:52:26.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:52:26.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^up+' 2021-11-21T03:52:26.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:52:26.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:52:26.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.0 on gibba043 2021-11-21T03:52:26.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:52:26.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'last_update=2021-11-21 03:52:11' 2021-11-21T03:52:26.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-21 03:52:11' 2021-11-21T03:52:26.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:26.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:26.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:26.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:52:26.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'prev_last_update=2021-11-21 03:52:11' 2021-11-21T03:52:26.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-21T03:52:26.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror.mirror_status 2021-11-21T03:52:26.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:52:26.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror.mirror_status 2021-11-21T03:52:26.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-21T03:52:26.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: failed to query services: (13) Permission denied 2021-11-21T03:52:26.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local last_update state 2021-11-21T03:52:26.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-21T03:52:26.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ last_update='2021-11-21 03:52:11' 2021-11-21T03:52:26.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-21T03:52:26.812 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ state=up+replaying 2021-11-21T03:52:26.813 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:52:26.813 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep up+replaying 2021-11-21T03:52:26.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:52:26.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:52:26.816 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:52:26.817 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap2 2021-11-21T03:52:26.817 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap2 2021-11-21T03:52:26.817 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:52:26.818 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:26.818 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:26.818 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap2 2021-11-21T03:52:26.818 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap2 --debug-rbd=20 --debug-journaler=20 2021-11-21T03:52:53.466 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.399366590195548) > weight (0.25) 2021-11-21T03:52:53.466 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.9365641432855929) > weight (0.25) 2021-11-21T03:52:53.467 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.2 with skip (0.6672657515636151) > weight (0.25) 2021-11-21T03:52:53.467 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.3 with skip (0.2901896320996864) > weight (0.25) 2021-11-21T03:52:53.467 INFO:tasks.rbd_mirror_thrash:waiting for 77 secs before thrashing 2021-11-21T03:52:55.463 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.4856919127744129) > weight (0.25) 2021-11-21T03:52:55.464 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.2923401363502184) > weight (0.25) 2021-11-21T03:52:55.464 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.2 2021-11-21T03:52:55.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Sent signal 15 2021-11-21T03:52:55.465 INFO:tasks.rbd_mirror_thrash:waiting for 0 secs before reviving daemons 2021-11-21T03:52:55.465 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.2 2021-11-21T03:52:55.465 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T03:52:55.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.gibba043.stderr:2021-11-21T03:52:55.468+0000 7f1c7f972700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 (PID: 30979) UID: 1000 2021-11-21T03:52:55.666 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.gibba043.stderr:daemon-helper: command failed with exit status 1 2021-11-21T03:52:56.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-21T03:52:56.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:56.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:56.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:56.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-21T03:52:56.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:56.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:56.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:56.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state=started 2021-11-21T03:52:56.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:52:56.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:52:56.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:52:57.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-21T03:52:57.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:57.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:57.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:57.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=started 2021-11-21T03:52:57.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_result 2021-11-21T03:52:57.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=stopped 2021-11-21T03:52:57.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-21T03:52:57.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_instance=cluster1 2021-11-21T03:52:57.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:52:57.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ grep -i state 2021-11-21T03:52:57.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T03:52:57.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance=cluster1 2021-11-21T03:52:57.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local loop_instance 2021-11-21T03:52:57.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:52:57.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 0 2021-11-21T03:52:57.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:52:57.422 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:52:57.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:52:57.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:52:57.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:52:57.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:52:57.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:52:57.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:52:57.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:52:57.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:52:57.427 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:52:57.427 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:52:57.427 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:52:57.427 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:52:57.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:52:57.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:52:57.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:52:57.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:52:57.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:52:57.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:52:57.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:52:57.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:52:57.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:52:57.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:52:57.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:52:57.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:52:57.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:52:57.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:52:57.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:52:57.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:52:57.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:52:57.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:52:57.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:52:57.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:52:57.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:52:57.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:52:57.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:52:57.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:52:57.493 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ return 0 2021-11-21T03:52:57.493 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ status_result=' "state": "Replaying"' 2021-11-21T03:52:57.494 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo ' "state": "Replaying"' 2021-11-21T03:52:57.494 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep -i Replaying 2021-11-21T03:52:57.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "state": "Replaying" 2021-11-21T03:52:57.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_state=started 2021-11-21T03:52:57.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test started = started 2021-11-21T03:52:57.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:52:57.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-21T03:52:57.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:52:57.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:52:57.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:57.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:57.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = journal ']' 2021-11-21T03:52:57.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = snapshot ']' 2021-11-21T03:52:57.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-21T03:52:57.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:52:57.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:52:57.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:57.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:57.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster2-mirror-test.status 2021-11-21T03:52:57.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster2-mirror-test.status 2021-11-21T03:52:57.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:52:57.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:52:57.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.status 2021-11-21T03:52:57.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.status 2021-11-21T03:52:57.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:52:57.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:57.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-21T03:52:57.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:52:57.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:57.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:57.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-21T03:52:58.422 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Snapshot ID: 10 2021-11-21T03:52:58.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:52:58.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:52:58.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:58.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:58.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:52:58.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-21T03:52:58.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:52:58.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-21T03:52:58.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snapshot_id=10 2021-11-21T03:52:58.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:52:58.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:52:58.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.2 2021-11-21T03:52:58.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:58.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:58.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:58.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:58.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:58.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:52:58.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:52:58.696 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:52:58.697 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=6 2021-11-21T03:52:58.698 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 10 = 6 2021-11-21T03:52:58.698 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:52:58.698 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.4 2021-11-21T03:52:59.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:59.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:59.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:59.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:59.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:59.100 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:52:59.100 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:52:59.134 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:52:59.135 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=6 2021-11-21T03:52:59.135 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 10 = 6 2021-11-21T03:52:59.135 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:52:59.136 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.8 2021-11-21T03:52:59.936 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:59.937 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:52:59.937 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:52:59.937 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:52:59.937 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:52:59.937 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:52:59.938 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:52:59.971 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:52:59.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:52:59.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:52:59.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:52:59.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:52:59.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:52:59.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 10 = '' 2021-11-21T03:52:59.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:52:59.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1.6 2021-11-21T03:53:01.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T03:53:01.567 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.2 2021-11-21T03:53:01.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Restarting daemon 2021-11-21T03:53:01.568 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 2021-11-21T03:53:01.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Started 2021-11-21T03:53:01.571 INFO:tasks.rbd_mirror_thrash:waiting for 77 secs before thrashing 2021-11-21T03:53:01.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:53:01.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:01.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:01.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:01.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:53:01.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:53:01.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:53:01.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:53:01.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:53:01.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:53:01.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:53:01.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:53:01.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:53:01.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 10 = '' 2021-11-21T03:53:01.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:53:01.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 2 2021-11-21T03:53:03.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:53:03.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:03.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:03.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:03.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:53:03.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:53:03.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:53:03.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:53:03.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=10 2021-11-21T03:53:03.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 10 = 10 2021-11-21T03:53:03.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:53:03.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snap_present cluster1 mirror test snap2 2021-11-21T03:53:03.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:03.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:03.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:03.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap2 2021-11-21T03:53:03.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:53:03.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-21T03:53:03.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:53:04.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 info mirror/test@snap2 2021-11-21T03:53:04.882 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'test': 2021-11-21T03:53:04.883 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 512 MiB in 128 objects 2021-11-21T03:53:04.883 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T03:53:04.884 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 4 2021-11-21T03:53:04.884 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 10a2324c201b 2021-11-21T03:53:04.884 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.10a2324c201b 2021-11-21T03:53:04.885 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T03:53:04.885 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T03:53:04.886 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T03:53:04.886 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T03:53:04.887 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:53:04.887 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:53:04.887 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:53:04.888 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: protected: False 2021-11-21T03:53:04.888 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T03:53:04.889 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T03:53:04.889 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:53:04.890 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T03:53:04.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:53:04.893 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snap1-clean ']' 2021-11-21T03:53:04.893 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap1-clean 2021-11-21T03:53:04.894 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:04.894 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:04.895 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap1-clean 2021-11-21T03:53:04.895 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:53:04.896 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:53:04.896 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:04.896 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:04.897 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap1-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:53:05.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:53:05.321 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap1-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:05.952 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:53:05.955 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:06.083 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:06.185 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:53:06.185 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap2 2021-11-21T03:53:06.185 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:06.186 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:06.186 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap2 2021-11-21T03:53:06.186 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:53:06.186 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:53:06.187 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:06.187 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:06.187 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap2 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:53:06.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:53:06.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap2 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:07.297 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:53:07.300 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:07.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:07.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:53:07.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ clean_snap_name=snap2-clean 2021-11-21T03:53:07.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap2-clean 2021-11-21T03:53:07.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:53:07.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:07.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:07.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap2-clean 2021-11-21T03:53:07.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap2-clean --debug-rbd=20 --debug-journaler=20 2021-11-21T03:53:08.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T03:53:08.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror test 2021-11-21T03:53:08.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:53:08.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:08.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:08.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T03:53:08.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=12 2021-11-21T03:53:08.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T03:53:08.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 12s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-21T03:53:08.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 55369728 bytes 2021-11-21T03:53:08.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 65381376 bytes 2021-11-21T03:53:08.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 109638656 bytes 2021-11-21T03:53:08.761 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 110322688 bytes 2021-11-21T03:53:08.796 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 120213504 bytes 2021-11-21T03:53:08.851 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 147480576 bytes 2021-11-21T03:53:08.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 170412032 bytes 2021-11-21T03:53:08.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 225933312 bytes 2021-11-21T03:53:09.007 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 231806976 bytes 2021-11-21T03:53:09.058 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 256440320 bytes 2021-11-21T03:53:09.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 281900032 bytes 2021-11-21T03:53:09.165 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 316899328 bytes 2021-11-21T03:53:09.255 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 373807104 bytes 2021-11-21T03:53:09.405 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 439579648 bytes 2021-11-21T03:53:09.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 468573184 bytes 2021-11-21T03:53:09.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 500763648 bytes 2021-11-21T03:53:09.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 542512128 bytes 2021-11-21T03:53:09.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 592001024 bytes 2021-11-21T03:53:09.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 640468992 bytes 2021-11-21T03:53:09.798 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 662889472 bytes 2021-11-21T03:53:09.867 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 706375680 bytes 2021-11-21T03:53:09.897 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 708121600 bytes 2021-11-21T03:53:10.175 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 766906368 bytes 2021-11-21T03:53:10.205 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 767513600 bytes 2021-11-21T03:53:10.242 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 779932672 bytes 2021-11-21T03:53:10.337 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 845286400 bytes 2021-11-21T03:53:10.381 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 860991488 bytes 2021-11-21T03:53:10.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 902444032 bytes 2021-11-21T03:53:10.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 941563904 bytes 2021-11-21T03:53:10.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1014460416 bytes 2021-11-21T03:53:10.662 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1039297536 bytes 2021-11-21T03:53:10.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1089055744 bytes 2021-11-21T03:53:10.832 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1146424320 bytes 2021-11-21T03:53:10.923 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1209873408 bytes 2021-11-21T03:53:10.965 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1224690688 bytes 2021-11-21T03:53:11.015 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1262871552 bytes 2021-11-21T03:53:11.069 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1271868416 bytes 2021-11-21T03:53:11.134 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1336346624 bytes 2021-11-21T03:53:11.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1444374528 bytes 2021-11-21T03:53:11.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1498677248 bytes 2021-11-21T03:53:11.492 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1586739200 bytes 2021-11-21T03:53:11.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1601507328 bytes 2021-11-21T03:53:11.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1650572288 bytes 2021-11-21T03:53:11.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1724449792 bytes 2021-11-21T03:53:11.757 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1777713152 bytes 2021-11-21T03:53:11.865 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1824457728 bytes 2021-11-21T03:53:11.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1843138560 bytes 2021-11-21T03:53:11.996 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 1896720384 bytes 2021-11-21T03:53:12.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 1941234688 bytes 2021-11-21T03:53:12.153 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2002402304 bytes 2021-11-21T03:53:12.187 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2004208640 bytes 2021-11-21T03:53:12.258 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2046363648 bytes 2021-11-21T03:53:12.361 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2120634368 bytes 2021-11-21T03:53:12.423 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2163150848 bytes 2021-11-21T03:53:12.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2215623680 bytes 2021-11-21T03:53:12.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2216228864 bytes 2021-11-21T03:53:12.625 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2274631680 bytes 2021-11-21T03:53:12.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2326956032 bytes 2021-11-21T03:53:12.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2344027136 bytes 2021-11-21T03:53:12.818 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2393872384 bytes 2021-11-21T03:53:12.875 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2416022528 bytes 2021-11-21T03:53:12.955 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2469805056 bytes 2021-11-21T03:53:13.003 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2490040320 bytes 2021-11-21T03:53:13.122 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2580730880 bytes 2021-11-21T03:53:13.185 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2618797056 bytes 2021-11-21T03:53:13.239 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2640457728 bytes 2021-11-21T03:53:13.270 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2643474432 bytes 2021-11-21T03:53:13.304 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2649764864 bytes 2021-11-21T03:53:13.361 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2679878656 bytes 2021-11-21T03:53:13.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2707096576 bytes 2021-11-21T03:53:13.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 2751203328 bytes 2021-11-21T03:53:13.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 2768481280 bytes 2021-11-21T03:53:13.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 2803959808 bytes 2021-11-21T03:53:13.682 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 2871467008 bytes 2021-11-21T03:53:13.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 2930146304 bytes 2021-11-21T03:53:13.848 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 2981023744 bytes 2021-11-21T03:53:13.924 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3027411968 bytes 2021-11-21T03:53:14.015 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3111713792 bytes 2021-11-21T03:53:14.104 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3156034560 bytes 2021-11-21T03:53:14.150 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3172972544 bytes 2021-11-21T03:53:14.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3173582848 bytes 2021-11-21T03:53:14.265 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3232945152 bytes 2021-11-21T03:53:14.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3278597120 bytes 2021-11-21T03:53:14.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3346879488 bytes 2021-11-21T03:53:14.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3405045760 bytes 2021-11-21T03:53:14.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3405681664 bytes 2021-11-21T03:53:14.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3425323008 bytes 2021-11-21T03:53:14.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3450074112 bytes 2021-11-21T03:53:14.695 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3473628160 bytes 2021-11-21T03:53:14.764 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3508518912 bytes 2021-11-21T03:53:14.841 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3559337984 bytes 2021-11-21T03:53:14.921 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3626207232 bytes 2021-11-21T03:53:14.980 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 3637260288 bytes 2021-11-21T03:53:15.031 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 3664835584 bytes 2021-11-21T03:53:15.072 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 3671911424 bytes 2021-11-21T03:53:15.115 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 3685808128 bytes 2021-11-21T03:53:15.167 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 3708684288 bytes 2021-11-21T03:53:15.258 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 3758396416 bytes 2021-11-21T03:53:15.341 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 3811025920 bytes 2021-11-21T03:53:15.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 3847316480 bytes 2021-11-21T03:53:15.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 3914532864 bytes 2021-11-21T03:53:15.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 3968391168 bytes 2021-11-21T03:53:15.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4002887680 bytes 2021-11-21T03:53:15.722 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4051187712 bytes 2021-11-21T03:53:15.818 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4120978432 bytes 2021-11-21T03:53:15.877 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4165035008 bytes 2021-11-21T03:53:15.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4256271360 bytes 2021-11-21T03:53:16.051 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4272246784 bytes 2021-11-21T03:53:16.084 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4275941376 bytes 2021-11-21T03:53:16.144 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4309800960 bytes 2021-11-21T03:53:16.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 4310421504 bytes 2021-11-21T03:53:16.252 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 4358477824 bytes 2021-11-21T03:53:16.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 4370700288 bytes 2021-11-21T03:53:16.345 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 4403415040 bytes 2021-11-21T03:53:16.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 4431531008 bytes 2021-11-21T03:53:16.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 4445232128 bytes 2021-11-21T03:53:16.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 4470363136 bytes 2021-11-21T03:53:16.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 4510240768 bytes 2021-11-21T03:53:16.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 4537260032 bytes 2021-11-21T03:53:16.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 4615503872 bytes 2021-11-21T03:53:16.822 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 4664616960 bytes 2021-11-21T03:53:16.926 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 4752262144 bytes 2021-11-21T03:53:16.986 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 4774091776 bytes 2021-11-21T03:53:17.127 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 4873039872 bytes 2021-11-21T03:53:17.184 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 4905502720 bytes 2021-11-21T03:53:17.257 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12600 IOs, 4981662720 bytes 2021-11-21T03:53:17.353 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12700 IOs, 5042155520 bytes 2021-11-21T03:53:17.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12800 IOs, 5054316544 bytes 2021-11-21T03:53:17.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12900 IOs, 5156025344 bytes 2021-11-21T03:53:17.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13000 IOs, 5208521728 bytes 2021-11-21T03:53:17.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13100 IOs, 5265268736 bytes 2021-11-21T03:53:17.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13200 IOs, 5306452992 bytes 2021-11-21T03:53:17.907 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13300 IOs, 5403266048 bytes 2021-11-21T03:53:18.008 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13400 IOs, 5480589312 bytes 2021-11-21T03:53:18.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13500 IOs, 5511982080 bytes 2021-11-21T03:53:18.175 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13600 IOs, 5593692160 bytes 2021-11-21T03:53:18.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13700 IOs, 5594324992 bytes 2021-11-21T03:53:18.306 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13800 IOs, 5639884800 bytes 2021-11-21T03:53:18.352 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13900 IOs, 5667548160 bytes 2021-11-21T03:53:18.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14000 IOs, 5692258304 bytes 2021-11-21T03:53:18.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14100 IOs, 5715014656 bytes 2021-11-21T03:53:18.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14200 IOs, 5775474688 bytes 2021-11-21T03:53:18.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14300 IOs, 5831199744 bytes 2021-11-21T03:53:18.694 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14400 IOs, 5846036480 bytes 2021-11-21T03:53:18.816 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14500 IOs, 5924775936 bytes 2021-11-21T03:53:18.890 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14600 IOs, 5978485760 bytes 2021-11-21T03:53:18.940 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14700 IOs, 5990519808 bytes 2021-11-21T03:53:18.980 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14800 IOs, 6001755136 bytes 2021-11-21T03:53:19.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14900 IOs, 6014469120 bytes 2021-11-21T03:53:19.103 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15000 IOs, 6071907328 bytes 2021-11-21T03:53:19.180 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15100 IOs, 6118420480 bytes 2021-11-21T03:53:19.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15200 IOs, 6196198400 bytes 2021-11-21T03:53:19.345 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15300 IOs, 6226632704 bytes 2021-11-21T03:53:19.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15400 IOs, 6289901568 bytes 2021-11-21T03:53:19.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15500 IOs, 6338225152 bytes 2021-11-21T03:53:19.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15600 IOs, 6383436800 bytes 2021-11-21T03:53:19.651 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15700 IOs, 6413201408 bytes 2021-11-21T03:53:19.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15800 IOs, 6441280512 bytes 2021-11-21T03:53:19.798 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15900 IOs, 6508776448 bytes 2021-11-21T03:53:19.873 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16000 IOs, 6548101120 bytes 2021-11-21T03:53:19.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16100 IOs, 6586906624 bytes 2021-11-21T03:53:19.999 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16200 IOs, 6612358144 bytes 2021-11-21T03:53:20.054 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16300 IOs, 6637465600 bytes 2021-11-21T03:53:20.142 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16400 IOs, 6695731200 bytes 2021-11-21T03:53:20.232 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16500 IOs, 6754577408 bytes 2021-11-21T03:53:20.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16600 IOs, 6837183488 bytes 2021-11-21T03:53:20.413 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T03:53:20.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T03:53:20.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T03:53:20.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:53:20.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-21T03:53:20.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:20.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:20.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:20.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:53:20.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:53:20.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:53:20.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:53:20.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:53:21.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-21T03:53:21.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:21.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:21.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:21.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:53:21.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:53:21.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:53:21.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-21T03:53:21.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-21T03:53:21.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:53:21.422 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:53:21.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:53:21.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-21T03:53:21.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ tee /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:53:21.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:test: 2021-11-21T03:53:21.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: global_id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:53:21.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+replaying 2021-11-21T03:53:21.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: replaying, {"bytes_per_second":17878664.53,"bytes_per_snapshot":536467968.0,"local_snapshot_timestamp":1637466778,"remote_snapshot_timestamp":1637466778,"replay_state":"idle"} 2021-11-21T03:53:21.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: service: mirror.0 on gibba043 2021-11-21T03:53:21.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:53:11 2021-11-21T03:53:21.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: peer_sites: 2021-11-21T03:53:21.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: name: cluster2 2021-11-21T03:53:21.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+stopped 2021-11-21T03:53:21.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: local image is primary 2021-11-21T03:53:21.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:53:12 2021-11-21T03:53:21.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:53:21.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T03:53:21.478 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ description: .*' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:53:21.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":17878664.53,"bytes_per_snapshot":536467968.0,"local_snapshot_timestamp":1637466778,"remote_snapshot_timestamp":1637466778,"replay_state":"idle"} 2021-11-21T03:53:21.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:53:21.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:53:21.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^up+' 2021-11-21T03:53:21.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:53:21.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:53:21.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.0 on gibba043 2021-11-21T03:53:21.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:53:21.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'last_update=2021-11-21 03:53:11' 2021-11-21T03:53:21.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-21 03:53:11' 2021-11-21T03:53:21.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:21.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:21.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:21.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:53:21.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'prev_last_update=2021-11-21 03:53:11' 2021-11-21T03:53:21.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-21T03:53:21.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror.mirror_status 2021-11-21T03:53:21.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:53:21.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror.mirror_status 2021-11-21T03:53:21.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-21T03:53:21.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: failed to query services: (13) Permission denied 2021-11-21T03:53:21.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local last_update state 2021-11-21T03:53:21.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-21T03:53:21.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ last_update='2021-11-21 03:53:11' 2021-11-21T03:53:21.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-21T03:53:21.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ state=up+replaying 2021-11-21T03:53:21.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:53:21.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep up+replaying 2021-11-21T03:53:21.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:53:21.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:53:21.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:53:21.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap3 2021-11-21T03:53:21.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap3 2021-11-21T03:53:21.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:53:21.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:21.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:21.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap3 2021-11-21T03:53:21.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap3 --debug-rbd=20 --debug-journaler=20 2021-11-21T03:53:51.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-21T03:53:51.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:51.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:51.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:51.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-21T03:53:51.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:51.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:51.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:51.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state=started 2021-11-21T03:53:51.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:53:51.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:53:51.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:53:52.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-21T03:53:52.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:52.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:52.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:52.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=started 2021-11-21T03:53:52.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_result 2021-11-21T03:53:52.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=stopped 2021-11-21T03:53:52.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-21T03:53:52.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_instance=cluster1 2021-11-21T03:53:52.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:53:52.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ grep -i state 2021-11-21T03:53:52.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T03:53:52.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance=cluster1 2021-11-21T03:53:52.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local loop_instance 2021-11-21T03:53:52.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:53:52.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 0 2021-11-21T03:53:52.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:53:52.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:53:52.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:53:52.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:53:52.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:53:52.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:53:52.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:53:52.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:53:52.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:53:52.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:53:52.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:53:52.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:53:52.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:53:52.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:53:52.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:53:52.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:53:52.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:53:52.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:53:52.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:53:52.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:53:52.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:53:52.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:53:52.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:53:52.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:53:52.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:53:52.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:53:52.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:53:52.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:53:52.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:53:52.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:53:52.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:53:52.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:53:52.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:53:52.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:53:52.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:53:52.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:53:52.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:53:52.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:53:52.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ return 0 2021-11-21T03:53:52.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ status_result=' "state": "Replaying"' 2021-11-21T03:53:52.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo ' "state": "Replaying"' 2021-11-21T03:53:52.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep -i Replaying 2021-11-21T03:53:52.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "state": "Replaying" 2021-11-21T03:53:52.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_state=started 2021-11-21T03:53:52.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test started = started 2021-11-21T03:53:52.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:53:52.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-21T03:53:52.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:53:52.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:53:52.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:52.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:52.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = journal ']' 2021-11-21T03:53:52.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = snapshot ']' 2021-11-21T03:53:52.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-21T03:53:52.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:53:52.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:53:52.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:52.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:52.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster2-mirror-test.status 2021-11-21T03:53:52.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster2-mirror-test.status 2021-11-21T03:53:52.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:53:52.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:53:52.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.status 2021-11-21T03:53:52.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.status 2021-11-21T03:53:52.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:53:52.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:53:52.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-21T03:53:52.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:53:52.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:52.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:52.522 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-21T03:53:53.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Snapshot ID: 14 2021-11-21T03:53:53.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:53:53.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:53:53.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:53.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:53.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:53:53.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-21T03:53:53.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:53:53.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-21T03:53:53.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snapshot_id=14 2021-11-21T03:53:53.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:53:53.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:53:53.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.2 2021-11-21T03:53:53.671 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:53:53.671 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:53.671 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:53.671 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:53.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:53:53.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:53:53.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:53:53.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:53:53.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:53:53.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:53:53.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:53:53.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:53:53.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:53:53.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 14 = '' 2021-11-21T03:53:53.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:53:53.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.4 2021-11-21T03:53:54.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:53:54.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:54.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:54.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:54.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:53:54.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:53:54.113 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:53:54.145 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:53:54.145 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:53:54.146 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:53:54.147 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:53:54.147 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:53:54.147 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:53:54.147 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 14 = '' 2021-11-21T03:53:54.148 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:53:54.148 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.8 2021-11-21T03:53:54.948 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:53:54.948 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:54.948 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:54.949 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:54.949 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:53:54.949 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:53:54.950 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:53:54.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:53:54.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:53:54.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:53:54.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:53:54.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:53:54.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:53:54.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 14 = '' 2021-11-21T03:53:54.986 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:53:54.986 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1.6 2021-11-21T03:53:56.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:53:56.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:56.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:56.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:56.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:53:56.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:53:56.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:53:56.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:53:56.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=14 2021-11-21T03:53:56.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 14 = 14 2021-11-21T03:53:56.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:53:56.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snap_present cluster1 mirror test snap3 2021-11-21T03:53:56.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:53:56.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:56.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:56.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap3 2021-11-21T03:53:56.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:53:56.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-21T03:53:56.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:53:57.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 info mirror/test@snap3 2021-11-21T03:53:57.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'test': 2021-11-21T03:53:57.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 512 MiB in 128 objects 2021-11-21T03:53:57.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T03:53:57.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 6 2021-11-21T03:53:57.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 10a2324c201b 2021-11-21T03:53:57.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.10a2324c201b 2021-11-21T03:53:57.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T03:53:57.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T03:53:57.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T03:53:57.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T03:53:57.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:53:57.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 03:53:05 2021 2021-11-21T03:53:57.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:53:57.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: protected: False 2021-11-21T03:53:57.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T03:53:57.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T03:53:57.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:53:57.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T03:53:57.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:53:57.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snap2-clean ']' 2021-11-21T03:53:57.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap2-clean 2021-11-21T03:53:57.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:57.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:57.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap2-clean 2021-11-21T03:53:57.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:53:57.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:53:57.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:57.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:57.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap2-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:53:58.093 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:53:58.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap2-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:58.798 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:53:58.801 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:58.927 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:59.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:53:59.024 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap3 2021-11-21T03:53:59.024 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:53:59.024 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:53:59.024 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap3 2021-11-21T03:53:59.025 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:53:59.025 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:53:59.025 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:59.025 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:53:59.026 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap3 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:53:59.481 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:53:59.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap3 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:54:00.094 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:54:00.096 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:54:00.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:54:00.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:54:00.320 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ clean_snap_name=snap3-clean 2021-11-21T03:54:00.320 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap3-clean 2021-11-21T03:54:00.320 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:54:00.320 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:00.321 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:00.321 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap3-clean 2021-11-21T03:54:00.321 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap3-clean --debug-rbd=20 --debug-journaler=20 2021-11-21T03:54:01.285 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T03:54:01.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror test 2021-11-21T03:54:01.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:54:01.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:01.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:01.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T03:54:01.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=12 2021-11-21T03:54:01.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T03:54:01.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 12s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-21T03:54:01.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 40064000 bytes 2021-11-21T03:54:01.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 75498496 bytes 2021-11-21T03:54:01.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 82280448 bytes 2021-11-21T03:54:01.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 82904064 bytes 2021-11-21T03:54:01.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 121661440 bytes 2021-11-21T03:54:01.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 164577280 bytes 2021-11-21T03:54:01.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 203138048 bytes 2021-11-21T03:54:01.932 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 256386048 bytes 2021-11-21T03:54:02.027 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 319838208 bytes 2021-11-21T03:54:02.120 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 380554240 bytes 2021-11-21T03:54:02.167 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 395183104 bytes 2021-11-21T03:54:02.273 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 466400256 bytes 2021-11-21T03:54:02.347 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 507012096 bytes 2021-11-21T03:54:02.406 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 534352896 bytes 2021-11-21T03:54:02.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 610912256 bytes 2021-11-21T03:54:02.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 658657280 bytes 2021-11-21T03:54:02.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 721247232 bytes 2021-11-21T03:54:02.744 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 721999872 bytes 2021-11-21T03:54:02.803 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 747927552 bytes 2021-11-21T03:54:02.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 788656128 bytes 2021-11-21T03:54:02.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 789675008 bytes 2021-11-21T03:54:02.967 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 815328256 bytes 2021-11-21T03:54:03.050 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 849661952 bytes 2021-11-21T03:54:03.086 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 857999360 bytes 2021-11-21T03:54:03.146 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 890457088 bytes 2021-11-21T03:54:03.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 995326976 bytes 2021-11-21T03:54:03.399 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1062898688 bytes 2021-11-21T03:54:03.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1078131712 bytes 2021-11-21T03:54:03.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1102702592 bytes 2021-11-21T03:54:03.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1143427072 bytes 2021-11-21T03:54:03.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1144041472 bytes 2021-11-21T03:54:03.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1186025472 bytes 2021-11-21T03:54:03.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1186639872 bytes 2021-11-21T03:54:03.808 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1241730048 bytes 2021-11-21T03:54:03.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1275141120 bytes 2021-11-21T03:54:03.920 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1303656448 bytes 2021-11-21T03:54:03.997 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1332712448 bytes 2021-11-21T03:54:04.078 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1379610624 bytes 2021-11-21T03:54:04.157 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1439260672 bytes 2021-11-21T03:54:04.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1531973632 bytes 2021-11-21T03:54:04.407 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1634135040 bytes 2021-11-21T03:54:04.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1653407744 bytes 2021-11-21T03:54:04.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1700636672 bytes 2021-11-21T03:54:04.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1760926720 bytes 2021-11-21T03:54:04.706 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1822818304 bytes 2021-11-21T03:54:04.794 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1849213952 bytes 2021-11-21T03:54:04.869 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1889796096 bytes 2021-11-21T03:54:04.939 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 1927413760 bytes 2021-11-21T03:54:04.991 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 1947355136 bytes 2021-11-21T03:54:05.094 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2015360000 bytes 2021-11-21T03:54:05.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2060214272 bytes 2021-11-21T03:54:05.246 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2103246848 bytes 2021-11-21T03:54:05.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2171950080 bytes 2021-11-21T03:54:05.427 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2222415872 bytes 2021-11-21T03:54:05.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2248142848 bytes 2021-11-21T03:54:05.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2283020288 bytes 2021-11-21T03:54:05.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2315866112 bytes 2021-11-21T03:54:05.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2384315392 bytes 2021-11-21T03:54:05.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2457137152 bytes 2021-11-21T03:54:05.894 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2480972800 bytes 2021-11-21T03:54:05.957 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2516518912 bytes 2021-11-21T03:54:06.036 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2553678848 bytes 2021-11-21T03:54:06.180 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2652561408 bytes 2021-11-21T03:54:06.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2664604672 bytes 2021-11-21T03:54:06.271 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2705933312 bytes 2021-11-21T03:54:06.398 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2769903616 bytes 2021-11-21T03:54:06.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2802189312 bytes 2021-11-21T03:54:06.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2850657280 bytes 2021-11-21T03:54:06.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2928854016 bytes 2021-11-21T03:54:06.722 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2961449984 bytes 2021-11-21T03:54:06.829 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 3033079808 bytes 2021-11-21T03:54:06.895 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 3063325696 bytes 2021-11-21T03:54:06.929 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3063913472 bytes 2021-11-21T03:54:06.994 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3092970496 bytes 2021-11-21T03:54:07.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3163731968 bytes 2021-11-21T03:54:07.169 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3198401536 bytes 2021-11-21T03:54:07.268 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3289145344 bytes 2021-11-21T03:54:07.347 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3307944960 bytes 2021-11-21T03:54:07.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3374534656 bytes 2021-11-21T03:54:07.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3412291584 bytes 2021-11-21T03:54:07.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3412934656 bytes 2021-11-21T03:54:07.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3457785856 bytes 2021-11-21T03:54:07.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3540064256 bytes 2021-11-21T03:54:07.796 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3555818496 bytes 2021-11-21T03:54:07.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3632781312 bytes 2021-11-21T03:54:08.003 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3712722944 bytes 2021-11-21T03:54:08.084 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3731954688 bytes 2021-11-21T03:54:08.136 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3754272768 bytes 2021-11-21T03:54:08.175 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3756749824 bytes 2021-11-21T03:54:08.220 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3773688832 bytes 2021-11-21T03:54:08.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3855154176 bytes 2021-11-21T03:54:08.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3995899904 bytes 2021-11-21T03:54:08.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 4015989760 bytes 2021-11-21T03:54:08.687 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 4090139648 bytes 2021-11-21T03:54:08.762 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 4132122624 bytes 2021-11-21T03:54:08.890 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 4221265920 bytes 2021-11-21T03:54:08.967 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 4272548864 bytes 2021-11-21T03:54:09.074 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 4347465728 bytes 2021-11-21T03:54:09.157 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 4388513792 bytes 2021-11-21T03:54:09.232 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 4430585856 bytes 2021-11-21T03:54:09.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4497303552 bytes 2021-11-21T03:54:09.366 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4497915904 bytes 2021-11-21T03:54:09.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4537524224 bytes 2021-11-21T03:54:09.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4597125120 bytes 2021-11-21T03:54:09.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4670365696 bytes 2021-11-21T03:54:09.706 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4698669056 bytes 2021-11-21T03:54:09.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4722239488 bytes 2021-11-21T03:54:09.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4786151424 bytes 2021-11-21T03:54:09.953 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4838838272 bytes 2021-11-21T03:54:10.002 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4851607552 bytes 2021-11-21T03:54:10.062 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 4884296704 bytes 2021-11-21T03:54:10.145 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 4930023424 bytes 2021-11-21T03:54:10.217 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 4987790336 bytes 2021-11-21T03:54:10.299 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 5015355392 bytes 2021-11-21T03:54:10.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 5018411008 bytes 2021-11-21T03:54:10.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 5084715008 bytes 2021-11-21T03:54:10.468 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.42009075609570434) > weight (0.25) 2021-11-21T03:54:10.468 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.34342817605086906) > weight (0.25) 2021-11-21T03:54:10.469 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.2 2021-11-21T03:54:10.469 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Sent signal 15 2021-11-21T03:54:10.470 INFO:tasks.rbd_mirror_thrash:waiting for 2 secs before reviving daemons 2021-11-21T03:54:10.470 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba043.stderr:2021-11-21T03:54:10.471+0000 7f79e38ab700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 (PID: 31147) UID: 1000 2021-11-21T03:54:10.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 5158158336 bytes 2021-11-21T03:54:10.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 5230389248 bytes 2021-11-21T03:54:10.670 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba043.stderr:daemon-helper: command failed with exit status 1 2021-11-21T03:54:10.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 5286240256 bytes 2021-11-21T03:54:10.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 5327997952 bytes 2021-11-21T03:54:10.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 5377166336 bytes 2021-11-21T03:54:11.045 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 5483106304 bytes 2021-11-21T03:54:11.107 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 5510991872 bytes 2021-11-21T03:54:11.176 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 5549497344 bytes 2021-11-21T03:54:11.278 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 5623415808 bytes 2021-11-21T03:54:11.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12600 IOs, 5652806656 bytes 2021-11-21T03:54:11.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12700 IOs, 5717959680 bytes 2021-11-21T03:54:11.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12800 IOs, 5718578176 bytes 2021-11-21T03:54:11.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12900 IOs, 5742458880 bytes 2021-11-21T03:54:11.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13000 IOs, 5757830144 bytes 2021-11-21T03:54:11.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13100 IOs, 5795248128 bytes 2021-11-21T03:54:11.706 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13200 IOs, 5815134208 bytes 2021-11-21T03:54:11.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13300 IOs, 5850667008 bytes 2021-11-21T03:54:11.818 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13400 IOs, 5863539712 bytes 2021-11-21T03:54:11.884 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13500 IOs, 5895546880 bytes 2021-11-21T03:54:11.931 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13600 IOs, 5920562176 bytes 2021-11-21T03:54:12.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13700 IOs, 5965495296 bytes 2021-11-21T03:54:12.079 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13800 IOs, 6002041856 bytes 2021-11-21T03:54:12.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13900 IOs, 6031842304 bytes 2021-11-21T03:54:12.220 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14000 IOs, 6058456064 bytes 2021-11-21T03:54:12.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14100 IOs, 6099766272 bytes 2021-11-21T03:54:12.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14200 IOs, 6110209024 bytes 2021-11-21T03:54:12.470 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.2 2021-11-21T03:54:12.471 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T03:54:12.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T03:54:12.472 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.2 2021-11-21T03:54:12.472 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Restarting daemon 2021-11-21T03:54:12.473 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 2021-11-21T03:54:12.476 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Started 2021-11-21T03:54:12.477 INFO:tasks.rbd_mirror_thrash:waiting for 85 secs before thrashing 2021-11-21T03:54:12.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14300 IOs, 6213065728 bytes 2021-11-21T03:54:12.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14400 IOs, 6240903168 bytes 2021-11-21T03:54:12.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14500 IOs, 6316047360 bytes 2021-11-21T03:54:12.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14600 IOs, 6364228608 bytes 2021-11-21T03:54:13.003 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14700 IOs, 6387148800 bytes 2021-11-21T03:54:13.062 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14800 IOs, 6424860672 bytes 2021-11-21T03:54:13.165 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14900 IOs, 6471324672 bytes 2021-11-21T03:54:13.236 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15000 IOs, 6522327040 bytes 2021-11-21T03:54:13.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T03:54:13.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T03:54:13.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T03:54:13.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:54:13.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-21T03:54:13.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:54:13.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:13.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:13.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:54:13.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:54:13.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:54:13.297 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:54:13.298 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:54:14.291 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-21T03:54:14.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:54:14.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:14.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:14.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:54:14.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:54:14.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:54:14.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-21T03:54:14.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-21T03:54:14.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:54:14.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:54:14.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:54:14.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-21T03:54:14.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ tee /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:54:14.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:test: 2021-11-21T03:54:14.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: global_id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:54:14.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+replaying 2021-11-21T03:54:14.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: replaying, {"bytes_per_second":17834291.2,"bytes_per_snapshot":535694336.0,"local_snapshot_timestamp":1637466833,"remote_snapshot_timestamp":1637466833,"replay_state":"idle"} 2021-11-21T03:54:14.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: service: mirror.0 on gibba043 2021-11-21T03:54:14.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:54:11 2021-11-21T03:54:14.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: peer_sites: 2021-11-21T03:54:14.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: name: cluster2 2021-11-21T03:54:14.334 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+stopped 2021-11-21T03:54:14.334 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: local image is primary 2021-11-21T03:54:14.334 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:54:12 2021-11-21T03:54:14.336 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:54:14.336 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T03:54:14.337 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ description: .*' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:54:14.337 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":17834291.2,"bytes_per_snapshot":535694336.0,"local_snapshot_timestamp":1637466833,"remote_snapshot_timestamp":1637466833,"replay_state":"idle"} 2021-11-21T03:54:14.338 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:54:14.338 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:54:14.338 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^up+' 2021-11-21T03:54:14.339 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:54:14.339 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:54:14.340 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.0 on gibba043 2021-11-21T03:54:14.341 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:54:14.342 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'last_update=2021-11-21 03:54:11' 2021-11-21T03:54:14.342 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-21 03:54:11' 2021-11-21T03:54:14.342 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:54:14.342 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:14.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:14.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:54:14.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'prev_last_update=2021-11-21 03:54:11' 2021-11-21T03:54:14.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-21T03:54:14.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror.mirror_status 2021-11-21T03:54:14.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:54:14.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror.mirror_status 2021-11-21T03:54:14.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-21T03:54:14.365 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: failed to query services: (13) Permission denied 2021-11-21T03:54:14.381 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local last_update state 2021-11-21T03:54:14.382 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-21T03:54:14.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ last_update='2021-11-21 03:54:11' 2021-11-21T03:54:14.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-21T03:54:14.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ state=up+replaying 2021-11-21T03:54:14.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:54:14.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep up+replaying 2021-11-21T03:54:14.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:54:14.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:54:14.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:54:14.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap4 2021-11-21T03:54:14.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap4 2021-11-21T03:54:14.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:54:14.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:14.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:14.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap4 2021-11-21T03:54:14.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap4 --debug-rbd=20 --debug-journaler=20 2021-11-21T03:54:18.572 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.0 2021-11-21T03:54:18.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Sent signal 15 2021-11-21T03:54:18.572 INFO:tasks.rbd_mirror_thrash:waiting for 9 secs before reviving daemons 2021-11-21T03:54:18.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr:2021-11-21T03:54:18.575+0000 7f4393eb7700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 (PID: 30895) UID: 1000 2021-11-21T03:54:18.774 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr:daemon-helper: command failed with exit status 1 2021-11-21T03:54:27.573 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.0 2021-11-21T03:54:27.574 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T03:54:27.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T03:54:27.575 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.0 2021-11-21T03:54:27.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Restarting daemon 2021-11-21T03:54:27.576 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 2021-11-21T03:54:27.580 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Started 2021-11-21T03:54:27.580 INFO:tasks.rbd_mirror_thrash:waiting for 118 secs before thrashing 2021-11-21T03:54:44.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-21T03:54:44.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:54:44.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:44.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:44.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-21T03:54:44.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:54:44.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:44.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:44.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state=started 2021-11-21T03:54:44.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:54:44.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:54:44.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:54:45.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-21T03:54:45.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:54:45.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:45.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:45.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=started 2021-11-21T03:54:45.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_result 2021-11-21T03:54:45.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=stopped 2021-11-21T03:54:45.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-21T03:54:45.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ grep -i state 2021-11-21T03:54:45.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_instance=cluster1 2021-11-21T03:54:45.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:45.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T03:54:45.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance=cluster1 2021-11-21T03:54:45.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local loop_instance 2021-11-21T03:54:45.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:54:45.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 0 2021-11-21T03:54:45.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:54:45.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:54:45.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:45.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:54:45.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:54:45.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:45.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:45.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:54:45.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:54:45.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:45.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:45.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:45.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:54:45.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:54:45.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:45.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:45.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:54:45.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:54:45.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:54:45.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:54:45.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:45.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:45.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:54:45.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:54:45.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:45.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:45.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:45.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:54:45.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:54:45.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:45.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:45.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:54:45.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:54:45.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:54:45.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:54:45.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:54:45.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:54:45.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:54:45.522 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:45.523 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:45.523 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:45.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:45.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:54:45.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:54:45.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:45.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:45.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:54:45.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:54:45.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:45.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:45.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:45.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:54:45.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:54:45.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:45.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:45.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:54:45.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:54:45.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:54:45.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:54:45.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:45.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:45.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:54:45.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:54:45.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:45.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:45.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:45.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:54:45.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:54:45.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:45.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:45.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:54:45.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:54:45.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:54:45.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:54:45.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:54:45.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:54:45.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:54:45.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:45.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:45.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:45.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:45.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:54:45.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:54:45.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:45.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:45.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:54:45.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:54:45.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:45.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:45.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:45.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:54:45.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:54:45.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:45.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:45.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:54:45.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:54:45.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:54:45.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:54:45.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:45.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:45.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:54:45.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:54:45.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:45.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:45.599 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:45.599 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:54:45.599 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:54:45.599 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:45.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:45.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:54:45.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:54:45.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:54:45.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:54:45.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:54:45.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:54:45.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:54:45.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:45.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:45.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:45.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:45.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:54:45.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:54:45.664 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:45.664 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:45.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:54:45.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:54:45.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:45.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:45.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:45.667 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:54:45.667 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:54:45.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:45.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:45.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:54:45.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:54:45.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:54:45.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:54:45.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:45.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:45.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:54:45.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:54:45.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:45.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:45.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:45.671 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:54:45.671 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:54:45.671 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:45.671 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:45.671 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:54:45.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:54:45.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:54:45.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:54:45.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:54:45.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:54:45.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:54:45.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:45.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:45.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:45.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:54:45.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 1 2021-11-21T03:54:46.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:54:46.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:54:46.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:46.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:54:46.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:54:46.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:46.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:46.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:54:46.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:54:46.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:46.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:46.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:46.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:54:46.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:54:46.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:46.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:46.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:54:46.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:54:46.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:54:46.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:54:46.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:46.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:46.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:54:46.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:54:46.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:46.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:46.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:46.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:54:46.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:54:46.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:46.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:46.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:54:46.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:54:46.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:54:46.744 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:54:46.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:54:46.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:54:46.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:54:46.801 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:46.802 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:46.802 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:46.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:46.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:54:46.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:54:46.806 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:46.806 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:46.806 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:54:46.806 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:54:46.807 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:46.807 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:46.807 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:46.807 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:54:46.808 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:54:46.808 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:46.808 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:46.808 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:54:46.808 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:54:46.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:54:46.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:54:46.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:46.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:46.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:54:46.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:54:46.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:46.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:46.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:46.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:54:46.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:54:46.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:46.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:46.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:54:46.812 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:54:46.812 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:54:46.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:54:46.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:54:46.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:54:46.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:54:46.871 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:46.871 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:46.871 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:46.874 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:46.874 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:54:46.875 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:54:46.875 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:46.875 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:46.875 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:54:46.876 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:54:46.876 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:46.876 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:46.876 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:46.876 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:54:46.877 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:54:46.877 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:46.877 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:46.877 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:54:46.877 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:54:46.878 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:54:46.878 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:54:46.878 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:46.878 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:46.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:54:46.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:54:46.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:46.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:46.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:46.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:54:46.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:54:46.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:46.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:46.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:54:46.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:54:46.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:54:46.883 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:54:46.883 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:54:46.884 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:54:46.884 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:54:46.940 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:46.941 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:46.941 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:46.944 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:46.944 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:54:46.944 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:54:46.944 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:46.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:46.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:54:46.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:54:46.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:46.946 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:46.946 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:46.946 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:54:46.946 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:54:46.946 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:46.947 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:46.947 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:54:46.947 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:54:46.947 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:54:46.948 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:54:46.948 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:46.948 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:46.948 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:54:46.948 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:54:46.949 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:46.949 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:46.949 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:46.949 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:54:46.949 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:54:46.950 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:46.950 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:46.950 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:54:46.950 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:54:46.951 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:54:46.953 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:54:46.953 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:54:46.953 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:54:46.953 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:54:47.010 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:47.011 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:47.012 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:47.012 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:54:47.013 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 2 2021-11-21T03:54:49.012 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:54:49.013 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:54:49.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:49.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:54:49.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:54:49.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:49.017 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:49.017 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:54:49.017 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:54:49.017 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:49.018 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:49.018 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:49.018 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:54:49.018 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:54:49.019 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:49.019 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:49.019 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:54:49.019 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:54:49.019 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:54:49.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:54:49.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:49.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:49.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:54:49.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:54:49.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:49.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:49.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:49.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:54:49.022 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:54:49.022 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:49.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:49.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:54:49.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:54:49.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:54:49.025 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:54:49.025 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:54:49.025 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:54:49.026 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:54:49.082 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:49.083 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:49.083 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:49.086 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:49.086 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:54:49.086 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:54:49.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:49.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:49.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:54:49.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:54:49.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:49.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:49.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:49.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:54:49.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:54:49.089 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:49.089 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:49.089 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:54:49.089 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:54:49.090 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:54:49.090 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:54:49.090 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:49.090 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:49.091 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:54:49.091 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:54:49.091 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:49.091 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:49.091 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:49.092 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:54:49.092 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:54:49.092 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:49.092 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:49.092 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:54:49.093 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:54:49.093 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:54:49.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:54:49.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:54:49.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:54:49.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:54:49.151 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:49.151 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:49.152 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:49.154 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:49.155 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:54:49.155 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:54:49.155 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:49.155 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:49.156 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:54:49.156 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:54:49.156 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:49.156 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:49.156 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:49.157 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:54:49.157 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:54:49.157 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:49.157 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:49.158 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:54:49.158 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:54:49.158 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:54:49.158 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:54:49.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:49.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:49.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:54:49.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:54:49.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:49.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:49.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:49.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:54:49.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:54:49.161 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:49.161 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:49.161 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:54:49.161 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:54:49.162 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:54:49.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:54:49.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:54:49.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:54:49.164 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:54:49.218 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:49.219 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:49.219 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:49.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:49.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:54:49.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:54:49.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:49.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:49.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:54:49.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:54:49.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:49.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:49.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:49.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:54:49.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:54:49.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:49.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:49.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:54:49.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:54:49.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:54:49.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:54:49.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:49.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:49.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:54:49.227 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:54:49.227 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:49.227 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:49.227 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:49.227 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:54:49.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:54:49.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:49.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:49.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:54:49.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:54:49.229 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:54:49.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:54:49.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:54:49.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:54:49.231 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:54:49.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:49.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:49.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:49.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:54:49.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 4 2021-11-21T03:54:53.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:54:53.289 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:54:53.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:53.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:54:53.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:54:53.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:53.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:53.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:54:53.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:54:53.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:53.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:53.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:53.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:54:53.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:54:53.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:53.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:53.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:54:53.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:54:53.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:54:53.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:54:53.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:53.297 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:53.297 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:54:53.297 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:54:53.297 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:53.297 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:53.298 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:53.298 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:54:53.298 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:54:53.298 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:53.298 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:53.299 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:54:53.299 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:54:53.299 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:54:53.301 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:54:53.301 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:54:53.301 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:54:53.302 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:54:53.356 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:53.357 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:53.357 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:53.360 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:53.360 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:54:53.360 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:54:53.360 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:53.361 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:53.361 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:54:53.361 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:54:53.361 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:53.361 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:53.362 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:53.362 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:54:53.362 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:54:53.362 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:53.363 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:53.363 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:54:53.363 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:54:53.364 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:54:53.364 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:54:53.364 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:53.364 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:53.365 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:54:53.365 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:54:53.365 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:53.365 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:53.365 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:53.366 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:54:53.366 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:54:53.366 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:53.367 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:53.367 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:54:53.367 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:54:53.367 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:54:53.369 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:54:53.369 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:54:53.369 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:54:53.369 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:54:53.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:53.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:53.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:53.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:53.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:54:53.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:54:53.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:53.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:53.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:54:53.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:54:53.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:53.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:53.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:53.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:54:53.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:54:53.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:53.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:53.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:54:53.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:54:53.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:54:53.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:54:53.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:53.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:53.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:54:53.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:54:53.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:53.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:53.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:53.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:54:53.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:54:53.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:53.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:53.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:54:53.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:54:53.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:54:53.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:54:53.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:54:53.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:54:53.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:54:53.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:54:53.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:54:53.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:54:53.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:54:53.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:54:53.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:54:53.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:54:53.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:54:53.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:54:53.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:54:53.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:54:53.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:54:53.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:54:53.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:54:53.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:54:53.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:54:53.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:53.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:54:53.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:54:53.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:54:53.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:54:53.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:54:53.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:54:53.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:54:53.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:54:53.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:54:53.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:54:53.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:54:53.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:54:53.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:54:53.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:54:53.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:54:53.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:54:53.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:54:53.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:54:53.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:54:53.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:54:53.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:54:53.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:54:53.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ return 0 2021-11-21T03:54:53.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ status_result=' "state": "Replaying"' 2021-11-21T03:54:53.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo ' "state": "Replaying"' 2021-11-21T03:54:53.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep -i Replaying 2021-11-21T03:54:53.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "state": "Replaying" 2021-11-21T03:54:53.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_state=started 2021-11-21T03:54:53.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test started = started 2021-11-21T03:54:53.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:54:53.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-21T03:54:53.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:54:53.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:54:53.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:53.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:53.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = journal ']' 2021-11-21T03:54:53.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = snapshot ']' 2021-11-21T03:54:53.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-21T03:54:53.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:54:53.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:54:53.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:53.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:53.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster2-mirror-test.status 2021-11-21T03:54:53.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster2-mirror-test.status 2021-11-21T03:54:53.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:54:53.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:54:53.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.status 2021-11-21T03:54:53.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.status 2021-11-21T03:54:53.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:54:53.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:54:53.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-21T03:54:53.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:54:53.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:53.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:53.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-21T03:54:54.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Snapshot ID: 18 2021-11-21T03:54:54.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:54:54.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:54:54.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:54.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:54.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:54:54.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-21T03:54:54.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:54:54.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-21T03:54:54.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snapshot_id=18 2021-11-21T03:54:54.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:54:54.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:54:54.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.2 2021-11-21T03:54:54.707 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:54:54.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:54:54.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:54.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:54.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:54:54.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:54:54.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:54:54.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:54:54.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=14 2021-11-21T03:54:54.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 18 = 14 2021-11-21T03:54:54.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:54:54.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.4 2021-11-21T03:54:55.144 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:54:55.144 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:54:55.145 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:55.145 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:55.145 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:54:55.145 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:54:55.145 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:54:55.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:54:55.180 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=14 2021-11-21T03:54:55.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 18 = 14 2021-11-21T03:54:55.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:54:55.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.8 2021-11-21T03:54:55.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:54:55.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:54:55.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:55.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:55.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:54:55.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:54:55.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:54:56.019 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:54:56.019 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:54:56.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:54:56.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:54:56.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:54:56.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:54:56.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 18 = '' 2021-11-21T03:54:56.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:54:56.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1.6 2021-11-21T03:54:57.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:54:57.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:54:57.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:57.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:57.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:54:57.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:54:57.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:54:57.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:54:57.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:54:57.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:54:57.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:54:57.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:54:57.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:54:57.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 18 = '' 2021-11-21T03:54:57.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:54:57.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 2 2021-11-21T03:54:59.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:54:59.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:54:59.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:59.662 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:59.662 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:54:59.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:54:59.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:54:59.697 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:54:59.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=18 2021-11-21T03:54:59.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 18 = 18 2021-11-21T03:54:59.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:54:59.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snap_present cluster1 mirror test snap4 2021-11-21T03:54:59.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:54:59.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:54:59.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:54:59.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap4 2021-11-21T03:54:59.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:54:59.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-21T03:54:59.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:55:00.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 info mirror/test@snap4 2021-11-21T03:55:00.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'test': 2021-11-21T03:55:00.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 512 MiB in 128 objects 2021-11-21T03:55:00.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T03:55:00.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 8 2021-11-21T03:55:00.733 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 10a2324c201b 2021-11-21T03:55:00.733 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.10a2324c201b 2021-11-21T03:55:00.733 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T03:55:00.733 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T03:55:00.734 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T03:55:00.734 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T03:55:00.734 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:55:00.734 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 03:53:05 2021 2021-11-21T03:55:00.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:55:00.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: protected: False 2021-11-21T03:55:00.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T03:55:00.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T03:55:00.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:55:00.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T03:55:00.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:55:00.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snap3-clean ']' 2021-11-21T03:55:00.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap3-clean 2021-11-21T03:55:00.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:00.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:00.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap3-clean 2021-11-21T03:55:00.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:55:00.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:55:00.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:00.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:00.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap3-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:55:01.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:55:01.184 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap3-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:01.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:55:01.860 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:01.990 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:02.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:55:02.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap4 2021-11-21T03:55:02.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:02.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:02.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap4 2021-11-21T03:55:02.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:55:02.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:55:02.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:02.089 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:02.089 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap4 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:55:02.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:55:02.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap4 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:03.258 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:55:03.260 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:03.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:03.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:55:03.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ clean_snap_name=snap4-clean 2021-11-21T03:55:03.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap4-clean 2021-11-21T03:55:03.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:55:03.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:03.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:03.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap4-clean 2021-11-21T03:55:03.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap4-clean --debug-rbd=20 --debug-journaler=20 2021-11-21T03:55:04.481 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T03:55:04.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror test 2021-11-21T03:55:04.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:55:04.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:04.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:04.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T03:55:04.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=13 2021-11-21T03:55:04.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T03:55:04.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 13s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-21T03:55:04.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 36001792 bytes 2021-11-21T03:55:04.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 99464192 bytes 2021-11-21T03:55:04.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 154025984 bytes 2021-11-21T03:55:05.002 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 260338688 bytes 2021-11-21T03:55:05.076 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 276834304 bytes 2021-11-21T03:55:05.126 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 293004288 bytes 2021-11-21T03:55:05.173 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 307870720 bytes 2021-11-21T03:55:05.232 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 330339328 bytes 2021-11-21T03:55:05.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 353350656 bytes 2021-11-21T03:55:05.373 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 397066240 bytes 2021-11-21T03:55:05.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 409129984 bytes 2021-11-21T03:55:05.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 439726080 bytes 2021-11-21T03:55:05.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 459906048 bytes 2021-11-21T03:55:05.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 520636416 bytes 2021-11-21T03:55:05.706 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 548472832 bytes 2021-11-21T03:55:05.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 631601152 bytes 2021-11-21T03:55:05.876 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 661228544 bytes 2021-11-21T03:55:05.927 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 677061632 bytes 2021-11-21T03:55:05.963 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 677681152 bytes 2021-11-21T03:55:06.028 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 707774464 bytes 2021-11-21T03:55:06.101 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 744900608 bytes 2021-11-21T03:55:06.200 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 806759424 bytes 2021-11-21T03:55:06.304 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 884446208 bytes 2021-11-21T03:55:06.346 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 885033984 bytes 2021-11-21T03:55:06.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 932792320 bytes 2021-11-21T03:55:06.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 958835712 bytes 2021-11-21T03:55:06.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 999246848 bytes 2021-11-21T03:55:06.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1017511936 bytes 2021-11-21T03:55:06.688 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1036043264 bytes 2021-11-21T03:55:06.762 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1078428672 bytes 2021-11-21T03:55:06.862 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1141937152 bytes 2021-11-21T03:55:06.922 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1167225856 bytes 2021-11-21T03:55:07.005 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1214943232 bytes 2021-11-21T03:55:07.097 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1287189504 bytes 2021-11-21T03:55:07.191 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1331301376 bytes 2021-11-21T03:55:07.284 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1388109824 bytes 2021-11-21T03:55:07.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1459774464 bytes 2021-11-21T03:55:07.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1522854912 bytes 2021-11-21T03:55:07.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1542433792 bytes 2021-11-21T03:55:07.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1560562688 bytes 2021-11-21T03:55:07.681 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1597227008 bytes 2021-11-21T03:55:07.789 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1682292736 bytes 2021-11-21T03:55:07.922 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1774189568 bytes 2021-11-21T03:55:08.010 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1826555904 bytes 2021-11-21T03:55:08.069 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1851201536 bytes 2021-11-21T03:55:08.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1862692864 bytes 2021-11-21T03:55:08.208 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1918635008 bytes 2021-11-21T03:55:08.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 1985550336 bytes 2021-11-21T03:55:08.371 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2010290176 bytes 2021-11-21T03:55:08.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2061575168 bytes 2021-11-21T03:55:08.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2128277504 bytes 2021-11-21T03:55:08.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2168693760 bytes 2021-11-21T03:55:08.697 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2190928896 bytes 2021-11-21T03:55:08.759 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2224662528 bytes 2021-11-21T03:55:08.804 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2226494464 bytes 2021-11-21T03:55:08.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2238828544 bytes 2021-11-21T03:55:08.927 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2277837824 bytes 2021-11-21T03:55:09.001 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2314770432 bytes 2021-11-21T03:55:09.062 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2340796416 bytes 2021-11-21T03:55:09.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2343221248 bytes 2021-11-21T03:55:09.144 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2353747968 bytes 2021-11-21T03:55:09.221 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2401381376 bytes 2021-11-21T03:55:09.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2427161600 bytes 2021-11-21T03:55:09.328 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2431369216 bytes 2021-11-21T03:55:09.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2443487232 bytes 2021-11-21T03:55:09.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2508837888 bytes 2021-11-21T03:55:09.723 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2521704448 bytes 2021-11-21T03:55:09.799 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2561331200 bytes 2021-11-21T03:55:09.863 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2589298688 bytes 2021-11-21T03:55:09.937 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2631943168 bytes 2021-11-21T03:55:09.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 2649434112 bytes 2021-11-21T03:55:10.058 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 2681432064 bytes 2021-11-21T03:55:10.127 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 2713158656 bytes 2021-11-21T03:55:10.276 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 2826772480 bytes 2021-11-21T03:55:10.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 2854802432 bytes 2021-11-21T03:55:10.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 2921583616 bytes 2021-11-21T03:55:10.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 2956195840 bytes 2021-11-21T03:55:10.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 2997468160 bytes 2021-11-21T03:55:10.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3031769088 bytes 2021-11-21T03:55:10.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3129618432 bytes 2021-11-21T03:55:10.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3185476608 bytes 2021-11-21T03:55:10.916 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3186973696 bytes 2021-11-21T03:55:10.980 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3211897856 bytes 2021-11-21T03:55:11.053 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3245449216 bytes 2021-11-21T03:55:11.104 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3266170880 bytes 2021-11-21T03:55:11.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3289175040 bytes 2021-11-21T03:55:11.234 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3325498368 bytes 2021-11-21T03:55:11.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3350802432 bytes 2021-11-21T03:55:11.352 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3384816640 bytes 2021-11-21T03:55:11.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3385441280 bytes 2021-11-21T03:55:11.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3390568448 bytes 2021-11-21T03:55:11.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3465870336 bytes 2021-11-21T03:55:11.641 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 3501851648 bytes 2021-11-21T03:55:11.691 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 3516607488 bytes 2021-11-21T03:55:11.761 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 3548080128 bytes 2021-11-21T03:55:11.883 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 3637653504 bytes 2021-11-21T03:55:11.981 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 3703531520 bytes 2021-11-21T03:55:12.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 3746690048 bytes 2021-11-21T03:55:12.143 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 3788497920 bytes 2021-11-21T03:55:12.212 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 3813535744 bytes 2021-11-21T03:55:12.261 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 3826727936 bytes 2021-11-21T03:55:12.354 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 3887409152 bytes 2021-11-21T03:55:12.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 3908609024 bytes 2021-11-21T03:55:12.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 3963452416 bytes 2021-11-21T03:55:12.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 3986890752 bytes 2021-11-21T03:55:12.696 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4048384000 bytes 2021-11-21T03:55:12.760 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4076785664 bytes 2021-11-21T03:55:12.799 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4089052160 bytes 2021-11-21T03:55:12.866 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4112584704 bytes 2021-11-21T03:55:12.915 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4126908416 bytes 2021-11-21T03:55:13.024 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 4202343424 bytes 2021-11-21T03:55:13.102 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 4245010432 bytes 2021-11-21T03:55:13.195 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 4305804288 bytes 2021-11-21T03:55:13.316 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 4385036288 bytes 2021-11-21T03:55:13.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 4426116096 bytes 2021-11-21T03:55:13.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 4452104192 bytes 2021-11-21T03:55:13.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 4511983616 bytes 2021-11-21T03:55:13.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 4514675712 bytes 2021-11-21T03:55:13.724 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 4598833152 bytes 2021-11-21T03:55:13.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 4606345216 bytes 2021-11-21T03:55:13.829 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 4632922112 bytes 2021-11-21T03:55:13.889 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 4656026624 bytes 2021-11-21T03:55:13.962 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 4689520640 bytes 2021-11-21T03:55:14.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 4712968192 bytes 2021-11-21T03:55:14.065 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 4720560128 bytes 2021-11-21T03:55:14.193 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12600 IOs, 4808813568 bytes 2021-11-21T03:55:14.299 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12700 IOs, 4878695424 bytes 2021-11-21T03:55:14.350 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12800 IOs, 4894726144 bytes 2021-11-21T03:55:14.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12900 IOs, 4968842240 bytes 2021-11-21T03:55:14.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13000 IOs, 5007211520 bytes 2021-11-21T03:55:14.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13100 IOs, 5022641152 bytes 2021-11-21T03:55:14.816 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13200 IOs, 5090606080 bytes 2021-11-21T03:55:14.896 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13300 IOs, 5127536640 bytes 2021-11-21T03:55:14.949 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13400 IOs, 5144620032 bytes 2021-11-21T03:55:15.062 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13500 IOs, 5220378624 bytes 2021-11-21T03:55:15.114 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13600 IOs, 5238636544 bytes 2021-11-21T03:55:15.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13700 IOs, 5278439424 bytes 2021-11-21T03:55:15.265 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13800 IOs, 5312933888 bytes 2021-11-21T03:55:15.329 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13900 IOs, 5338911744 bytes 2021-11-21T03:55:15.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14000 IOs, 5378583552 bytes 2021-11-21T03:55:15.478 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14100 IOs, 5424862208 bytes 2021-11-21T03:55:15.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14200 IOs, 5475357696 bytes 2021-11-21T03:55:15.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14300 IOs, 5507741696 bytes 2021-11-21T03:55:15.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14400 IOs, 5547363328 bytes 2021-11-21T03:55:15.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14500 IOs, 5555792896 bytes 2021-11-21T03:55:15.865 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14600 IOs, 5607323648 bytes 2021-11-21T03:55:15.970 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14700 IOs, 5673518080 bytes 2021-11-21T03:55:16.038 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14800 IOs, 5713111040 bytes 2021-11-21T03:55:16.127 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14900 IOs, 5754605568 bytes 2021-11-21T03:55:16.196 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15000 IOs, 5781082112 bytes 2021-11-21T03:55:16.255 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15100 IOs, 5804138496 bytes 2021-11-21T03:55:16.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15200 IOs, 5841267712 bytes 2021-11-21T03:55:16.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15300 IOs, 5864974336 bytes 2021-11-21T03:55:16.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15400 IOs, 5976556544 bytes 2021-11-21T03:55:16.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15500 IOs, 6060780544 bytes 2021-11-21T03:55:16.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15600 IOs, 6108767232 bytes 2021-11-21T03:55:16.823 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15700 IOs, 6146489344 bytes 2021-11-21T03:55:16.885 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15800 IOs, 6173162496 bytes 2021-11-21T03:55:16.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15900 IOs, 6221087744 bytes 2021-11-21T03:55:17.086 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16000 IOs, 6294068224 bytes 2021-11-21T03:55:17.149 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16100 IOs, 6317257728 bytes 2021-11-21T03:55:17.217 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16200 IOs, 6346905600 bytes 2021-11-21T03:55:17.273 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16300 IOs, 6368060416 bytes 2021-11-21T03:55:17.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16400 IOs, 6375615488 bytes 2021-11-21T03:55:17.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16500 IOs, 6419568640 bytes 2021-11-21T03:55:17.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16600 IOs, 6454156288 bytes 2021-11-21T03:55:17.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T03:55:17.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T03:55:17.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T03:55:17.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:55:17.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-21T03:55:17.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:55:17.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:17.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:17.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:55:17.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:55:17.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:55:17.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:55:17.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:55:18.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-21T03:55:18.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:55:18.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:18.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:18.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:55:18.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:55:18.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:55:18.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-21T03:55:18.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-21T03:55:18.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:55:18.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:55:18.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:55:18.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-21T03:55:18.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ tee /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:55:18.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:test: 2021-11-21T03:55:18.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: global_id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:55:18.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+replaying 2021-11-21T03:55:18.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: replaying, {"bytes_per_second":26842521.6,"bytes_per_snapshot":536850432.0,"local_snapshot_timestamp":1637466894,"remote_snapshot_timestamp":1637466894,"replay_state":"idle"} 2021-11-21T03:55:18.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: service: mirror.3 on gibba043 2021-11-21T03:55:18.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:55:11 2021-11-21T03:55:18.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: peer_sites: 2021-11-21T03:55:18.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: name: cluster2 2021-11-21T03:55:18.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+stopped 2021-11-21T03:55:18.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: local image is primary 2021-11-21T03:55:18.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:55:12 2021-11-21T03:55:18.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:55:18.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T03:55:18.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ description: .*' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:55:18.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":26842521.6,"bytes_per_snapshot":536850432.0,"local_snapshot_timestamp":1637466894,"remote_snapshot_timestamp":1637466894,"replay_state":"idle"} 2021-11-21T03:55:18.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:55:18.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:55:18.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^up+' 2021-11-21T03:55:18.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:55:18.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:55:18.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.3 on gibba043 2021-11-21T03:55:18.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:55:18.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'last_update=2021-11-21 03:55:11' 2021-11-21T03:55:18.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-21 03:55:11' 2021-11-21T03:55:18.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:55:18.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:18.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:18.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:55:18.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'prev_last_update=2021-11-21 03:55:11' 2021-11-21T03:55:18.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-21T03:55:18.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror.mirror_status 2021-11-21T03:55:18.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:55:18.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror.mirror_status 2021-11-21T03:55:18.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-21T03:55:18.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: failed to query services: (13) Permission denied 2021-11-21T03:55:18.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local last_update state 2021-11-21T03:55:18.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-21T03:55:18.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ last_update='2021-11-21 03:55:11' 2021-11-21T03:55:18.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-21T03:55:18.657 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ state=up+replaying 2021-11-21T03:55:18.657 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:55:18.657 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep up+replaying 2021-11-21T03:55:18.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:55:18.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:55:18.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:55:18.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap5 2021-11-21T03:55:18.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap5 2021-11-21T03:55:18.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:55:18.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:18.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:18.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap5 2021-11-21T03:55:18.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap5 --debug-rbd=20 --debug-journaler=20 2021-11-21T03:55:37.478 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.8089517774542033) > weight (0.25) 2021-11-21T03:55:37.478 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.1 2021-11-21T03:55:37.479 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Sent signal 15 2021-11-21T03:55:37.479 INFO:tasks.rbd_mirror_thrash:waiting for 2 secs before reviving daemons 2021-11-21T03:55:37.480 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba043.stderr:2021-11-21T03:55:37.482+0000 7fdee2e68700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 31105) UID: 1000 2021-11-21T03:55:37.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba043.stderr:daemon-helper: command failed with exit status 1 2021-11-21T03:55:39.480 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.1 2021-11-21T03:55:39.481 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T03:55:39.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T03:55:39.482 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.1 2021-11-21T03:55:39.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2021-11-21T03:55:39.482 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2021-11-21T03:55:39.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2021-11-21T03:55:39.486 INFO:tasks.rbd_mirror_thrash:waiting for 70 secs before thrashing 2021-11-21T03:55:48.315 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-21T03:55:48.315 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:55:48.316 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:48.316 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:48.316 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-21T03:55:48.316 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:55:48.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:48.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:48.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state=started 2021-11-21T03:55:48.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:55:48.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:55:48.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:55:49.316 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-21T03:55:49.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:55:49.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:49.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:49.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=started 2021-11-21T03:55:49.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_result 2021-11-21T03:55:49.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=stopped 2021-11-21T03:55:49.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-21T03:55:49.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_instance=cluster1 2021-11-21T03:55:49.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:55:49.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T03:55:49.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ grep -i state 2021-11-21T03:55:49.320 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance=cluster1 2021-11-21T03:55:49.320 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local loop_instance 2021-11-21T03:55:49.320 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:55:49.320 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 0 2021-11-21T03:55:49.324 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:55:49.324 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:55:49.324 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:55:49.324 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:55:49.325 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:55:49.325 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:55:49.325 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:55:49.325 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:55:49.325 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:55:49.326 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:55:49.326 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:55:49.326 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:55:49.326 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:55:49.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:55:49.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:55:49.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:55:49.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:55:49.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:55:49.328 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:55:49.328 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:55:49.328 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:55:49.328 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:55:49.329 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:55:49.329 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:55:49.329 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:55:49.329 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:55:49.329 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:55:49.330 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:55:49.330 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:55:49.330 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:55:49.330 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:55:49.331 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:55:49.331 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:55:49.331 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:55:49.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:55:49.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:55:49.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:55:49.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:55:49.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:55:49.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:55:49.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:55:49.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:55:49.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:55:49.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:55:49.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:55:49.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:55:49.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:55:49.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:55:49.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:55:49.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:55:49.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:55:49.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:55:49.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:55:49.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:55:49.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:55:49.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:55:49.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:55:49.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:55:49.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:55:49.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:55:49.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:55:49.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:55:49.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:55:49.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:55:49.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:55:49.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:55:49.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:55:49.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:55:49.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:55:49.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:55:49.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:55:49.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:55:49.398 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:55:49.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:55:49.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:55:49.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:55:49.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:55:49.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:55:49.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:55:49.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:55:49.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:55:49.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:55:49.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:55:49.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:55:49.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:55:49.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:55:49.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:55:49.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:55:49.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:55:49.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:55:49.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:55:49.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:55:49.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:55:49.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:55:49.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:55:49.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:55:49.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:55:49.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:55:49.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:55:49.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:55:49.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:55:49.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:55:49.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:55:49.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:55:49.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:55:49.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:55:49.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:55:49.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:55:49.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:55:49.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:55:49.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:55:49.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:55:49.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:55:49.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:55:49.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:55:49.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:55:49.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:55:49.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:55:49.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:55:49.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:55:49.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:55:49.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:55:49.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:55:49.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:55:49.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:55:49.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:55:49.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:55:49.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:55:49.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:55:49.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:55:49.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:55:49.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:55:49.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:55:49.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:55:49.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:55:49.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:55:49.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:55:49.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:55:49.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:55:49.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:55:49.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:55:49.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:55:49.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:55:49.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:55:49.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:55:49.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:55:49.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:55:49.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:55:49.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:55:49.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:55:49.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:55:49.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:55:49.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:55:49.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:55:49.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:55:49.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ return 0 2021-11-21T03:55:49.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ status_result=' "state": "Replaying"' 2021-11-21T03:55:49.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo ' "state": "Replaying"' 2021-11-21T03:55:49.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep -i Replaying 2021-11-21T03:55:49.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "state": "Replaying" 2021-11-21T03:55:49.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_state=started 2021-11-21T03:55:49.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test started = started 2021-11-21T03:55:49.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:55:49.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-21T03:55:49.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:55:49.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:55:49.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:49.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:49.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = journal ']' 2021-11-21T03:55:49.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = snapshot ']' 2021-11-21T03:55:49.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-21T03:55:49.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:55:49.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:55:49.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:49.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:49.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster2-mirror-test.status 2021-11-21T03:55:49.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster2-mirror-test.status 2021-11-21T03:55:49.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:55:49.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:55:49.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.status 2021-11-21T03:55:49.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.status 2021-11-21T03:55:49.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:55:49.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:55:49.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-21T03:55:49.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:55:49.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:49.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:49.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-21T03:55:50.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Snapshot ID: 22 2021-11-21T03:55:50.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:55:50.328 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:55:50.328 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:50.329 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:50.329 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:55:50.329 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-21T03:55:50.330 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:55:50.356 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-21T03:55:50.357 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snapshot_id=22 2021-11-21T03:55:50.357 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:55:50.358 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:55:50.358 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.2 2021-11-21T03:55:50.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:55:50.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:55:50.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:50.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:50.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:55:50.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:55:50.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:55:50.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:55:50.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:55:50.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:55:50.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:55:50.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:55:50.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:55:50.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 22 = '' 2021-11-21T03:55:50.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:55:50.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.4 2021-11-21T03:55:50.996 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:55:50.997 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:55:50.997 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:50.997 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:50.997 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:55:50.998 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:55:50.998 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:55:51.034 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:55:51.034 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:55:51.036 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:55:51.036 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:55:51.036 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:55:51.037 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:55:51.037 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 22 = '' 2021-11-21T03:55:51.037 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:55:51.037 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.8 2021-11-21T03:55:51.837 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:55:51.838 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:55:51.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:51.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:51.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:55:51.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:55:51.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:55:51.874 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:55:51.874 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:55:51.875 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:55:51.876 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:55:51.876 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:55:51.877 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:55:51.877 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 22 = '' 2021-11-21T03:55:51.878 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:55:51.878 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1.6 2021-11-21T03:55:53.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:55:53.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:55:53.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:53.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:53.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:55:53.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:55:53.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:55:53.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:55:53.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:55:53.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:55:53.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:55:53.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:55:53.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:55:53.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 22 = '' 2021-11-21T03:55:53.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:55:53.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 2 2021-11-21T03:55:55.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:55:55.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:55:55.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:55.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:55.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:55:55.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:55:55.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:55:55.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:55:55.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=22 2021-11-21T03:55:55.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 22 = 22 2021-11-21T03:55:55.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:55:55.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snap_present cluster1 mirror test snap5 2021-11-21T03:55:55.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:55:55.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:55.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:55.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap5 2021-11-21T03:55:55.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:55:55.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-21T03:55:55.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:55:56.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 info mirror/test@snap5 2021-11-21T03:55:56.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'test': 2021-11-21T03:55:56.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 512 MiB in 128 objects 2021-11-21T03:55:56.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T03:55:56.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 10 2021-11-21T03:55:56.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 10a2324c201b 2021-11-21T03:55:56.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.10a2324c201b 2021-11-21T03:55:56.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T03:55:56.585 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T03:55:56.585 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T03:55:56.585 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T03:55:56.585 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:55:56.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 03:55:01 2021 2021-11-21T03:55:56.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:55:56.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: protected: False 2021-11-21T03:55:56.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T03:55:56.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T03:55:56.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:55:56.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T03:55:56.588 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:55:56.589 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snap4-clean ']' 2021-11-21T03:55:56.589 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap4-clean 2021-11-21T03:55:56.589 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:56.589 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:56.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap4-clean 2021-11-21T03:55:56.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:55:56.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:55:56.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:56.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:56.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap4-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:55:57.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:55:57.233 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap4-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:57.875 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:55:57.878 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:58.004 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:58.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:55:58.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap5 2021-11-21T03:55:58.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:58.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:58.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap5 2021-11-21T03:55:58.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:55:58.100 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:55:58.101 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:58.101 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:58.101 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap5 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:55:58.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:55:58.557 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap5 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:59.215 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:55:59.217 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:59.345 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:55:59.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:55:59.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ clean_snap_name=snap5-clean 2021-11-21T03:55:59.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap5-clean 2021-11-21T03:55:59.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:55:59.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:55:59.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:55:59.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap5-clean 2021-11-21T03:55:59.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap5-clean --debug-rbd=20 --debug-journaler=20 2021-11-21T03:56:00.303 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T03:56:00.304 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror test 2021-11-21T03:56:00.304 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:56:00.304 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:00.304 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:00.305 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T03:56:00.305 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=10 2021-11-21T03:56:00.306 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T03:56:00.306 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 10s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-21T03:56:00.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 25822208 bytes 2021-11-21T03:56:00.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 104095744 bytes 2021-11-21T03:56:00.667 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 114665472 bytes 2021-11-21T03:56:00.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 190277632 bytes 2021-11-21T03:56:00.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 245585920 bytes 2021-11-21T03:56:00.966 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 306991104 bytes 2021-11-21T03:56:01.085 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 389509120 bytes 2021-11-21T03:56:01.168 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 442917888 bytes 2021-11-21T03:56:01.247 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 474054656 bytes 2021-11-21T03:56:01.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 520323072 bytes 2021-11-21T03:56:01.374 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 525506560 bytes 2021-11-21T03:56:01.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 557381632 bytes 2021-11-21T03:56:01.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 585935872 bytes 2021-11-21T03:56:01.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 586530816 bytes 2021-11-21T03:56:01.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 646064128 bytes 2021-11-21T03:56:01.691 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 647105536 bytes 2021-11-21T03:56:01.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 685959168 bytes 2021-11-21T03:56:01.856 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 740165632 bytes 2021-11-21T03:56:01.952 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 797153280 bytes 2021-11-21T03:56:02.006 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 814279680 bytes 2021-11-21T03:56:02.064 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 840610816 bytes 2021-11-21T03:56:02.178 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 906281984 bytes 2021-11-21T03:56:02.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1020505088 bytes 2021-11-21T03:56:02.381 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1035658240 bytes 2021-11-21T03:56:02.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1042422784 bytes 2021-11-21T03:56:02.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1082049536 bytes 2021-11-21T03:56:02.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1104483328 bytes 2021-11-21T03:56:02.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1161222144 bytes 2021-11-21T03:56:02.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1196279808 bytes 2021-11-21T03:56:02.788 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1211011072 bytes 2021-11-21T03:56:02.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1232732160 bytes 2021-11-21T03:56:02.961 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1310109696 bytes 2021-11-21T03:56:03.030 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1340488704 bytes 2021-11-21T03:56:03.161 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1440026624 bytes 2021-11-21T03:56:03.203 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1440657408 bytes 2021-11-21T03:56:03.305 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1505295360 bytes 2021-11-21T03:56:03.342 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1505911808 bytes 2021-11-21T03:56:03.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1506554880 bytes 2021-11-21T03:56:03.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1544096768 bytes 2021-11-21T03:56:03.760 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1621545984 bytes 2021-11-21T03:56:03.868 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1682278400 bytes 2021-11-21T03:56:03.964 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1740296192 bytes 2021-11-21T03:56:04.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1754484736 bytes 2021-11-21T03:56:04.091 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1793683456 bytes 2021-11-21T03:56:04.191 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1852610560 bytes 2021-11-21T03:56:04.304 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1925440512 bytes 2021-11-21T03:56:04.372 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1956941824 bytes 2021-11-21T03:56:04.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 1988066304 bytes 2021-11-21T03:56:04.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2007615488 bytes 2021-11-21T03:56:04.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2096295936 bytes 2021-11-21T03:56:04.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2156060672 bytes 2021-11-21T03:56:04.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2214623232 bytes 2021-11-21T03:56:04.920 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2277054464 bytes 2021-11-21T03:56:05.017 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2316541952 bytes 2021-11-21T03:56:05.127 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2394172416 bytes 2021-11-21T03:56:05.282 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2502700032 bytes 2021-11-21T03:56:05.368 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2546987008 bytes 2021-11-21T03:56:05.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2547580928 bytes 2021-11-21T03:56:05.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2587138048 bytes 2021-11-21T03:56:05.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2640704512 bytes 2021-11-21T03:56:05.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2664458240 bytes 2021-11-21T03:56:05.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2727207936 bytes 2021-11-21T03:56:05.808 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2755950592 bytes 2021-11-21T03:56:05.871 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2778511360 bytes 2021-11-21T03:56:05.944 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2811271168 bytes 2021-11-21T03:56:06.004 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2834101248 bytes 2021-11-21T03:56:06.072 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2861266944 bytes 2021-11-21T03:56:06.182 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2928037888 bytes 2021-11-21T03:56:06.256 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2963783680 bytes 2021-11-21T03:56:06.370 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 3049805824 bytes 2021-11-21T03:56:06.473 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 3091293184 bytes 2021-11-21T03:56:06.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 3117819904 bytes 2021-11-21T03:56:06.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3127291904 bytes 2021-11-21T03:56:06.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3178076160 bytes 2021-11-21T03:56:06.734 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3200325632 bytes 2021-11-21T03:56:06.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3207883776 bytes 2021-11-21T03:56:06.854 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3242660864 bytes 2021-11-21T03:56:06.926 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3287041024 bytes 2021-11-21T03:56:07.018 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3326808064 bytes 2021-11-21T03:56:07.092 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3362665472 bytes 2021-11-21T03:56:07.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3415197696 bytes 2021-11-21T03:56:07.251 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3452984320 bytes 2021-11-21T03:56:07.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3508649984 bytes 2021-11-21T03:56:07.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3552596992 bytes 2021-11-21T03:56:07.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3561526272 bytes 2021-11-21T03:56:07.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3653330944 bytes 2021-11-21T03:56:07.698 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3686677504 bytes 2021-11-21T03:56:07.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3722928128 bytes 2021-11-21T03:56:07.828 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3736474624 bytes 2021-11-21T03:56:07.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3813437440 bytes 2021-11-21T03:56:07.998 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3829792768 bytes 2021-11-21T03:56:08.056 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3865100288 bytes 2021-11-21T03:56:08.148 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 3900606464 bytes 2021-11-21T03:56:08.202 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 3917686784 bytes 2021-11-21T03:56:08.249 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 3941281792 bytes 2021-11-21T03:56:08.358 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 4002541568 bytes 2021-11-21T03:56:08.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 4044797952 bytes 2021-11-21T03:56:08.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 4101485568 bytes 2021-11-21T03:56:08.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 4120141824 bytes 2021-11-21T03:56:08.698 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 4178776064 bytes 2021-11-21T03:56:08.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4252308480 bytes 2021-11-21T03:56:08.941 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4337225728 bytes 2021-11-21T03:56:09.004 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4359310336 bytes 2021-11-21T03:56:09.094 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4408178688 bytes 2021-11-21T03:56:09.189 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4452306944 bytes 2021-11-21T03:56:09.255 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4480416768 bytes 2021-11-21T03:56:09.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4576145408 bytes 2021-11-21T03:56:09.473 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4621328384 bytes 2021-11-21T03:56:09.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4638530560 bytes 2021-11-21T03:56:09.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4651533312 bytes 2021-11-21T03:56:09.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 4678310912 bytes 2021-11-21T03:56:09.764 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 4761208832 bytes 2021-11-21T03:56:09.813 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 4772790272 bytes 2021-11-21T03:56:09.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 4806684672 bytes 2021-11-21T03:56:09.977 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 4849506304 bytes 2021-11-21T03:56:10.065 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 4897130496 bytes 2021-11-21T03:56:10.140 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 4936143872 bytes 2021-11-21T03:56:10.191 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 4949656576 bytes 2021-11-21T03:56:10.309 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T03:56:10.309 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T03:56:10.310 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T03:56:10.310 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:56:10.310 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-21T03:56:10.310 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:56:10.310 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:10.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:10.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:56:10.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:56:10.312 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:56:10.312 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:56:10.312 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:56:11.310 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-21T03:56:11.310 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:56:11.310 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:11.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:11.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:56:11.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:56:11.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:56:11.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-21T03:56:11.312 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-21T03:56:11.312 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:56:11.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:56:11.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:56:11.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-21T03:56:11.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ tee /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:56:11.346 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:test: 2021-11-21T03:56:11.347 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: global_id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:56:11.347 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+replaying 2021-11-21T03:56:11.347 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":536850432.0,"local_snapshot_timestamp":1637466894,"remote_snapshot_timestamp":1637466894,"replay_state":"idle"} 2021-11-21T03:56:11.347 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: service: mirror.3 on gibba043 2021-11-21T03:56:11.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:55:41 2021-11-21T03:56:11.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: peer_sites: 2021-11-21T03:56:11.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: name: cluster2 2021-11-21T03:56:11.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+stopped 2021-11-21T03:56:11.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: local image is primary 2021-11-21T03:56:11.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:55:42 2021-11-21T03:56:11.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:56:11.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T03:56:11.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ description: .*' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:56:11.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":536850432.0,"local_snapshot_timestamp":1637466894,"remote_snapshot_timestamp":1637466894,"replay_state":"idle"} 2021-11-21T03:56:11.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:56:11.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:56:11.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^up+' 2021-11-21T03:56:11.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:56:11.389 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:56:11.389 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.3 on gibba043 2021-11-21T03:56:11.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:56:11.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'last_update=2021-11-21 03:55:41' 2021-11-21T03:56:11.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-21 03:55:41' 2021-11-21T03:56:11.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:56:11.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:11.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:11.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:56:11.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'prev_last_update=2021-11-21 03:55:41' 2021-11-21T03:56:11.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-21T03:56:11.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror.mirror_status 2021-11-21T03:56:11.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:56:11.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror.mirror_status 2021-11-21T03:56:11.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-21T03:56:11.413 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: failed to query services: (13) Permission denied 2021-11-21T03:56:11.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local last_update state 2021-11-21T03:56:11.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-21T03:56:11.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ last_update='2021-11-21 03:55:41' 2021-11-21T03:56:11.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-21T03:56:11.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ state=up+replaying 2021-11-21T03:56:11.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:56:11.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep up+replaying 2021-11-21T03:56:11.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:56:11.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:56:11.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:56:11.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap6 2021-11-21T03:56:11.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap6 2021-11-21T03:56:11.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:56:11.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:11.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:11.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap6 2021-11-21T03:56:11.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap6 --debug-rbd=20 --debug-journaler=20 2021-11-21T03:56:25.582 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.0 2021-11-21T03:56:25.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Sent signal 15 2021-11-21T03:56:25.583 INFO:tasks.rbd_mirror_thrash:waiting for 8 secs before reviving daemons 2021-11-21T03:56:25.584 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr:2021-11-21T03:56:25.585+0000 7fb7864a1700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 (PID: 36282) UID: 1000 2021-11-21T03:56:25.784 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr:daemon-helper: command failed with exit status 1 2021-11-21T03:56:33.585 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.0 2021-11-21T03:56:33.585 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T03:56:33.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T03:56:33.586 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.0 2021-11-21T03:56:33.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Restarting daemon 2021-11-21T03:56:33.587 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 2021-11-21T03:56:33.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Started 2021-11-21T03:56:33.590 INFO:tasks.rbd_mirror_thrash:waiting for 68 secs before thrashing 2021-11-21T03:56:41.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-21T03:56:41.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:56:41.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:41.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:41.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-21T03:56:41.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:56:41.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:41.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:41.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state=started 2021-11-21T03:56:41.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:56:41.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:56:41.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:56:42.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-21T03:56:42.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:56:42.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:42.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:42.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=started 2021-11-21T03:56:42.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_result 2021-11-21T03:56:42.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=stopped 2021-11-21T03:56:42.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-21T03:56:42.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ grep -i state 2021-11-21T03:56:42.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_instance=cluster1 2021-11-21T03:56:42.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:56:42.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T03:56:42.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance=cluster1 2021-11-21T03:56:42.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local loop_instance 2021-11-21T03:56:42.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:56:42.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 0 2021-11-21T03:56:42.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:56:42.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:56:42.494 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:56:42.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:56:42.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:56:42.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:56:42.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:56:42.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:56:42.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:56:42.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:56:42.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:56:42.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:56:42.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:56:42.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:56:42.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:56:42.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:56:42.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:56:42.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:56:42.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:56:42.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:56:42.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:56:42.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:56:42.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:56:42.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:56:42.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:56:42.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:56:42.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:56:42.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:56:42.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:56:42.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:56:42.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:56:42.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:56:42.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:56:42.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:56:42.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:56:42.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:56:42.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:56:42.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:56:42.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:56:42.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:56:42.557 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:56:42.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:56:42.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:56:42.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:56:42.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:56:42.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:56:42.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:56:42.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:56:42.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:56:42.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:56:42.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:56:42.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:56:42.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:56:42.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:56:42.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:56:42.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:56:42.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:56:42.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:56:42.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:56:42.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:56:42.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:56:42.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:56:42.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:56:42.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:56:42.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:56:42.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:56:42.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:56:42.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:56:42.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:56:42.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:56:42.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:56:42.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:56:42.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:56:42.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:56:42.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:56:42.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:56:42.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:56:42.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:56:42.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:56:42.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:56:42.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:56:42.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:56:42.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:56:42.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:56:42.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:56:42.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:56:42.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:56:42.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:56:42.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:56:42.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:56:42.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:56:42.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:56:42.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:56:42.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:56:42.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:56:42.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:56:42.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:56:42.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:56:42.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:56:42.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:56:42.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:56:42.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:56:42.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:56:42.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:56:42.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:56:42.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:56:42.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:56:42.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:56:42.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:56:42.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:56:42.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:56:42.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:56:42.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:56:42.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:56:42.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:56:42.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:56:42.695 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:56:42.696 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:56:42.696 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:56:42.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:56:42.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:56:42.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:56:42.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:56:42.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:56:42.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:56:42.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:56:42.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:56:42.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:56:42.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:56:42.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:56:42.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:56:42.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:56:42.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:56:42.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:56:42.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:56:42.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:56:42.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:56:42.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:56:42.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:56:42.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:56:42.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:56:42.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:56:42.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:56:42.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:56:42.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:56:42.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:56:42.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:56:42.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:56:42.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:56:42.706 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:56:42.706 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:56:42.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:56:42.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:56:42.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:56:42.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:56:42.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ return 0 2021-11-21T03:56:42.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ status_result=' "state": "Replaying"' 2021-11-21T03:56:42.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo ' "state": "Replaying"' 2021-11-21T03:56:42.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep -i Replaying 2021-11-21T03:56:42.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "state": "Replaying" 2021-11-21T03:56:42.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_state=started 2021-11-21T03:56:42.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test started = started 2021-11-21T03:56:42.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:56:42.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-21T03:56:42.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:56:42.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:56:42.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:42.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:42.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = journal ']' 2021-11-21T03:56:42.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = snapshot ']' 2021-11-21T03:56:42.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-21T03:56:42.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:56:42.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:56:42.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:42.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:42.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster2-mirror-test.status 2021-11-21T03:56:42.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster2-mirror-test.status 2021-11-21T03:56:42.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:56:42.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:56:42.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.status 2021-11-21T03:56:42.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.status 2021-11-21T03:56:42.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:56:42.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:56:42.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-21T03:56:42.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:56:42.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:42.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:42.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-21T03:56:43.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Snapshot ID: 26 2021-11-21T03:56:43.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:56:43.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:56:43.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:43.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:43.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:56:43.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-21T03:56:43.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:56:43.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-21T03:56:43.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snapshot_id=26 2021-11-21T03:56:43.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:56:43.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:56:43.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.2 2021-11-21T03:56:43.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:56:43.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:56:43.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:43.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:43.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:56:43.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:56:43.733 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:56:43.764 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:56:43.765 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=22 2021-11-21T03:56:43.765 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 26 = 22 2021-11-21T03:56:43.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:56:43.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.4 2021-11-21T03:56:44.166 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:56:44.167 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:56:44.167 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:44.167 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:44.168 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:56:44.168 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:56:44.168 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:56:44.202 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:56:44.204 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=22 2021-11-21T03:56:44.204 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 26 = 22 2021-11-21T03:56:44.204 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:56:44.204 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.8 2021-11-21T03:56:45.005 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:56:45.006 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:56:45.006 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:45.006 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:45.006 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:56:45.007 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:56:45.007 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:56:45.042 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:56:45.043 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:56:45.043 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:56:45.044 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:56:45.044 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:56:45.044 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:56:45.045 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 26 = '' 2021-11-21T03:56:45.045 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:56:45.045 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1.6 2021-11-21T03:56:46.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:56:46.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:56:46.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:46.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:46.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:56:46.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:56:46.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:56:46.676 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:56:46.677 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:56:46.677 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:56:46.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:56:46.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:56:46.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:56:46.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 26 = '' 2021-11-21T03:56:46.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:56:46.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 2 2021-11-21T03:56:48.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:56:48.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:56:48.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:48.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:48.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:56:48.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:56:48.681 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:56:48.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:56:48.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=26 2021-11-21T03:56:48.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 26 = 26 2021-11-21T03:56:48.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:56:48.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snap_present cluster1 mirror test snap6 2021-11-21T03:56:48.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:56:48.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:48.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:48.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap6 2021-11-21T03:56:48.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:56:48.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-21T03:56:48.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:56:49.487 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2021-11-21T03:56:49.487 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2021-11-21T03:56:49.488 INFO:tasks.rbd_mirror_thrash:waiting for 5 secs before reviving daemons 2021-11-21T03:56:49.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr:2021-11-21T03:56:49.490+0000 7f6536b45700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 31063) UID: 1000 2021-11-21T03:56:49.689 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr:daemon-helper: command failed with exit status 1 2021-11-21T03:56:49.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 info mirror/test@snap6 2021-11-21T03:56:49.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'test': 2021-11-21T03:56:49.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 512 MiB in 128 objects 2021-11-21T03:56:49.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T03:56:49.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 12 2021-11-21T03:56:49.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 10a2324c201b 2021-11-21T03:56:49.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.10a2324c201b 2021-11-21T03:56:49.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T03:56:49.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T03:56:49.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T03:56:49.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T03:56:49.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:56:49.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 03:55:01 2021 2021-11-21T03:56:49.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:56:49.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: protected: False 2021-11-21T03:56:49.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T03:56:49.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T03:56:49.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:56:49.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T03:56:49.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:56:49.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snap5-clean ']' 2021-11-21T03:56:49.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap5-clean 2021-11-21T03:56:49.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:49.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:49.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap5-clean 2021-11-21T03:56:49.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:56:49.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:56:49.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:56:49.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:56:49.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap5-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:56:50.208 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:56:50.211 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap5-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:56:50.869 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:56:50.872 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:56:50.999 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:56:51.093 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:56:51.094 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap6 2021-11-21T03:56:51.094 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:51.094 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:51.094 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap6 2021-11-21T03:56:51.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:56:51.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:56:51.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:56:51.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:56:51.096 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap6 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:56:51.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:56:51.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap6 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:56:52.200 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:56:52.203 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:56:52.331 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:56:52.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:56:52.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ clean_snap_name=snap6-clean 2021-11-21T03:56:52.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap6-clean 2021-11-21T03:56:52.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:56:52.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:52.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:52.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap6-clean 2021-11-21T03:56:52.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap6-clean --debug-rbd=20 --debug-journaler=20 2021-11-21T03:56:52.494 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T03:56:52.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror test 2021-11-21T03:56:52.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:56:52.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:52.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:52.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T03:56:52.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=7 2021-11-21T03:56:52.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T03:56:52.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 7s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-21T03:56:52.691 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 39885824 bytes 2021-11-21T03:56:52.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 85395456 bytes 2021-11-21T03:56:52.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 129672192 bytes 2021-11-21T03:56:52.923 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 133087232 bytes 2021-11-21T03:56:53.028 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 190459904 bytes 2021-11-21T03:56:53.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 301748224 bytes 2021-11-21T03:56:53.265 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 358374400 bytes 2021-11-21T03:56:53.355 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 387505152 bytes 2021-11-21T03:56:53.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 429755392 bytes 2021-11-21T03:56:53.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 454483968 bytes 2021-11-21T03:56:53.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 455099392 bytes 2021-11-21T03:56:53.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 458461184 bytes 2021-11-21T03:56:53.692 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 532083712 bytes 2021-11-21T03:56:53.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 544911360 bytes 2021-11-21T03:56:53.858 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 633787392 bytes 2021-11-21T03:56:53.934 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 651225088 bytes 2021-11-21T03:56:54.010 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 683842560 bytes 2021-11-21T03:56:54.060 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 696510464 bytes 2021-11-21T03:56:54.198 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 800524288 bytes 2021-11-21T03:56:54.328 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 890521600 bytes 2021-11-21T03:56:54.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 937730048 bytes 2021-11-21T03:56:54.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 963613696 bytes 2021-11-21T03:56:54.489 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2021-11-21T03:56:54.489 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T03:56:54.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T03:56:54.490 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.0 2021-11-21T03:56:54.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2021-11-21T03:56:54.490 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2021-11-21T03:56:54.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2021-11-21T03:56:54.493 INFO:tasks.rbd_mirror_thrash:waiting for 92 secs before thrashing 2021-11-21T03:56:54.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1003396096 bytes 2021-11-21T03:56:54.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1010700288 bytes 2021-11-21T03:56:54.681 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1043050496 bytes 2021-11-21T03:56:54.760 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1077547008 bytes 2021-11-21T03:56:54.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1128056832 bytes 2021-11-21T03:56:54.924 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1166960640 bytes 2021-11-21T03:56:55.022 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1225911296 bytes 2021-11-21T03:56:55.085 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1264090112 bytes 2021-11-21T03:56:55.182 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1310935040 bytes 2021-11-21T03:56:55.253 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1330887680 bytes 2021-11-21T03:56:55.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1350428672 bytes 2021-11-21T03:56:55.427 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1447359488 bytes 2021-11-21T03:56:55.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1485877248 bytes 2021-11-21T03:56:55.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1486476288 bytes 2021-11-21T03:56:55.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1506525184 bytes 2021-11-21T03:56:55.671 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1507134464 bytes 2021-11-21T03:56:55.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1515134976 bytes 2021-11-21T03:56:55.803 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1561060352 bytes 2021-11-21T03:56:55.915 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1624058880 bytes 2021-11-21T03:56:56.001 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1673243648 bytes 2021-11-21T03:56:56.091 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1718254592 bytes 2021-11-21T03:56:56.185 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1773242368 bytes 2021-11-21T03:56:56.242 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1795958784 bytes 2021-11-21T03:56:56.316 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1829942272 bytes 2021-11-21T03:56:56.369 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1841316864 bytes 2021-11-21T03:56:56.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 1885159424 bytes 2021-11-21T03:56:56.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 1926691840 bytes 2021-11-21T03:56:56.589 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 1941044224 bytes 2021-11-21T03:56:56.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 1957794816 bytes 2021-11-21T03:56:56.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 1987542016 bytes 2021-11-21T03:56:56.819 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2061836288 bytes 2021-11-21T03:56:56.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2095255552 bytes 2021-11-21T03:56:56.987 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2117645312 bytes 2021-11-21T03:56:57.068 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2154098688 bytes 2021-11-21T03:56:57.162 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2197643264 bytes 2021-11-21T03:56:57.256 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2268483584 bytes 2021-11-21T03:56:57.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2350770176 bytes 2021-11-21T03:56:57.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2395554816 bytes 2021-11-21T03:56:57.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2401723392 bytes 2021-11-21T03:56:57.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2412045312 bytes 2021-11-21T03:56:57.696 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2475869184 bytes 2021-11-21T03:56:57.969 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2514267136 bytes 2021-11-21T03:56:58.097 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2602800128 bytes 2021-11-21T03:56:58.154 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2622338048 bytes 2021-11-21T03:56:58.257 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2687560704 bytes 2021-11-21T03:56:58.298 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2689664000 bytes 2021-11-21T03:56:58.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2701216768 bytes 2021-11-21T03:56:58.423 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2744476672 bytes 2021-11-21T03:56:58.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 2788112384 bytes 2021-11-21T03:56:58.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 2840041472 bytes 2021-11-21T03:56:58.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 2921263104 bytes 2021-11-21T03:56:58.876 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3016954880 bytes 2021-11-21T03:56:58.965 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3042604032 bytes 2021-11-21T03:56:59.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3055557632 bytes 2021-11-21T03:56:59.093 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3100905472 bytes 2021-11-21T03:56:59.183 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3147735040 bytes 2021-11-21T03:56:59.251 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3173705728 bytes 2021-11-21T03:56:59.320 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3197672448 bytes 2021-11-21T03:56:59.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3240195072 bytes 2021-11-21T03:56:59.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3268736000 bytes 2021-11-21T03:56:59.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T03:56:59.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T03:56:59.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T03:56:59.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:56:59.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-21T03:56:59.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:56:59.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:56:59.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:56:59.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:56:59.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:56:59.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:56:59.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:56:59.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:57:00.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-21T03:57:00.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:00.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:00.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:00.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:57:00.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:57:00.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:57:00.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-21T03:57:00.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-21T03:57:00.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:57:00.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:57:00.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:57:00.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-21T03:57:00.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ tee /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:57:00.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:test: 2021-11-21T03:57:00.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: global_id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:57:00.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+replaying 2021-11-21T03:57:00.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":535262208.0,"local_snapshot_timestamp":1637466950,"remote_snapshot_timestamp":1637466950,"replay_state":"idle"} 2021-11-21T03:57:00.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: service: mirror.3 on gibba043 2021-11-21T03:57:00.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:56:41 2021-11-21T03:57:00.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: peer_sites: 2021-11-21T03:57:00.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: name: cluster2 2021-11-21T03:57:00.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: down+unknown 2021-11-21T03:57:00.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: status not found 2021-11-21T03:57:00.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21T03:57:00.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:57:00.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T03:57:00.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ description: .*' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:57:00.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":535262208.0,"local_snapshot_timestamp":1637466950,"remote_snapshot_timestamp":1637466950,"replay_state":"idle"} 2021-11-21T03:57:00.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:57:00.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:57:00.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^up+' 2021-11-21T03:57:00.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:57:00.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:57:00.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.3 on gibba043 2021-11-21T03:57:00.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:57:00.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'last_update=2021-11-21 03:56:41' 2021-11-21T03:57:00.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-21 03:56:41' 2021-11-21T03:57:00.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:00.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:00.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:00.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:57:00.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'prev_last_update=2021-11-21 03:56:41' 2021-11-21T03:57:00.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-21T03:57:00.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror.mirror_status 2021-11-21T03:57:00.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:57:00.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror.mirror_status 2021-11-21T03:57:00.557 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-21T03:57:00.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: failed to query services: (13) Permission denied 2021-11-21T03:57:00.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local last_update state 2021-11-21T03:57:00.599 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-21T03:57:00.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ last_update='2021-11-21 03:56:41' 2021-11-21T03:57:00.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-21T03:57:00.601 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ state=up+replaying 2021-11-21T03:57:00.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:57:00.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep up+replaying 2021-11-21T03:57:00.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:57:00.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:57:00.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:57:00.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap7 2021-11-21T03:57:00.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap7 2021-11-21T03:57:00.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:57:00.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:00.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:00.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap7 2021-11-21T03:57:00.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap7 --debug-rbd=20 --debug-journaler=20 2021-11-21T03:57:29.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-21T03:57:29.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:29.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:29.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:29.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-21T03:57:29.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:29.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:29.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:29.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state=started 2021-11-21T03:57:29.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:57:29.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:57:29.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:57:30.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-21T03:57:30.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:30.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:30.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:30.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=started 2021-11-21T03:57:30.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_result 2021-11-21T03:57:30.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=stopped 2021-11-21T03:57:30.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-21T03:57:30.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_instance=cluster1 2021-11-21T03:57:30.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:57:30.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ grep -i state 2021-11-21T03:57:30.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T03:57:30.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance=cluster1 2021-11-21T03:57:30.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local loop_instance 2021-11-21T03:57:30.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:57:30.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 0 2021-11-21T03:57:30.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:57:30.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:57:30.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:57:30.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:57:30.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:57:30.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:57:30.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:57:30.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:57:30.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:57:30.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:57:30.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:57:30.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:57:30.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:57:30.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:57:30.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:57:30.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:57:30.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:57:30.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:57:30.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:57:30.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:57:30.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:57:30.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:57:30.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:57:30.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:57:30.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:57:30.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:57:30.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:57:30.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:57:30.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:57:30.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:57:30.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:57:30.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:57:30.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:57:30.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:57:30.522 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:57:30.523 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:57:30.523 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:57:30.523 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:57:30.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:57:30.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:57:30.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:57:30.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:57:30.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:57:30.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:57:30.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:57:30.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:57:30.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:57:30.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:57:30.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:57:30.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:57:30.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:57:30.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:57:30.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:57:30.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:57:30.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:57:30.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:57:30.585 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:57:30.585 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:57:30.585 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:57:30.585 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:57:30.585 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:57:30.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:57:30.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:57:30.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:57:30.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:57:30.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:57:30.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:57:30.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:57:30.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:57:30.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:57:30.588 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:57:30.588 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:57:30.588 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:57:30.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:57:30.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:57:30.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:57:30.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:57:30.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:57:30.651 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:57:30.651 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:57:30.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:57:30.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:57:30.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:57:30.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:57:30.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:57:30.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:57:30.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:57:30.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:57:30.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:57:30.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:57:30.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:57:30.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:57:30.657 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:57:30.657 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:57:30.657 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:57:30.657 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:57:30.657 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:57:30.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:57:30.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:57:30.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:57:30.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:57:30.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:57:30.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:57:30.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:57:30.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:57:30.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:57:30.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:57:30.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:57:30.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:57:30.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:57:30.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:57:30.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:57:30.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:57:30.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:57:30.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:57:30.664 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:57:30.720 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:57:30.720 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:57:30.721 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:57:30.723 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:57:30.724 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:57:30.724 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:57:30.724 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:57:30.724 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:57:30.725 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:57:30.725 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:57:30.725 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:57:30.725 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:57:30.725 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:57:30.726 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:57:30.726 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:57:30.726 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:57:30.726 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:57:30.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:57:30.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:57:30.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:57:30.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:57:30.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:57:30.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:57:30.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:57:30.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:57:30.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:57:30.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:57:30.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:57:30.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:57:30.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:57:30.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:57:30.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:57:30.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:57:30.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:57:30.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:57:30.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:57:30.733 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:57:30.733 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:57:30.733 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:57:30.795 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ return 0 2021-11-21T03:57:30.795 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ status_result=' "state": "Replaying"' 2021-11-21T03:57:30.795 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo ' "state": "Replaying"' 2021-11-21T03:57:30.795 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep -i Replaying 2021-11-21T03:57:30.796 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "state": "Replaying" 2021-11-21T03:57:30.798 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_state=started 2021-11-21T03:57:30.799 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test started = started 2021-11-21T03:57:30.799 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:57:30.799 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-21T03:57:30.799 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:57:30.799 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:57:30.800 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:30.800 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:30.800 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = journal ']' 2021-11-21T03:57:30.800 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = snapshot ']' 2021-11-21T03:57:30.801 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-21T03:57:30.801 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:57:30.801 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:57:30.801 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:30.801 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:30.802 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster2-mirror-test.status 2021-11-21T03:57:30.802 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster2-mirror-test.status 2021-11-21T03:57:30.802 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:57:30.802 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:57:30.803 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.status 2021-11-21T03:57:30.803 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.status 2021-11-21T03:57:30.803 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:57:30.803 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:57:30.803 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-21T03:57:30.804 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:57:30.804 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:30.804 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:30.804 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-21T03:57:31.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Snapshot ID: 30 2021-11-21T03:57:31.523 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:57:31.523 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:57:31.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:31.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:31.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:57:31.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-21T03:57:31.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:57:31.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-21T03:57:31.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snapshot_id=30 2021-11-21T03:57:31.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:57:31.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:57:31.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.2 2021-11-21T03:57:31.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:57:31.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:31.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:31.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:31.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:57:31.756 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:57:31.756 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:57:31.788 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:57:31.789 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=26 2021-11-21T03:57:31.790 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 30 = 26 2021-11-21T03:57:31.790 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:57:31.790 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.4 2021-11-21T03:57:32.191 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:57:32.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:32.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:32.193 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:32.193 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:57:32.194 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:57:32.194 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:57:32.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:57:32.227 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=26 2021-11-21T03:57:32.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 30 = 26 2021-11-21T03:57:32.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:57:32.229 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.8 2021-11-21T03:57:33.029 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:57:33.029 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:33.030 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:33.030 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:33.030 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:57:33.030 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:57:33.031 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:57:33.066 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:57:33.066 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:57:33.067 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:57:33.067 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:57:33.067 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:57:33.067 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:57:33.068 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 30 = '' 2021-11-21T03:57:33.068 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:57:33.068 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1.6 2021-11-21T03:57:34.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:57:34.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:34.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:34.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:34.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:57:34.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:57:34.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:57:34.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:57:34.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:57:34.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:57:34.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:57:34.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:57:34.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:57:34.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 30 = '' 2021-11-21T03:57:34.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:57:34.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 2 2021-11-21T03:57:36.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:57:36.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:36.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:36.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:36.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:57:36.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:57:36.706 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:57:36.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:57:36.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=30 2021-11-21T03:57:36.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 30 = 30 2021-11-21T03:57:36.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:57:36.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snap_present cluster1 mirror test snap7 2021-11-21T03:57:36.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:36.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:36.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:36.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap7 2021-11-21T03:57:36.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:57:36.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-21T03:57:36.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:57:37.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 info mirror/test@snap7 2021-11-21T03:57:37.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'test': 2021-11-21T03:57:37.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 512 MiB in 128 objects 2021-11-21T03:57:37.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T03:57:37.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 14 2021-11-21T03:57:37.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 10a2324c201b 2021-11-21T03:57:37.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.10a2324c201b 2021-11-21T03:57:37.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T03:57:37.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T03:57:37.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T03:57:37.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T03:57:37.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:57:37.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 03:56:50 2021 2021-11-21T03:57:37.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:57:37.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: protected: False 2021-11-21T03:57:37.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T03:57:37.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T03:57:37.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:57:37.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T03:57:37.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:57:37.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snap6-clean ']' 2021-11-21T03:57:37.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap6-clean 2021-11-21T03:57:37.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:37.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:37.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap6-clean 2021-11-21T03:57:37.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:57:37.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:57:37.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:57:37.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:57:37.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap6-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:57:38.218 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:57:38.221 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap6-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:57:38.885 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:57:38.887 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:57:39.015 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:57:39.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:57:39.113 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap7 2021-11-21T03:57:39.113 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:39.113 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:39.113 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap7 2021-11-21T03:57:39.114 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:57:39.114 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:57:39.114 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:57:39.114 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:57:39.115 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap7 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:57:39.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:57:39.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap7 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:57:40.210 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:57:40.213 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:57:40.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:57:40.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:57:40.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ clean_snap_name=snap7-clean 2021-11-21T03:57:40.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap7-clean 2021-11-21T03:57:40.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:57:40.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:40.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:40.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap7-clean 2021-11-21T03:57:40.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap7-clean --debug-rbd=20 --debug-journaler=20 2021-11-21T03:57:41.325 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T03:57:41.326 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror test 2021-11-21T03:57:41.326 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:57:41.326 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:41.326 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:41.326 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T03:57:41.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=11 2021-11-21T03:57:41.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T03:57:41.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 11s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-21T03:57:41.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 26684416 bytes 2021-11-21T03:57:41.592 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.7285295454346405) > weight (0.25) 2021-11-21T03:57:41.592 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.469170451032499) > weight (0.25) 2021-11-21T03:57:41.592 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.6403658413816697) > weight (0.25) 2021-11-21T03:57:41.592 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.3 with skip (0.8286262435695898) > weight (0.25) 2021-11-21T03:57:41.593 INFO:tasks.rbd_mirror_thrash:waiting for 98 secs before thrashing 2021-11-21T03:57:41.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 91421696 bytes 2021-11-21T03:57:41.722 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 116579328 bytes 2021-11-21T03:57:41.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 117185536 bytes 2021-11-21T03:57:41.900 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 207237120 bytes 2021-11-21T03:57:41.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 255347712 bytes 2021-11-21T03:57:42.117 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 345644032 bytes 2021-11-21T03:57:42.205 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 391567360 bytes 2021-11-21T03:57:42.264 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 408891392 bytes 2021-11-21T03:57:42.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 505604096 bytes 2021-11-21T03:57:42.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 535655424 bytes 2021-11-21T03:57:42.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 555023360 bytes 2021-11-21T03:57:42.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 563292160 bytes 2021-11-21T03:57:42.695 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 639550464 bytes 2021-11-21T03:57:42.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 672984064 bytes 2021-11-21T03:57:42.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 685692928 bytes 2021-11-21T03:57:42.885 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 713757696 bytes 2021-11-21T03:57:42.963 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 754541568 bytes 2021-11-21T03:57:43.004 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 755165184 bytes 2021-11-21T03:57:43.107 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 828360704 bytes 2021-11-21T03:57:43.203 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 882432000 bytes 2021-11-21T03:57:43.302 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 939832320 bytes 2021-11-21T03:57:43.366 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 970034176 bytes 2021-11-21T03:57:43.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1001944064 bytes 2021-11-21T03:57:43.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1007985664 bytes 2021-11-21T03:57:43.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1026961408 bytes 2021-11-21T03:57:43.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1027599360 bytes 2021-11-21T03:57:43.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1028187136 bytes 2021-11-21T03:57:43.758 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1139278848 bytes 2021-11-21T03:57:43.842 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1181005824 bytes 2021-11-21T03:57:43.932 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1220939776 bytes 2021-11-21T03:57:43.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1221555200 bytes 2021-11-21T03:57:44.028 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1261345792 bytes 2021-11-21T03:57:44.108 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1281758208 bytes 2021-11-21T03:57:44.209 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1339281408 bytes 2021-11-21T03:57:44.297 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1386981376 bytes 2021-11-21T03:57:44.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1448880128 bytes 2021-11-21T03:57:44.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1506572288 bytes 2021-11-21T03:57:44.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1557733376 bytes 2021-11-21T03:57:44.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1571179520 bytes 2021-11-21T03:57:44.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1647219712 bytes 2021-11-21T03:57:44.797 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1666015232 bytes 2021-11-21T03:57:44.917 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1739752448 bytes 2021-11-21T03:57:44.978 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1756436480 bytes 2021-11-21T03:57:45.066 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1800174592 bytes 2021-11-21T03:57:45.136 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1830847488 bytes 2021-11-21T03:57:45.210 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1883729920 bytes 2021-11-21T03:57:45.325 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 1940484096 bytes 2021-11-21T03:57:45.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2030477312 bytes 2021-11-21T03:57:45.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2090923008 bytes 2021-11-21T03:57:45.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2104425472 bytes 2021-11-21T03:57:45.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2145414144 bytes 2021-11-21T03:57:45.799 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2205122560 bytes 2021-11-21T03:57:45.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2245699584 bytes 2021-11-21T03:57:45.954 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2282961920 bytes 2021-11-21T03:57:46.055 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2340158464 bytes 2021-11-21T03:57:46.132 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2378032128 bytes 2021-11-21T03:57:46.205 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2410588160 bytes 2021-11-21T03:57:46.306 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2468837376 bytes 2021-11-21T03:57:46.359 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2482001920 bytes 2021-11-21T03:57:46.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2530249728 bytes 2021-11-21T03:57:46.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2594681856 bytes 2021-11-21T03:57:46.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2630992896 bytes 2021-11-21T03:57:46.799 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2690509824 bytes 2021-11-21T03:57:46.885 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2716247040 bytes 2021-11-21T03:57:46.993 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2782575616 bytes 2021-11-21T03:57:47.067 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2819196928 bytes 2021-11-21T03:57:47.154 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2871284736 bytes 2021-11-21T03:57:47.258 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2926647296 bytes 2021-11-21T03:57:47.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2950060032 bytes 2021-11-21T03:57:47.372 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 2956806144 bytes 2021-11-21T03:57:47.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 3016296448 bytes 2021-11-21T03:57:47.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3053152256 bytes 2021-11-21T03:57:47.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3136016384 bytes 2021-11-21T03:57:47.724 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3150989312 bytes 2021-11-21T03:57:47.821 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3206016000 bytes 2021-11-21T03:57:47.886 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3234911232 bytes 2021-11-21T03:57:47.989 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3293591552 bytes 2021-11-21T03:57:48.053 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3315171328 bytes 2021-11-21T03:57:48.131 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3353777152 bytes 2021-11-21T03:57:48.235 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3421369344 bytes 2021-11-21T03:57:48.324 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3486844928 bytes 2021-11-21T03:57:48.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3516136448 bytes 2021-11-21T03:57:48.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3591439360 bytes 2021-11-21T03:57:48.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3628020736 bytes 2021-11-21T03:57:48.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3700698112 bytes 2021-11-21T03:57:48.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3763994624 bytes 2021-11-21T03:57:48.922 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3808514048 bytes 2021-11-21T03:57:48.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3832684544 bytes 2021-11-21T03:57:49.082 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3876406272 bytes 2021-11-21T03:57:49.123 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3877006336 bytes 2021-11-21T03:57:49.190 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3917210624 bytes 2021-11-21T03:57:49.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 3965629440 bytes 2021-11-21T03:57:49.367 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 3999817728 bytes 2021-11-21T03:57:49.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 4086769664 bytes 2021-11-21T03:57:49.625 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 4180852736 bytes 2021-11-21T03:57:49.684 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 4200192000 bytes 2021-11-21T03:57:49.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 4262714368 bytes 2021-11-21T03:57:49.845 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 4278874112 bytes 2021-11-21T03:57:49.991 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 4387764224 bytes 2021-11-21T03:57:50.049 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4437886976 bytes 2021-11-21T03:57:50.135 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4458202112 bytes 2021-11-21T03:57:50.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4502598656 bytes 2021-11-21T03:57:50.308 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4544921600 bytes 2021-11-21T03:57:50.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4608966656 bytes 2021-11-21T03:57:50.478 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4630946816 bytes 2021-11-21T03:57:50.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4687451136 bytes 2021-11-21T03:57:50.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4705409024 bytes 2021-11-21T03:57:50.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4776136704 bytes 2021-11-21T03:57:50.795 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4776719360 bytes 2021-11-21T03:57:50.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 4800110592 bytes 2021-11-21T03:57:50.915 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 4819502080 bytes 2021-11-21T03:57:51.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 4907829248 bytes 2021-11-21T03:57:51.161 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 4987961344 bytes 2021-11-21T03:57:51.239 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 5041826816 bytes 2021-11-21T03:57:51.358 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 5097964544 bytes 2021-11-21T03:57:51.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 5130272768 bytes 2021-11-21T03:57:51.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 5227791360 bytes 2021-11-21T03:57:51.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 5248845824 bytes 2021-11-21T03:57:51.720 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 5298890752 bytes 2021-11-21T03:57:51.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 5310091264 bytes 2021-11-21T03:57:51.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 5391325184 bytes 2021-11-21T03:57:51.951 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 5411359744 bytes 2021-11-21T03:57:52.037 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 5459347456 bytes 2021-11-21T03:57:52.103 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 5506013184 bytes 2021-11-21T03:57:52.210 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12600 IOs, 5557370880 bytes 2021-11-21T03:57:52.330 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T03:57:52.331 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T03:57:52.331 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T03:57:52.331 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:57:52.331 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-21T03:57:52.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:52.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:52.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:52.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:57:52.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:57:52.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:57:52.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:57:52.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:57:53.331 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-21T03:57:53.331 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:53.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:53.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:53.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:57:53.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:57:53.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:57:53.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-21T03:57:53.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-21T03:57:53.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:57:53.334 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:57:53.334 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:57:53.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-21T03:57:53.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ tee /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:57:53.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:test: 2021-11-21T03:57:53.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: global_id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:57:53.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+replaying 2021-11-21T03:57:53.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: replaying, {"bytes_per_second":17831697.07,"bytes_per_snapshot":535305216.0,"local_snapshot_timestamp":1637467051,"remote_snapshot_timestamp":1637467051,"replay_state":"idle"} 2021-11-21T03:57:53.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: service: mirror.3 on gibba043 2021-11-21T03:57:53.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:57:41 2021-11-21T03:57:53.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: peer_sites: 2021-11-21T03:57:53.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: name: cluster2 2021-11-21T03:57:53.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+stopped 2021-11-21T03:57:53.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: local image is primary 2021-11-21T03:57:53.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:57:30 2021-11-21T03:57:53.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:57:53.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T03:57:53.381 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ description: .*' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:57:53.381 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":17831697.07,"bytes_per_snapshot":535305216.0,"local_snapshot_timestamp":1637467051,"remote_snapshot_timestamp":1637467051,"replay_state":"idle"} 2021-11-21T03:57:53.382 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:57:53.382 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:57:53.382 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^up+' 2021-11-21T03:57:53.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:57:53.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:57:53.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.3 on gibba043 2021-11-21T03:57:53.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:57:53.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'last_update=2021-11-21 03:57:41' 2021-11-21T03:57:53.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-21 03:57:41' 2021-11-21T03:57:53.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:57:53.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:53.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:53.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:57:53.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'prev_last_update=2021-11-21 03:57:41' 2021-11-21T03:57:53.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-21T03:57:53.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror.mirror_status 2021-11-21T03:57:53.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:57:53.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror.mirror_status 2021-11-21T03:57:53.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-21T03:57:53.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: failed to query services: (13) Permission denied 2021-11-21T03:57:53.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local last_update state 2021-11-21T03:57:53.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-21T03:57:53.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ last_update='2021-11-21 03:57:41' 2021-11-21T03:57:53.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-21T03:57:53.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ state=up+replaying 2021-11-21T03:57:53.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:57:53.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep up+replaying 2021-11-21T03:57:53.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:57:53.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:57:53.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:57:53.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap8 2021-11-21T03:57:53.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap8 2021-11-21T03:57:53.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:57:53.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:57:53.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:57:53.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap8 2021-11-21T03:57:53.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap8 --debug-rbd=20 --debug-journaler=20 2021-11-21T03:58:23.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-21T03:58:23.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:58:23.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:23.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:23.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-21T03:58:23.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:58:23.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:23.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:23.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state=started 2021-11-21T03:58:23.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:58:23.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:58:23.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:58:24.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-21T03:58:24.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:58:24.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:24.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:24.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=started 2021-11-21T03:58:24.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_result 2021-11-21T03:58:24.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=stopped 2021-11-21T03:58:24.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-21T03:58:24.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_instance=cluster1 2021-11-21T03:58:24.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:58:24.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ grep -i state 2021-11-21T03:58:24.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T03:58:24.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance=cluster1 2021-11-21T03:58:24.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local loop_instance 2021-11-21T03:58:24.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:58:24.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 0 2021-11-21T03:58:24.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:58:24.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:58:24.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:58:24.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:58:24.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:58:24.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:58:24.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:58:24.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:58:24.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:58:24.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:58:24.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:58:24.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:58:24.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:58:24.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:58:24.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:58:24.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:58:24.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:58:24.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:58:24.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:58:24.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:58:24.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:58:24.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:58:24.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:58:24.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:58:24.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:58:24.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:58:24.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:58:24.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:58:24.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:58:24.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:58:24.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:58:24.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:58:24.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:58:24.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:58:24.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:58:24.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:58:24.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:58:24.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:58:24.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:58:24.588 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:58:24.588 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:58:24.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:58:24.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:58:24.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:58:24.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:58:24.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:58:24.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:58:24.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:58:24.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:58:24.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:58:24.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:58:24.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:58:24.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:58:24.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:58:24.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:58:24.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:58:24.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:58:24.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:58:24.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:58:24.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:58:24.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:58:24.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:58:24.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:58:24.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:58:24.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:58:24.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:58:24.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:58:24.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:58:24.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:58:24.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:58:24.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:58:24.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:58:24.598 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:58:24.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:58:24.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:58:24.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:58:24.601 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:58:24.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:58:24.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:58:24.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:58:24.662 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:58:24.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:58:24.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:58:24.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:58:24.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:58:24.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:58:24.664 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:58:24.664 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:58:24.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:58:24.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:58:24.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:58:24.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:58:24.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:58:24.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:58:24.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:58:24.667 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:58:24.667 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:58:24.667 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:58:24.667 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:58:24.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:58:24.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:58:24.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:58:24.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:58:24.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:58:24.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:58:24.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:58:24.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:58:24.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:58:24.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:58:24.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:58:24.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:58:24.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:58:24.671 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:58:24.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:58:24.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:58:24.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:58:24.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:58:24.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:58:24.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:58:24.733 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:58:24.733 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:58:24.733 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:58:24.734 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:58:24.734 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:58:24.734 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:58:24.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:58:24.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:58:24.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:58:24.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:58:24.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:58:24.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:58:24.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:58:24.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:58:24.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:58:24.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:58:24.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:58:24.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:58:24.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:58:24.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:58:24.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:58:24.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:58:24.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:58:24.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:58:24.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:58:24.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:58:24.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:58:24.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:58:24.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:58:24.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:58:24.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:58:24.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:58:24.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:58:24.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:58:24.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:58:24.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:58:24.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ return 0 2021-11-21T03:58:24.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ status_result=' "state": "Replaying"' 2021-11-21T03:58:24.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo ' "state": "Replaying"' 2021-11-21T03:58:24.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep -i Replaying 2021-11-21T03:58:24.806 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "state": "Replaying" 2021-11-21T03:58:24.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_state=started 2021-11-21T03:58:24.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test started = started 2021-11-21T03:58:24.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:58:24.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-21T03:58:24.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:58:24.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:58:24.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:24.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:24.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = journal ']' 2021-11-21T03:58:24.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = snapshot ']' 2021-11-21T03:58:24.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-21T03:58:24.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:58:24.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:58:24.812 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:24.812 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:24.812 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster2-mirror-test.status 2021-11-21T03:58:24.812 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster2-mirror-test.status 2021-11-21T03:58:24.813 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:58:24.813 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:58:24.813 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.status 2021-11-21T03:58:24.813 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.status 2021-11-21T03:58:24.813 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:58:24.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:58:24.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-21T03:58:24.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:58:24.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:24.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:24.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-21T03:58:25.523 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Snapshot ID: 34 2021-11-21T03:58:25.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:58:25.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:58:25.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:25.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:25.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:58:25.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-21T03:58:25.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:58:25.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-21T03:58:25.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snapshot_id=34 2021-11-21T03:58:25.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:58:25.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:58:25.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.2 2021-11-21T03:58:25.761 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:58:25.762 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:58:25.762 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:25.762 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:25.762 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:58:25.762 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:58:25.763 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:58:25.793 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:58:25.794 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=30 2021-11-21T03:58:25.794 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 34 = 30 2021-11-21T03:58:25.795 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:58:25.795 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.4 2021-11-21T03:58:26.195 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:58:26.196 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:58:26.196 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:26.196 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:26.196 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:58:26.197 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:58:26.197 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:58:26.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:58:26.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=30 2021-11-21T03:58:26.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 34 = 30 2021-11-21T03:58:26.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:58:26.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.8 2021-11-21T03:58:26.493 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2021-11-21T03:58:26.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2021-11-21T03:58:26.495 INFO:tasks.rbd_mirror_thrash:waiting for 9 secs before reviving daemons 2021-11-21T03:58:26.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr:2021-11-21T03:58:26.496+0000 7f049dc71700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 38142) UID: 1000 2021-11-21T03:58:26.696 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr:daemon-helper: command failed with exit status 1 2021-11-21T03:58:27.031 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:58:27.031 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:58:27.032 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:27.032 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:27.032 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:58:27.033 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:58:27.033 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:58:27.069 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:58:27.069 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:58:27.070 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:58:27.070 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:58:27.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:58:27.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:58:27.072 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 34 = '' 2021-11-21T03:58:27.072 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:58:27.072 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1.6 2021-11-21T03:58:28.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:58:28.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:58:28.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:28.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:28.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:58:28.674 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:58:28.674 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:58:28.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:58:28.715 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:58:28.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:58:28.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:58:28.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:58:28.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:58:28.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 34 = '' 2021-11-21T03:58:28.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:58:28.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 2 2021-11-21T03:58:30.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:58:30.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:58:30.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:30.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:30.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:58:30.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:58:30.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:58:30.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:58:30.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=34 2021-11-21T03:58:30.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 34 = 34 2021-11-21T03:58:30.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:58:30.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snap_present cluster1 mirror test snap8 2021-11-21T03:58:30.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:58:30.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:30.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:30.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap8 2021-11-21T03:58:30.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:58:30.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-21T03:58:30.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:58:31.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 info mirror/test@snap8 2021-11-21T03:58:31.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'test': 2021-11-21T03:58:31.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 512 MiB in 128 objects 2021-11-21T03:58:31.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T03:58:31.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 16 2021-11-21T03:58:31.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 10a2324c201b 2021-11-21T03:58:31.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.10a2324c201b 2021-11-21T03:58:31.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T03:58:31.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T03:58:31.788 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T03:58:31.788 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T03:58:31.788 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:58:31.788 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 03:56:50 2021 2021-11-21T03:58:31.789 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:58:31.789 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: protected: False 2021-11-21T03:58:31.789 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T03:58:31.789 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T03:58:31.789 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:58:31.790 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T03:58:31.791 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:58:31.791 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snap7-clean ']' 2021-11-21T03:58:31.792 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap7-clean 2021-11-21T03:58:31.792 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:31.792 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:31.792 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap7-clean 2021-11-21T03:58:31.793 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:58:31.793 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:58:31.793 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:58:31.793 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:58:31.793 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap7-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:58:32.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:58:32.229 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap7-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:58:33.143 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:58:33.146 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:58:33.277 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:58:33.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:58:33.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap8 2021-11-21T03:58:33.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:33.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:33.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap8 2021-11-21T03:58:33.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:58:33.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:58:33.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:58:33.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:58:33.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap8 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:58:33.832 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:58:33.834 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap8 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:58:34.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:58:34.473 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:58:34.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:58:34.698 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:58:34.698 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ clean_snap_name=snap8-clean 2021-11-21T03:58:34.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap8-clean 2021-11-21T03:58:34.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:58:34.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:34.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:34.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap8-clean 2021-11-21T03:58:34.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap8-clean --debug-rbd=20 --debug-journaler=20 2021-11-21T03:58:35.342 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T03:58:35.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror test 2021-11-21T03:58:35.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:58:35.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:35.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:35.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T03:58:35.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=14 2021-11-21T03:58:35.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T03:58:35.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 14s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-21T03:58:35.495 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2021-11-21T03:58:35.496 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T03:58:35.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T03:58:35.497 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.0 2021-11-21T03:58:35.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2021-11-21T03:58:35.497 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2021-11-21T03:58:35.500 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2021-11-21T03:58:35.501 INFO:tasks.rbd_mirror_thrash:waiting for 99 secs before thrashing 2021-11-21T03:58:35.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 52290560 bytes 2021-11-21T03:58:35.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 79758336 bytes 2021-11-21T03:58:35.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 133894144 bytes 2021-11-21T03:58:35.824 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 184236032 bytes 2021-11-21T03:58:35.951 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 279036928 bytes 2021-11-21T03:58:36.028 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 306879488 bytes 2021-11-21T03:58:36.082 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 322038784 bytes 2021-11-21T03:58:36.146 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 338105344 bytes 2021-11-21T03:58:36.279 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 443826176 bytes 2021-11-21T03:58:36.362 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 473616384 bytes 2021-11-21T03:58:36.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 498827264 bytes 2021-11-21T03:58:36.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 560399360 bytes 2021-11-21T03:58:36.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 620019712 bytes 2021-11-21T03:58:36.693 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 643923968 bytes 2021-11-21T03:58:36.788 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 714074112 bytes 2021-11-21T03:58:36.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 766288896 bytes 2021-11-21T03:58:36.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 828789760 bytes 2021-11-21T03:58:37.057 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 861444096 bytes 2021-11-21T03:58:37.141 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 908384256 bytes 2021-11-21T03:58:37.214 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 938397696 bytes 2021-11-21T03:58:37.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 1012846592 bytes 2021-11-21T03:58:37.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 1050984448 bytes 2021-11-21T03:58:37.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1070371840 bytes 2021-11-21T03:58:37.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1134210048 bytes 2021-11-21T03:58:37.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1159190528 bytes 2021-11-21T03:58:37.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1220785152 bytes 2021-11-21T03:58:37.854 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1285882880 bytes 2021-11-21T03:58:37.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1302194176 bytes 2021-11-21T03:58:37.960 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1314208768 bytes 2021-11-21T03:58:38.031 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1344856064 bytes 2021-11-21T03:58:38.074 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1348515840 bytes 2021-11-21T03:58:38.152 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1386215424 bytes 2021-11-21T03:58:38.276 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1466554368 bytes 2021-11-21T03:58:38.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1481131008 bytes 2021-11-21T03:58:38.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1498318848 bytes 2021-11-21T03:58:38.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1561053184 bytes 2021-11-21T03:58:38.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1593229312 bytes 2021-11-21T03:58:38.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1606304768 bytes 2021-11-21T03:58:38.685 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1633464320 bytes 2021-11-21T03:58:38.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1663602688 bytes 2021-11-21T03:58:38.821 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1712201728 bytes 2021-11-21T03:58:39.034 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1855396864 bytes 2021-11-21T03:58:39.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1876156416 bytes 2021-11-21T03:58:39.137 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1878691840 bytes 2021-11-21T03:58:39.211 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1927948288 bytes 2021-11-21T03:58:39.357 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 2022798336 bytes 2021-11-21T03:58:39.398 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 2023402496 bytes 2021-11-21T03:58:39.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 2048653312 bytes 2021-11-21T03:58:39.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2053065728 bytes 2021-11-21T03:58:39.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2083237888 bytes 2021-11-21T03:58:39.692 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2140200960 bytes 2021-11-21T03:58:39.792 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2199435264 bytes 2021-11-21T03:58:39.855 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2245774336 bytes 2021-11-21T03:58:39.980 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2329862144 bytes 2021-11-21T03:58:40.078 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2365895680 bytes 2021-11-21T03:58:40.189 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2431151104 bytes 2021-11-21T03:58:40.268 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2485542912 bytes 2021-11-21T03:58:40.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2545261568 bytes 2021-11-21T03:58:40.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2551809024 bytes 2021-11-21T03:58:40.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2572895232 bytes 2021-11-21T03:58:40.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2573529088 bytes 2021-11-21T03:58:40.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2638403584 bytes 2021-11-21T03:58:40.707 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2662187008 bytes 2021-11-21T03:58:40.790 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2702840832 bytes 2021-11-21T03:58:40.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2710643712 bytes 2021-11-21T03:58:40.885 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2732817408 bytes 2021-11-21T03:58:40.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2775639040 bytes 2021-11-21T03:58:41.085 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2822763520 bytes 2021-11-21T03:58:41.167 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2864478208 bytes 2021-11-21T03:58:41.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2882081792 bytes 2021-11-21T03:58:41.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 2934124544 bytes 2021-11-21T03:58:41.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 2985785344 bytes 2021-11-21T03:58:41.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 2989204480 bytes 2021-11-21T03:58:41.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3076310016 bytes 2021-11-21T03:58:41.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3101693952 bytes 2021-11-21T03:58:41.692 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3102302208 bytes 2021-11-21T03:58:41.797 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3198602240 bytes 2021-11-21T03:58:41.900 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3235745792 bytes 2021-11-21T03:58:41.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3279931392 bytes 2021-11-21T03:58:42.084 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3337677824 bytes 2021-11-21T03:58:42.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3375443968 bytes 2021-11-21T03:58:42.239 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3410157568 bytes 2021-11-21T03:58:42.299 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3428762624 bytes 2021-11-21T03:58:42.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3434278912 bytes 2021-11-21T03:58:42.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3516259328 bytes 2021-11-21T03:58:42.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3567733760 bytes 2021-11-21T03:58:42.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3581735936 bytes 2021-11-21T03:58:42.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3589183488 bytes 2021-11-21T03:58:42.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3650846720 bytes 2021-11-21T03:58:42.876 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3709378560 bytes 2021-11-21T03:58:42.971 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3760327680 bytes 2021-11-21T03:58:43.165 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3916008448 bytes 2021-11-21T03:58:43.244 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 3941377024 bytes 2021-11-21T03:58:43.315 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 3971121152 bytes 2021-11-21T03:58:43.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 4033195008 bytes 2021-11-21T03:58:43.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 4033808384 bytes 2021-11-21T03:58:43.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 4086279168 bytes 2021-11-21T03:58:43.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 4117197824 bytes 2021-11-21T03:58:43.684 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 4170853376 bytes 2021-11-21T03:58:43.841 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 4244034560 bytes 2021-11-21T03:58:43.937 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4296782848 bytes 2021-11-21T03:58:44.033 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4347486208 bytes 2021-11-21T03:58:44.094 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4368081920 bytes 2021-11-21T03:58:44.205 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4454862848 bytes 2021-11-21T03:58:44.326 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4514407424 bytes 2021-11-21T03:58:44.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4529020928 bytes 2021-11-21T03:58:44.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4562820096 bytes 2021-11-21T03:58:44.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4585008128 bytes 2021-11-21T03:58:44.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4622311424 bytes 2021-11-21T03:58:44.682 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4671110144 bytes 2021-11-21T03:58:44.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 4713266176 bytes 2021-11-21T03:58:44.890 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 4822967296 bytes 2021-11-21T03:58:45.027 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 4884516864 bytes 2021-11-21T03:58:45.125 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 4941782016 bytes 2021-11-21T03:58:45.214 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 5017664512 bytes 2021-11-21T03:58:45.325 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 5060626432 bytes 2021-11-21T03:58:45.473 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 5175493632 bytes 2021-11-21T03:58:45.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 5213244416 bytes 2021-11-21T03:58:45.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 5223483392 bytes 2021-11-21T03:58:45.686 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 5248141312 bytes 2021-11-21T03:58:45.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 5270007808 bytes 2021-11-21T03:58:45.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 5325134848 bytes 2021-11-21T03:58:45.946 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 5392472064 bytes 2021-11-21T03:58:46.007 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 5406428160 bytes 2021-11-21T03:58:46.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 5437655040 bytes 2021-11-21T03:58:46.145 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12600 IOs, 5455287296 bytes 2021-11-21T03:58:46.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12700 IOs, 5493001216 bytes 2021-11-21T03:58:46.281 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12800 IOs, 5510293504 bytes 2021-11-21T03:58:46.367 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12900 IOs, 5556756480 bytes 2021-11-21T03:58:46.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13000 IOs, 5618617344 bytes 2021-11-21T03:58:46.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13100 IOs, 5694168064 bytes 2021-11-21T03:58:46.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13200 IOs, 5716859904 bytes 2021-11-21T03:58:46.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13300 IOs, 5816325120 bytes 2021-11-21T03:58:46.861 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13400 IOs, 5853223936 bytes 2021-11-21T03:58:46.929 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13500 IOs, 5882054656 bytes 2021-11-21T03:58:47.048 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13600 IOs, 5911045120 bytes 2021-11-21T03:58:47.237 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13700 IOs, 6078843904 bytes 2021-11-21T03:58:47.323 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13800 IOs, 6121674752 bytes 2021-11-21T03:58:47.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13900 IOs, 6197029888 bytes 2021-11-21T03:58:47.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14000 IOs, 6261305344 bytes 2021-11-21T03:58:47.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14100 IOs, 6327505920 bytes 2021-11-21T03:58:47.723 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14200 IOs, 6345147392 bytes 2021-11-21T03:58:47.783 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14300 IOs, 6362827776 bytes 2021-11-21T03:58:47.859 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14400 IOs, 6402135040 bytes 2021-11-21T03:58:47.907 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14500 IOs, 6406728704 bytes 2021-11-21T03:58:47.971 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14600 IOs, 6431603712 bytes 2021-11-21T03:58:48.055 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14700 IOs, 6472497152 bytes 2021-11-21T03:58:48.146 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14800 IOs, 6521516032 bytes 2021-11-21T03:58:48.235 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14900 IOs, 6570355712 bytes 2021-11-21T03:58:48.302 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15000 IOs, 6595595264 bytes 2021-11-21T03:58:48.362 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15100 IOs, 6616370176 bytes 2021-11-21T03:58:48.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15200 IOs, 6632809472 bytes 2021-11-21T03:58:48.493 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15300 IOs, 6658118656 bytes 2021-11-21T03:58:48.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15400 IOs, 6698513408 bytes 2021-11-21T03:58:48.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15500 IOs, 6729784320 bytes 2021-11-21T03:58:48.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15600 IOs, 6781092864 bytes 2021-11-21T03:58:48.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15700 IOs, 6781728768 bytes 2021-11-21T03:58:48.916 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15800 IOs, 6854242304 bytes 2021-11-21T03:58:48.987 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15900 IOs, 6894330880 bytes 2021-11-21T03:58:49.120 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16000 IOs, 6975608832 bytes 2021-11-21T03:58:49.246 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16100 IOs, 7083367424 bytes 2021-11-21T03:58:49.347 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T03:58:49.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T03:58:49.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T03:58:49.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:58:49.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-21T03:58:49.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:58:49.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:49.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:49.350 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:58:49.350 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:58:49.350 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:58:49.350 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:58:49.350 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:58:50.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-21T03:58:50.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:58:50.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:50.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:50.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:58:50.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T03:58:50.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T03:58:50.350 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-21T03:58:50.350 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-21T03:58:50.350 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:58:50.351 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:58:50.351 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T03:58:50.351 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-21T03:58:50.351 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ tee /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:58:50.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:test: 2021-11-21T03:58:50.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: global_id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:58:50.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+replaying 2021-11-21T03:58:50.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: replaying, {"bytes_per_second":17880473.6,"bytes_per_snapshot":535682560.0,"local_snapshot_timestamp":1637467105,"remote_snapshot_timestamp":1637467105,"replay_state":"idle"} 2021-11-21T03:58:50.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: service: mirror.3 on gibba043 2021-11-21T03:58:50.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:58:41 2021-11-21T03:58:50.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: peer_sites: 2021-11-21T03:58:50.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: name: cluster2 2021-11-21T03:58:50.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+stopped 2021-11-21T03:58:50.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: local image is primary 2021-11-21T03:58:50.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:58:30 2021-11-21T03:58:50.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:58:50.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T03:58:50.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ description: .*' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:58:50.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":17880473.6,"bytes_per_snapshot":535682560.0,"local_snapshot_timestamp":1637467105,"remote_snapshot_timestamp":1637467105,"replay_state":"idle"} 2021-11-21T03:58:50.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T03:58:50.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:58:50.405 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^up+' 2021-11-21T03:58:50.405 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:58:50.406 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:58:50.406 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.3 on gibba043 2021-11-21T03:58:50.407 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T03:58:50.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'last_update=2021-11-21 03:58:41' 2021-11-21T03:58:50.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-21 03:58:41' 2021-11-21T03:58:50.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:58:50.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:50.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:50.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T03:58:50.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'prev_last_update=2021-11-21 03:58:41' 2021-11-21T03:58:50.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-21T03:58:50.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror.mirror_status 2021-11-21T03:58:50.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:58:50.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror.mirror_status 2021-11-21T03:58:50.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-21T03:58:50.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: failed to query services: (13) Permission denied 2021-11-21T03:58:50.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local last_update state 2021-11-21T03:58:50.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-21T03:58:50.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ last_update='2021-11-21 03:58:41' 2021-11-21T03:58:50.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-21T03:58:50.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ state=up+replaying 2021-11-21T03:58:50.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T03:58:50.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep up+replaying 2021-11-21T03:58:50.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T03:58:50.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:58:50.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:58:50.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap9 2021-11-21T03:58:50.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap9 2021-11-21T03:58:50.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:58:50.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:58:50.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:58:50.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap9 2021-11-21T03:58:50.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap9 --debug-rbd=20 --debug-journaler=20 2021-11-21T03:59:19.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-21T03:59:19.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:59:19.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:19.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:19.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-21T03:59:19.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:59:19.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:19.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:19.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state=started 2021-11-21T03:59:19.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:59:19.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:59:19.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:59:19.594 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.8037926147471325) > weight (0.25) 2021-11-21T03:59:19.594 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.9622040276227878) > weight (0.25) 2021-11-21T03:59:19.595 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.8292459466035184) > weight (0.25) 2021-11-21T03:59:19.595 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.3 2021-11-21T03:59:19.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Sent signal 15 2021-11-21T03:59:19.596 INFO:tasks.rbd_mirror_thrash:waiting for 8 secs before reviving daemons 2021-11-21T03:59:19.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.gibba043.stderr:2021-11-21T03:59:19.597+0000 7fe149c94700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.3 (PID: 31021) UID: 1000 2021-11-21T03:59:19.797 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.gibba043.stderr:daemon-helper: command failed with exit status 1 2021-11-21T03:59:20.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-21T03:59:20.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:59:20.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:20.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:20.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=started 2021-11-21T03:59:20.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_result 2021-11-21T03:59:20.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=stopped 2021-11-21T03:59:20.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-21T03:59:20.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_instance=cluster1 2021-11-21T03:59:20.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:20.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T03:59:20.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ grep -i state 2021-11-21T03:59:20.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance=cluster1 2021-11-21T03:59:20.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local loop_instance 2021-11-21T03:59:20.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:59:20.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 0 2021-11-21T03:59:20.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:59:20.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:59:20.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:20.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:59:20.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:59:20.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:20.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:20.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:59:20.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:59:20.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:20.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:20.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:20.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:59:20.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:20.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:20.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:20.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:59:20.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:20.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:59:20.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:59:20.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:20.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:20.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:59:20.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:59:20.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:20.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:20.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:20.546 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:20.546 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:20.546 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:20.546 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:20.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:59:20.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:59:20.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:59:20.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:20.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:20.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:20.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:59:20.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:20.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:20.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:20.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:20.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:59:20.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:59:20.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:20.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:20.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:59:20.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:59:20.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:20.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:20.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:20.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:59:20.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:20.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:20.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:20.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:59:20.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:20.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:59:20.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:59:20.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:20.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:20.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:59:20.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:59:20.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:20.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:20.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:20.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:20.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:20.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:20.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:20.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:59:20.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:59:20.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:59:20.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:20.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:20.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:20.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:59:20.675 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:20.675 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:20.675 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:20.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:20.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:59:20.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:59:20.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:20.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:20.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:59:20.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:59:20.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:20.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:20.681 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:20.681 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:59:20.681 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:59:20.681 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:20.681 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:20.682 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:59:20.682 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:59:20.682 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:59:20.682 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:59:20.683 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:20.683 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:20.683 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:59:20.683 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:59:20.683 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:20.684 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:20.684 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:20.684 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:59:20.684 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:59:20.685 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:20.685 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:20.685 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:59:20.685 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:59:20.685 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:59:20.688 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:20.688 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:20.688 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:20.689 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:59:20.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:20.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:20.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:20.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:20.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:59:20.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:59:20.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:20.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:20.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:59:20.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:59:20.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:20.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:20.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:20.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:59:20.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:59:20.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:20.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:20.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:59:20.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:59:20.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:59:20.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:59:20.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:20.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:20.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:59:20.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:59:20.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:20.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:20.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:20.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:59:20.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:59:20.756 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:20.756 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:20.756 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:59:20.756 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:59:20.756 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:59:20.757 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:20.757 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:20.758 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:20.758 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:59:20.806 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2021-11-21T03:59:20.807 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:59:20.808 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 1 2021-11-21T03:59:21.808 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:59:21.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:59:21.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:21.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:59:21.812 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:59:21.812 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:21.812 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:21.812 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:59:21.813 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:59:21.813 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:21.813 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:21.813 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:21.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:59:21.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:21.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:21.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:21.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:59:21.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:21.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:59:21.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:59:21.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:21.816 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:21.816 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:59:21.816 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:59:21.816 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:21.816 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:21.817 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:21.817 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:21.817 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:21.817 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:21.818 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:21.818 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:59:21.818 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:59:21.818 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:59:21.821 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:21.821 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:21.821 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:21.821 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:59:21.877 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:21.878 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:21.878 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:21.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:21.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:59:21.882 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:59:21.882 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:21.882 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:21.882 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:59:21.882 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:59:21.883 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:21.883 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:21.883 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:21.883 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:59:21.884 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:21.884 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:21.884 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:21.884 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:59:21.884 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:21.885 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:59:21.885 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:59:21.885 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:21.885 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:21.886 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:59:21.886 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:59:21.886 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:21.891 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:21.891 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:21.891 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:21.891 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:21.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:21.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:21.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:59:21.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:59:21.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:59:21.893 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:21.893 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:21.894 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:21.894 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:59:21.947 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:21.947 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:21.947 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:21.950 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:21.951 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:59:21.951 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:59:21.951 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:21.951 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:21.951 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:59:21.952 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:59:21.952 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:21.952 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:21.952 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:21.953 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:59:21.953 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:59:21.953 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:21.953 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:21.954 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:59:21.954 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:59:21.954 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:59:21.954 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:59:21.954 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:21.955 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:21.955 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:59:21.955 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:59:21.955 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:21.956 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:21.956 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:21.956 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:59:21.956 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:59:21.957 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:21.957 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:21.957 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:59:21.957 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:59:21.958 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:59:21.959 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:21.959 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:21.959 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:21.959 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:59:22.015 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:22.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:22.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:22.019 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:22.019 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:59:22.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:59:22.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:22.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:22.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:59:22.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:59:22.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:22.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:22.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:22.022 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:59:22.022 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:59:22.022 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:22.022 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:22.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:59:22.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:59:22.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:59:22.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:59:22.024 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:22.024 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:22.024 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:59:22.025 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:59:22.025 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:22.025 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:22.025 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:22.026 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:59:22.026 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:59:22.026 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:22.026 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:22.027 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:59:22.027 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:59:22.027 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:59:22.028 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:22.028 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:22.029 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:22.029 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:59:22.076 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2021-11-21T03:59:22.077 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:59:22.077 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 2 2021-11-21T03:59:24.078 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:59:24.079 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:59:24.082 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:24.082 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:59:24.082 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:59:24.083 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:24.083 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:24.083 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:59:24.083 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:59:24.084 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:24.084 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:24.084 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:24.084 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:59:24.084 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:24.085 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:24.085 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:24.085 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:59:24.085 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:24.086 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:59:24.086 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:59:24.086 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:24.086 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:24.086 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:59:24.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:59:24.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:24.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:24.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:24.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:24.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:24.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:24.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:24.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:59:24.089 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:59:24.089 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:59:24.091 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:24.092 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:24.092 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:24.092 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:59:24.147 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:24.148 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:24.149 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:24.154 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:24.155 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:59:24.156 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:59:24.156 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:24.156 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:24.157 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:59:24.157 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:59:24.158 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:24.158 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:24.158 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:24.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:59:24.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:24.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:24.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:24.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:59:24.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:24.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:59:24.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:59:24.161 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:24.161 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:24.161 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:59:24.161 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:59:24.162 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:24.162 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:24.162 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:24.162 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:24.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:24.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:24.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:24.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:59:24.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:59:24.164 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:59:24.165 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:24.166 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:24.166 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:24.166 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:59:24.217 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:24.217 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:24.218 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:24.221 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:24.221 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:59:24.221 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:59:24.221 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:24.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:24.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:59:24.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:59:24.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:24.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:24.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:24.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:59:24.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:59:24.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:24.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:24.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:59:24.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:59:24.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:59:24.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:59:24.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:24.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:24.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:59:24.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:59:24.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:24.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:24.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:24.227 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:59:24.227 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:59:24.227 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:24.227 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:24.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:59:24.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:59:24.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:59:24.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:24.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:24.231 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:24.231 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:59:24.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:24.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:24.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:24.289 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:24.289 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:59:24.289 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:59:24.289 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:24.290 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:24.290 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:59:24.290 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:59:24.290 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:24.291 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:24.291 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:24.291 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:59:24.291 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:59:24.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:24.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:24.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:59:24.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:59:24.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:59:24.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:59:24.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:24.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:24.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:59:24.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:59:24.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:24.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:24.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:24.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:59:24.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:59:24.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:24.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:24.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:59:24.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:59:24.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:59:24.298 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:24.298 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:24.298 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:24.299 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:59:24.347 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2021-11-21T03:59:24.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:59:24.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 4 2021-11-21T03:59:27.597 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.3 2021-11-21T03:59:27.598 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T03:59:27.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T03:59:27.599 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.3 2021-11-21T03:59:27.599 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Restarting daemon 2021-11-21T03:59:27.600 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.3 2021-11-21T03:59:27.604 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Started 2021-11-21T03:59:27.604 INFO:tasks.rbd_mirror_thrash:waiting for 118 secs before thrashing 2021-11-21T03:59:28.348 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:59:28.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:59:28.352 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:28.352 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:59:28.353 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:59:28.353 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:28.353 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:28.353 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:59:28.353 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:59:28.354 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:28.354 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:28.354 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:28.354 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:59:28.355 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:28.355 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:28.355 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:28.355 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:59:28.355 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:28.356 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:59:28.356 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:59:28.356 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:28.356 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:28.356 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:59:28.357 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:59:28.357 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:28.357 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:28.357 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:28.358 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:28.358 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:28.359 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:28.359 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:28.360 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:59:28.360 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:59:28.361 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:59:28.362 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:28.363 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:28.363 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:28.364 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:59:28.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:28.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:28.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:28.423 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:28.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:59:28.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:59:28.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:28.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:28.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:59:28.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:59:28.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:28.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:28.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:28.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:59:28.427 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:28.427 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:28.427 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:28.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:59:28.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:28.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:59:28.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:59:28.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:28.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:28.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:59:28.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:59:28.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:28.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:28.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:28.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:28.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:28.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:28.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:28.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:59:28.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:59:28.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:59:28.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:28.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:28.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:28.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:59:28.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:28.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:28.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:28.494 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:28.494 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:59:28.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:59:28.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:28.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:28.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:59:28.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:59:28.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:28.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:28.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:28.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:59:28.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:59:28.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:28.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:28.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:59:28.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:59:28.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:59:28.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:59:28.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:28.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:28.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:59:28.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:59:28.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:28.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:28.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:28.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:59:28.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:59:28.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:28.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:28.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:59:28.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:59:28.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:59:28.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:28.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:28.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:28.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:59:28.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:28.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:28.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:28.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:28.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:59:28.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:59:28.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:28.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:28.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:59:28.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:59:28.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:28.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:28.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:28.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:59:28.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:59:28.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:28.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:28.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:59:28.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:59:28.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:59:28.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:59:28.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:28.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:28.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:59:28.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:59:28.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:28.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:28.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:28.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:59:28.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:59:28.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:28.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:28.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:59:28.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:59:28.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:59:28.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:28.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:28.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:28.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:59:28.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:28.625 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:28.625 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:28.625 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:59:28.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 8 2021-11-21T03:59:36.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:59:36.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:59:36.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:36.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:59:36.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:59:36.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:36.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:36.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:59:36.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:59:36.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:36.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:36.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:36.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:59:36.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:36.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:36.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:36.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:59:36.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:36.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:59:36.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:59:36.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:36.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:36.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:59:36.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:59:36.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:36.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:36.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:36.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:36.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:36.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:36.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:36.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:59:36.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:59:36.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:59:36.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:36.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:36.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:36.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:59:36.696 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:36.696 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:36.697 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:36.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:36.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:59:36.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:59:36.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:36.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:36.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:59:36.706 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:59:36.706 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:36.706 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:36.707 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:36.707 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:59:36.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:36.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:36.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:36.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:59:36.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:36.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:59:36.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:59:36.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:36.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:36.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:59:36.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:59:36.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:36.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:36.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:36.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:36.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:36.715 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:36.715 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:36.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:59:36.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:59:36.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:59:36.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:36.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:36.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:36.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:59:36.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:36.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:36.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:36.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:36.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:59:36.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:59:36.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:36.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:36.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:59:36.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:59:36.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:36.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:36.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:36.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:59:36.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:59:36.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:36.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:36.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:59:36.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:59:36.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:59:36.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:59:36.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:36.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:36.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:59:36.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:59:36.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:36.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:36.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:36.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:59:36.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:59:36.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:36.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:36.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:59:36.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:59:36.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:59:36.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:36.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:36.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:36.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:59:36.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:36.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:36.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:36.838 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:36.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:59:36.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:59:36.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:36.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:36.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:59:36.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:59:36.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:36.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:36.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:36.841 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:59:36.841 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:59:36.841 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:36.841 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:36.842 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:59:36.842 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:59:36.842 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:59:36.842 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:59:36.842 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:36.843 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:36.843 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:59:36.843 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:59:36.843 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:36.843 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:36.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:36.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:59:36.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:59:36.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:36.845 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:36.845 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:59:36.845 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:59:36.845 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:59:36.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:36.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:36.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:36.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:59:36.907 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:36.907 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:36.908 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:36.908 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:59:36.908 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 8 2021-11-21T03:59:44.906 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:59:44.906 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:59:44.910 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:44.910 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:59:44.910 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:59:44.910 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:44.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:44.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:59:44.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:59:44.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:44.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:44.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:44.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:59:44.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:44.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:44.913 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:44.913 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:59:44.913 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:44.913 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:59:44.913 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:59:44.914 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:44.914 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:44.915 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:59:44.916 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:59:44.916 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:44.916 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:44.916 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:44.917 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:44.917 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:44.917 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:44.917 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:44.918 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:59:44.918 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:59:44.918 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:59:44.919 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:44.919 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:44.919 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:44.920 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:59:44.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:44.976 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:44.976 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:44.979 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:44.979 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:59:44.980 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:59:44.980 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:44.981 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:44.981 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:59:44.981 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:59:44.981 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:44.981 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:44.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:44.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:59:44.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:44.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:44.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:44.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:59:44.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:44.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:59:44.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:59:44.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:44.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:44.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:59:44.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:59:44.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:44.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:44.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:44.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:44.986 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:44.986 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:44.986 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:44.986 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:59:44.987 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:59:44.987 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:59:44.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:44.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:44.989 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:44.989 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:59:45.045 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:45.046 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:45.046 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:45.050 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:45.051 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-21T03:59:45.051 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:2 2021-11-21T03:59:45.052 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:45.052 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:45.053 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-21T03:59:45.053 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:2 2021-11-21T03:59:45.053 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:45.054 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:45.054 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:45.055 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=2 2021-11-21T03:59:45.055 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-21T03:59:45.055 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:45.056 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:45.056 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=2 2021-11-21T03:59:45.057 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:59:45.057 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-21T03:59:45.058 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:2 2021-11-21T03:59:45.058 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:45.058 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:45.059 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-21T03:59:45.059 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:2 2021-11-21T03:59:45.060 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:45.060 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:45.061 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:45.061 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=2 2021-11-21T03:59:45.061 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-21T03:59:45.061 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:45.061 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:45.062 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=2 2021-11-21T03:59:45.062 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=2 2021-11-21T03:59:45.062 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-21T03:59:45.063 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:45.063 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:45.064 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-21T03:59:45.064 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-21T03:59:45.114 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:45.115 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:45.115 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:45.118 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:45.118 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-21T03:59:45.118 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:3 2021-11-21T03:59:45.119 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:45.119 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:45.119 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-21T03:59:45.119 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:3 2021-11-21T03:59:45.119 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:45.120 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:45.120 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:45.120 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=3 2021-11-21T03:59:45.120 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-21T03:59:45.121 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:45.121 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:45.121 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=3 2021-11-21T03:59:45.121 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:59:45.121 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-21T03:59:45.122 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:3 2021-11-21T03:59:45.122 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:45.122 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:45.122 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-21T03:59:45.123 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:3 2021-11-21T03:59:45.123 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:45.123 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:45.123 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:45.124 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=3 2021-11-21T03:59:45.124 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-21T03:59:45.124 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:45.124 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:45.124 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=3 2021-11-21T03:59:45.125 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=3 2021-11-21T03:59:45.125 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-21T03:59:45.127 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:45.127 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:45.127 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-21T03:59:45.127 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-21T03:59:45.183 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:45.183 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:45.183 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:45.184 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T03:59:45.184 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 8 2021-11-21T03:59:53.184 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T03:59:53.185 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T03:59:53.188 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:53.188 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T03:59:53.188 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T03:59:53.189 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:53.189 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:53.189 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T03:59:53.189 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T03:59:53.189 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:53.190 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:53.190 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:53.190 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T03:59:53.190 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:53.191 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:53.191 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:53.191 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T03:59:53.191 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:53.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T03:59:53.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T03:59:53.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:53.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:53.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T03:59:53.193 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T03:59:53.193 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:53.193 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:53.193 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:53.194 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T03:59:53.194 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T03:59:53.194 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:53.194 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:53.194 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T03:59:53.195 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T03:59:53.195 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T03:59:53.203 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:53.203 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:53.203 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T03:59:53.203 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T03:59:53.254 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T03:59:53.254 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T03:59:53.255 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T03:59:53.257 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T03:59:53.257 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T03:59:53.258 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T03:59:53.258 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T03:59:53.258 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T03:59:53.259 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T03:59:53.259 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T03:59:53.259 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T03:59:53.259 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T03:59:53.260 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T03:59:53.260 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T03:59:53.260 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:53.260 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T03:59:53.260 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:53.261 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T03:59:53.261 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:53.261 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T03:59:53.261 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T03:59:53.261 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T03:59:53.262 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T03:59:53.262 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T03:59:53.262 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T03:59:53.262 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T03:59:53.263 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T03:59:53.263 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T03:59:53.263 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T03:59:53.263 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T03:59:53.263 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T03:59:53.264 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T03:59:53.264 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T03:59:53.264 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T03:59:53.264 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T03:59:53.266 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:53.266 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:53.267 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T03:59:53.267 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T03:59:53.328 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ return 0 2021-11-21T03:59:53.329 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ status_result=' "state": "Replaying"' 2021-11-21T03:59:53.329 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo ' "state": "Replaying"' 2021-11-21T03:59:53.329 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep -i Replaying 2021-11-21T03:59:53.330 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "state": "Replaying" 2021-11-21T03:59:53.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_state=started 2021-11-21T03:59:53.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test started = started 2021-11-21T03:59:53.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:59:53.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-21T03:59:53.333 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:59:53.334 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:59:53.334 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:53.334 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:53.334 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = journal ']' 2021-11-21T03:59:53.334 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = snapshot ']' 2021-11-21T03:59:53.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-21T03:59:53.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T03:59:53.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:59:53.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:53.336 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:53.336 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster2-mirror-test.status 2021-11-21T03:59:53.336 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster2-mirror-test.status 2021-11-21T03:59:53.336 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:59:53.336 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:59:53.337 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.status 2021-11-21T03:59:53.337 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.status 2021-11-21T03:59:53.337 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T03:59:53.337 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:59:53.338 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-21T03:59:53.338 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:59:53.338 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:53.338 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:53.338 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-21T03:59:53.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Snapshot ID: 38 2021-11-21T03:59:53.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:59:53.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T03:59:53.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:53.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:53.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T03:59:53.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-21T03:59:53.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:59:53.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-21T03:59:53.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snapshot_id=38 2021-11-21T03:59:53.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:59:53.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:59:53.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.2 2021-11-21T03:59:53.793 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:59:53.793 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:59:53.793 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:53.794 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:53.794 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:59:53.794 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:59:53.794 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:59:53.827 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:59:53.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:59:53.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:59:53.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:59:53.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:59:53.882 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:59:53.883 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 38 = '' 2021-11-21T03:59:53.883 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:59:53.884 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.4 2021-11-21T03:59:54.229 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:59:54.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:59:54.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:54.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:54.231 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:59:54.231 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:59:54.231 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:59:54.267 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:59:54.267 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:59:54.268 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:59:54.268 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:59:54.268 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:59:54.269 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:59:54.269 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 38 = '' 2021-11-21T03:59:54.269 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:59:54.269 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.8 2021-11-21T03:59:55.070 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:59:55.070 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:59:55.070 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:55.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:55.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:59:55.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:59:55.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:59:55.107 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T03:59:55.108 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:59:55.108 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T03:59:55.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T03:59:55.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T03:59:55.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T03:59:55.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 38 = '' 2021-11-21T03:59:55.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T03:59:55.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1.6 2021-11-21T03:59:56.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:59:56.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:59:56.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:56.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:56.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T03:59:56.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T03:59:56.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T03:59:56.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T03:59:56.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=38 2021-11-21T03:59:56.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 38 = 38 2021-11-21T03:59:56.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:59:56.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snap_present cluster1 mirror test snap9 2021-11-21T03:59:56.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T03:59:56.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:56.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:56.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap9 2021-11-21T03:59:56.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T03:59:56.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-21T03:59:56.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T03:59:57.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 info mirror/test@snap9 2021-11-21T03:59:57.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'test': 2021-11-21T03:59:57.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 512 MiB in 128 objects 2021-11-21T03:59:57.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T03:59:57.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 19 2021-11-21T03:59:57.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 10a2324c201b 2021-11-21T03:59:57.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.10a2324c201b 2021-11-21T03:59:57.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T03:59:57.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, operations, non-primary 2021-11-21T03:59:57.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: snap-trash 2021-11-21T03:59:57.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T03:59:57.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:59:57.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 03:58:32 2021 2021-11-21T03:59:57.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T03:59:57.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: protected: False 2021-11-21T03:59:57.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T03:59:57.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T03:59:57.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T03:59:57.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T03:59:57.789 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:59:57.789 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snap8-clean ']' 2021-11-21T03:59:57.789 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap8-clean 2021-11-21T03:59:57.790 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:57.790 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:57.790 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap8-clean 2021-11-21T03:59:57.790 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:59:57.791 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:59:57.791 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:59:57.791 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:59:57.791 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap8-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:59:58.239 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:59:58.241 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap8-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:59:58.935 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:59:58.938 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:59:59.064 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:59:59.161 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T03:59:59.162 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap9 2021-11-21T03:59:59.162 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T03:59:59.162 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T03:59:59.162 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap9 2021-11-21T03:59:59.162 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T03:59:59.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:59:59.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:59:59.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T03:59:59.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap9 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T03:59:59.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T03:59:59.629 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap9 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:00.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:00.291 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:00.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:00.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:00.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ clean_snap_name=snap9-clean 2021-11-21T04:00:00.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap9-clean 2021-11-21T04:00:00.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:00:00.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:00.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:00.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap9-clean 2021-11-21T04:00:00.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap9-clean --debug-rbd=20 --debug-journaler=20 2021-11-21T04:00:01.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:00:01.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror test 2021-11-21T04:00:01.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:00:01.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:01.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:01.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:00:01.546 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=5 2021-11-21T04:00:01.546 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:00:01.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 5s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-21T04:00:01.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 75583488 bytes 2021-11-21T04:00:01.866 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 105103360 bytes 2021-11-21T04:00:01.922 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 110930944 bytes 2021-11-21T04:00:01.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 131776512 bytes 2021-11-21T04:00:02.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 132391936 bytes 2021-11-21T04:00:02.067 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 133015552 bytes 2021-11-21T04:00:02.157 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 188336128 bytes 2021-11-21T04:00:02.242 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 235244544 bytes 2021-11-21T04:00:02.303 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 253081600 bytes 2021-11-21T04:00:02.371 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 276992000 bytes 2021-11-21T04:00:02.423 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 288047104 bytes 2021-11-21T04:00:02.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 377930752 bytes 2021-11-21T04:00:02.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 461173760 bytes 2021-11-21T04:00:02.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 512894976 bytes 2021-11-21T04:00:02.852 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 559153152 bytes 2021-11-21T04:00:02.919 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 581853184 bytes 2021-11-21T04:00:02.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 602563584 bytes 2021-11-21T04:00:03.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 667901952 bytes 2021-11-21T04:00:03.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 695425024 bytes 2021-11-21T04:00:03.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 714436608 bytes 2021-11-21T04:00:03.341 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 784821248 bytes 2021-11-21T04:00:03.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 828895232 bytes 2021-11-21T04:00:03.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 844495872 bytes 2021-11-21T04:00:03.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 871111680 bytes 2021-11-21T04:00:03.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 913075200 bytes 2021-11-21T04:00:03.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 982356992 bytes 2021-11-21T04:00:03.797 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1003554816 bytes 2021-11-21T04:00:03.888 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1055933440 bytes 2021-11-21T04:00:03.955 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1081025536 bytes 2021-11-21T04:00:04.000 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1085832192 bytes 2021-11-21T04:00:04.069 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1118058496 bytes 2021-11-21T04:00:04.143 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1157457920 bytes 2021-11-21T04:00:04.199 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1188556800 bytes 2021-11-21T04:00:04.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1226305536 bytes 2021-11-21T04:00:04.337 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1227266048 bytes 2021-11-21T04:00:04.413 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1273024512 bytes 2021-11-21T04:00:04.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1273621504 bytes 2021-11-21T04:00:04.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1274241024 bytes 2021-11-21T04:00:04.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1327661056 bytes 2021-11-21T04:00:04.696 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1374240768 bytes 2021-11-21T04:00:04.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1415963648 bytes 2021-11-21T04:00:04.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1433005056 bytes 2021-11-21T04:00:04.900 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1458273280 bytes 2021-11-21T04:00:04.954 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1469049856 bytes 2021-11-21T04:00:05.077 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1539677184 bytes 2021-11-21T04:00:05.240 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1672780800 bytes 2021-11-21T04:00:05.337 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1719333888 bytes 2021-11-21T04:00:05.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 1751497728 bytes 2021-11-21T04:00:05.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 1784138752 bytes 2021-11-21T04:00:05.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 1838449664 bytes 2021-11-21T04:00:05.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 1851022336 bytes 2021-11-21T04:00:05.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 1851638784 bytes 2021-11-21T04:00:05.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 1872040960 bytes 2021-11-21T04:00:05.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 1932891136 bytes 2021-11-21T04:00:05.929 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 1985217536 bytes 2021-11-21T04:00:06.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2032439296 bytes 2021-11-21T04:00:06.061 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2036220928 bytes 2021-11-21T04:00:06.121 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2065338368 bytes 2021-11-21T04:00:06.188 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2084258816 bytes 2021-11-21T04:00:06.270 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2142274560 bytes 2021-11-21T04:00:06.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2162504704 bytes 2021-11-21T04:00:06.413 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2185059328 bytes 2021-11-21T04:00:06.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2257684480 bytes 2021-11-21T04:00:06.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:00:06.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:00:06.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:00:06.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:06.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-21T04:00:06.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:06.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:06.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:06.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T04:00:06.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T04:00:06.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T04:00:06.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T04:00:06.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T04:00:07.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-21T04:00:07.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:07.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:07.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:07.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T04:00:07.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local description_pattern= 2021-11-21T04:00:07.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local service_pattern= 2021-11-21T04:00:07.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-21T04:00:07.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-21T04:00:07.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T04:00:07.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T04:00:07.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ CEPH_ARGS= 2021-11-21T04:00:07.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-21T04:00:07.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ tee /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T04:00:07.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:test: 2021-11-21T04:00:07.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: global_id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T04:00:07.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+replaying 2021-11-21T04:00:07.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637467105,"remote_snapshot_timestamp":1637467105,"replay_state":"idle"} 2021-11-21T04:00:07.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: service: mirror.1 on gibba043 2021-11-21T04:00:07.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 03:59:51 2021-11-21T04:00:07.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: peer_sites: 2021-11-21T04:00:07.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: name: cluster2 2021-11-21T04:00:07.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: state: up+stopped 2021-11-21T04:00:07.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: description: local image is primary 2021-11-21T04:00:07.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: last_update: 2021-11-21 04:00:00 2021-11-21T04:00:07.599 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T04:00:07.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T04:00:07.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^ description: .*' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T04:00:07.601 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637467105,"remote_snapshot_timestamp":1637467105,"replay_state":"idle"} 2021-11-21T04:00:07.601 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:00:07.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T04:00:07.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep '^up+' 2021-11-21T04:00:07.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T04:00:07.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T04:00:07.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.1 on gibba043 2021-11-21T04:00:07.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.mirror_status 2021-11-21T04:00:07.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'last_update=2021-11-21 03:59:51' 2021-11-21T04:00:07.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-21 03:59:51' 2021-11-21T04:00:07.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:07.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:07.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:07.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state_pattern=up+replaying 2021-11-21T04:00:07.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local 'prev_last_update=2021-11-21 03:59:51' 2021-11-21T04:00:07.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-21T04:00:07.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror.mirror_status 2021-11-21T04:00:07.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T04:00:07.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror.mirror_status 2021-11-21T04:00:07.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-21T04:00:07.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: failed to query services: (13) Permission denied 2021-11-21T04:00:07.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local last_update state 2021-11-21T04:00:07.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-21T04:00:07.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ last_update='2021-11-21 03:59:51' 2021-11-21T04:00:07.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-21T04:00:07.657 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ state=up+replaying 2021-11-21T04:00:07.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo up+replaying 2021-11-21T04:00:07.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep up+replaying 2021-11-21T04:00:07.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:up+replaying 2021-11-21T04:00:07.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:07.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:07.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap10 2021-11-21T04:00:07.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap10 2021-11-21T04:00:07.662 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:00:07.662 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:07.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:07.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap10 2021-11-21T04:00:07.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap10 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:00:14.502 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.7992385426852472) > weight (0.25) 2021-11-21T04:00:14.502 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.1 2021-11-21T04:00:14.503 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Sent signal 15 2021-11-21T04:00:14.503 INFO:tasks.rbd_mirror_thrash:waiting for 9 secs before reviving daemons 2021-11-21T04:00:14.504 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba043.stderr:2021-11-21T04:00:14.505+0000 7ff280006700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 36979) UID: 1000 2021-11-21T04:00:14.705 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba043.stderr:daemon-helper: command failed with exit status 1 2021-11-21T04:00:23.504 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.1 2021-11-21T04:00:23.505 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T04:00:23.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T04:00:23.505 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.1 2021-11-21T04:00:23.506 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2021-11-21T04:00:23.506 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2021-11-21T04:00:23.510 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2021-11-21T04:00:23.510 INFO:tasks.rbd_mirror_thrash:waiting for 96 secs before thrashing 2021-11-21T04:00:35.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-21T04:00:35.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:35.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:35.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:35.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-21T04:00:35.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:35.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:35.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:35.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state=started 2021-11-21T04:00:35.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T04:00:35.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T04:00:35.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T04:00:36.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-21T04:00:36.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:36.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:36.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:36.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=started 2021-11-21T04:00:36.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_result 2021-11-21T04:00:36.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=stopped 2021-11-21T04:00:36.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-21T04:00:36.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ grep -i state 2021-11-21T04:00:36.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_instance=cluster1 2021-11-21T04:00:36.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T04:00:36.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T04:00:36.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance=cluster1 2021-11-21T04:00:36.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local loop_instance 2021-11-21T04:00:36.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T04:00:36.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 0 2021-11-21T04:00:36.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T04:00:36.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T04:00:36.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T04:00:36.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T04:00:36.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T04:00:36.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T04:00:36.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T04:00:36.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T04:00:36.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T04:00:36.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T04:00:36.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T04:00:36.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T04:00:36.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T04:00:36.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T04:00:36.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T04:00:36.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T04:00:36.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T04:00:36.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T04:00:36.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T04:00:36.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T04:00:36.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T04:00:36.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T04:00:36.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T04:00:36.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T04:00:36.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T04:00:36.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T04:00:36.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T04:00:36.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T04:00:36.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T04:00:36.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T04:00:36.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T04:00:36.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T04:00:36.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T04:00:36.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T04:00:36.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T04:00:36.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T04:00:36.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T04:00:36.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T04:00:36.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T04:00:36.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T04:00:36.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T04:00:36.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T04:00:36.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T04:00:36.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T04:00:36.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T04:00:36.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T04:00:36.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T04:00:36.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T04:00:36.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T04:00:36.641 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T04:00:36.641 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T04:00:36.641 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T04:00:36.641 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T04:00:36.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T04:00:36.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T04:00:36.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T04:00:36.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T04:00:36.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T04:00:36.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T04:00:36.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T04:00:36.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T04:00:36.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T04:00:36.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T04:00:36.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T04:00:36.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T04:00:36.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T04:00:36.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T04:00:36.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T04:00:36.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T04:00:36.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T04:00:36.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T04:00:36.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T04:00:36.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T04:00:36.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T04:00:36.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T04:00:36.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T04:00:36.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T04:00:36.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ return 0 2021-11-21T04:00:36.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ status_result=' "state": "Replaying"' 2021-11-21T04:00:36.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo ' "state": "Replaying"' 2021-11-21T04:00:36.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep -i Replaying 2021-11-21T04:00:36.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "state": "Replaying" 2021-11-21T04:00:36.715 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_state=started 2021-11-21T04:00:36.715 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test started = started 2021-11-21T04:00:36.715 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:36.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-21T04:00:36.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T04:00:36.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:00:36.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:36.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:36.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = journal ']' 2021-11-21T04:00:36.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = snapshot ']' 2021-11-21T04:00:36.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-21T04:00:36.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T04:00:36.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:00:36.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:36.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:36.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster2-mirror-test.status 2021-11-21T04:00:36.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster2-mirror-test.status 2021-11-21T04:00:36.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T04:00:36.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T04:00:36.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.status 2021-11-21T04:00:36.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.status 2021-11-21T04:00:36.720 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T04:00:36.720 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:36.720 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-21T04:00:36.720 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:00:36.721 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:36.721 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:36.721 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-21T04:00:37.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Snapshot ID: 42 2021-11-21T04:00:37.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T04:00:37.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:00:37.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:37.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:37.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T04:00:37.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-21T04:00:37.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T04:00:37.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-21T04:00:37.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snapshot_id=42 2021-11-21T04:00:37.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T04:00:37.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T04:00:37.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.2 2021-11-21T04:00:37.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:37.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:37.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:37.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:37.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:37.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T04:00:37.816 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T04:00:37.852 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T04:00:37.854 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=38 2021-11-21T04:00:37.854 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 42 = 38 2021-11-21T04:00:37.854 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T04:00:37.854 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.4 2021-11-21T04:00:38.255 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:38.255 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:38.256 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:38.256 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:38.256 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:38.256 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T04:00:38.257 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T04:00:38.292 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T04:00:38.293 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=38 2021-11-21T04:00:38.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 42 = 38 2021-11-21T04:00:38.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T04:00:38.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.8 2021-11-21T04:00:39.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:39.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:39.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:39.096 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:39.096 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:39.096 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T04:00:39.096 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T04:00:39.133 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T04:00:39.134 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=38 2021-11-21T04:00:39.134 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 42 = 38 2021-11-21T04:00:39.134 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T04:00:39.134 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1.6 2021-11-21T04:00:40.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:40.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:40.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:40.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:40.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:40.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T04:00:40.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T04:00:40.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T04:00:40.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T04:00:40.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T04:00:40.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T04:00:40.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T04:00:40.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T04:00:40.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 42 = '' 2021-11-21T04:00:40.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T04:00:40.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 2 2021-11-21T04:00:42.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:42.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:42.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:42.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:42.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:42.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T04:00:42.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T04:00:42.808 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T04:00:42.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=42 2021-11-21T04:00:42.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 42 = 42 2021-11-21T04:00:42.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:42.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snap_present cluster1 mirror test snap10 2021-11-21T04:00:42.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:42.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:42.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:42.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap10 2021-11-21T04:00:42.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T04:00:42.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-21T04:00:42.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T04:00:43.810 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 info mirror/test@snap10 2021-11-21T04:00:43.846 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'test': 2021-11-21T04:00:43.846 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 512 MiB in 128 objects 2021-11-21T04:00:43.846 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T04:00:43.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 20 2021-11-21T04:00:43.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 10a2324c201b 2021-11-21T04:00:43.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.10a2324c201b 2021-11-21T04:00:43.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T04:00:43.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T04:00:43.848 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T04:00:43.848 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T04:00:43.848 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T04:00:43.848 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 03:59:58 2021 2021-11-21T04:00:43.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T04:00:43.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: protected: False 2021-11-21T04:00:43.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T04:00:43.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T04:00:43.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T04:00:43.850 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T04:00:43.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:43.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snap9-clean ']' 2021-11-21T04:00:43.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap9-clean 2021-11-21T04:00:43.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:43.858 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:43.858 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap9-clean 2021-11-21T04:00:43.858 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:00:43.858 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:43.859 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:43.859 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:43.859 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap9-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:44.302 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:44.305 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap9-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:44.929 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:44.932 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:45.059 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:45.153 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:45.153 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap10 2021-11-21T04:00:45.154 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:45.154 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:45.154 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap10 2021-11-21T04:00:45.154 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:00:45.155 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:45.155 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:45.155 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:45.155 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap10 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:45.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:45.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap10 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:46.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:46.182 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:46.309 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:46.406 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:46.407 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ clean_snap_name=snap10-clean 2021-11-21T04:00:46.407 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_snap cluster2 mirror test snap10-clean 2021-11-21T04:00:46.407 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:00:46.407 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:46.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:46.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap10-clean 2021-11-21T04:00:46.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap10-clean --debug-rbd=20 --debug-journaler=20 2021-11-21T04:00:47.382 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-21T04:00:47.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:47.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:47.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:47.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-21T04:00:47.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:47.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:47.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:47.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state=started 2021-11-21T04:00:47.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T04:00:47.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T04:00:47.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T04:00:48.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-21T04:00:48.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:48.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:48.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:48.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=started 2021-11-21T04:00:48.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_result 2021-11-21T04:00:48.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=stopped 2021-11-21T04:00:48.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-21T04:00:48.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_instance=cluster1 2021-11-21T04:00:48.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T04:00:48.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ grep -i state 2021-11-21T04:00:48.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T04:00:48.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance=cluster1 2021-11-21T04:00:48.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local loop_instance 2021-11-21T04:00:48.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-21T04:00:48.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sleep 0 2021-11-21T04:00:48.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-21T04:00:48.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ seq 0 3 2021-11-21T04:00:48.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T04:00:48.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-21T04:00:48.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:0 2021-11-21T04:00:48.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T04:00:48.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T04:00:48.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-21T04:00:48.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:0 2021-11-21T04:00:48.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T04:00:48.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T04:00:48.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T04:00:48.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=0 2021-11-21T04:00:48.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-21T04:00:48.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T04:00:48.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T04:00:48.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=0 2021-11-21T04:00:48.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T04:00:48.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-21T04:00:48.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:0 2021-11-21T04:00:48.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T04:00:48.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T04:00:48.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-21T04:00:48.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:0 2021-11-21T04:00:48.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T04:00:48.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T04:00:48.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T04:00:48.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=0 2021-11-21T04:00:48.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-21T04:00:48.398 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T04:00:48.398 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T04:00:48.398 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=0 2021-11-21T04:00:48.398 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=0 2021-11-21T04:00:48.399 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-21T04:00:48.399 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T04:00:48.400 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T04:00:48.400 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-21T04:00:48.400 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-21T04:00:48.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-21T04:00:48.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd mirror status : get status for rbd mirror 2021-11-21T04:00:48.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:admin_socket: invalid command 2021-11-21T04:00:48.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-21T04:00:48.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-21T04:00:48.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1:1 2021-11-21T04:00:48.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ shift 2021-11-21T04:00:48.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance 2021-11-21T04:00:48.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-21T04:00:48.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local val=cluster1:1 2021-11-21T04:00:48.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster_var_name=cluster 2021-11-21T04:00:48.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local instance_var_name=instance 2021-11-21T04:00:48.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cluster=cluster1 2021-11-21T04:00:48.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ instance=1 2021-11-21T04:00:48.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-21T04:00:48.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval cluster=cluster1 2021-11-21T04:00:48.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T04:00:48.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ eval instance=1 2021-11-21T04:00:48.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T04:00:48.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-21T04:00:48.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local local_cluster=cluster1:1 2021-11-21T04:00:48.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster=cluster1 2021-11-21T04:00:48.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance 2021-11-21T04:00:48.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-21T04:00:48.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local val=cluster1:1 2021-11-21T04:00:48.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local cluster_var_name=local_cluster 2021-11-21T04:00:48.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ local instance_var_name=instance 2021-11-21T04:00:48.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ cluster=cluster1 2021-11-21T04:00:48.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ instance=1 2021-11-21T04:00:48.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-21T04:00:48.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval local_cluster=cluster1 2021-11-21T04:00:48.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ local_cluster=cluster1 2021-11-21T04:00:48.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ eval instance=1 2021-11-21T04:00:48.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ instance=1 2021-11-21T04:00:48.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-21T04:00:48.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T04:00:48.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T04:00:48.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-21T04:00:48.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-21T04:00:48.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ return 0 2021-11-21T04:00:48.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ status_result=' "state": "Replaying"' 2021-11-21T04:00:48.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo ' "state": "Replaying"' 2021-11-21T04:00:48.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ grep -i Replaying 2021-11-21T04:00:48.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "state": "Replaying" 2021-11-21T04:00:48.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_state=started 2021-11-21T04:00:48.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test started = started 2021-11-21T04:00:48.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:48.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-21T04:00:48.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T04:00:48.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:00:48.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:48.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:48.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = journal ']' 2021-11-21T04:00:48.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' snapshot = snapshot ']' 2021-11-21T04:00:48.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-21T04:00:48.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_cluster=cluster1 2021-11-21T04:00:48.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:00:48.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:48.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:48.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster2-mirror-test.status 2021-11-21T04:00:48.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster2-mirror-test.status 2021-11-21T04:00:48.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T04:00:48.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local status_log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T04:00:48.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ mkfname cluster1-mirror-test.status 2021-11-21T04:00:48.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo cluster1-mirror-test.status 2021-11-21T04:00:48.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-21T04:00:48.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local local_status_log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:48.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-21T04:00:48.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:00:48.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:48.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:48.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-21T04:00:49.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Snapshot ID: 45 2021-11-21T04:00:49.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T04:00:49.389 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:00:49.389 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:49.389 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:49.389 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.status 2021-11-21T04:00:49.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-21T04:00:49.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T04:00:49.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-21T04:00:49.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snapshot_id=45 2021-11-21T04:00:49.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T04:00:49.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T04:00:49.427 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.2 2021-11-21T04:00:49.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:49.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:49.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:49.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:49.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:49.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T04:00:49.629 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T04:00:49.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T04:00:49.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T04:00:49.664 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T04:00:49.664 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T04:00:49.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T04:00:49.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T04:00:49.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 45 = '' 2021-11-21T04:00:49.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T04:00:49.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.4 2021-11-21T04:00:50.065 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:50.066 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:50.066 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:50.066 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:50.066 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:50.067 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T04:00:50.067 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T04:00:50.100 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ true 2021-11-21T04:00:50.101 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T04:00:50.102 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:-:1.1: Document is empty 2021-11-21T04:00:50.102 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: 2021-11-21T04:00:50.102 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:^ 2021-11-21T04:00:50.102 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id= 2021-11-21T04:00:50.103 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 45 = '' 2021-11-21T04:00:50.103 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-21T04:00:50.103 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.8 2021-11-21T04:00:50.903 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:50.904 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:50.904 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:50.904 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:50.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local log=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.status 2021-11-21T04:00:50.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-21T04:00:50.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-21T04:00:50.941 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-21T04:00:50.943 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local primary_snapshot_id=45 2021-11-21T04:00:50.943 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test 45 = 45 2021-11-21T04:00:50.944 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:50.944 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_snap_present cluster1 mirror test snap10-clean 2021-11-21T04:00:50.944 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:00:50.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:50.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:50.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap10-clean 2021-11-21T04:00:50.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T04:00:50.946 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-21T04:00:50.946 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T04:00:51.943 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 info mirror/test@snap10-clean 2021-11-21T04:00:51.981 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'test': 2021-11-21T04:00:51.981 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 512 MiB in 128 objects 2021-11-21T04:00:51.981 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T04:00:51.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 21 2021-11-21T04:00:51.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 10a2324c201b 2021-11-21T04:00:51.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.10a2324c201b 2021-11-21T04:00:51.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T04:00:51.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T04:00:51.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T04:00:51.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T04:00:51.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T04:00:51.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 03:59:58 2021 2021-11-21T04:00:51.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 03:51:14 2021 2021-11-21T04:00:51.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: protected: False 2021-11-21T04:00:51.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T04:00:51.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T04:00:51.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T04:00:51.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T04:00:51.987 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:51.987 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ seq 1 10 2021-11-21T04:00:51.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:00:51.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap1 2021-11-21T04:00:51.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap1 2021-11-21T04:00:51.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:51.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:51.989 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap1 2021-11-21T04:00:51.989 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:00:51.989 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:51.989 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:51.990 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:51.990 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap1 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:52.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:52.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap1 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:53.007 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:53.009 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:53.138 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:53.235 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:53.236 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap1-clean 2021-11-21T04:00:53.236 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap1-clean 2021-11-21T04:00:53.236 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:53.236 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:53.237 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap1-clean 2021-11-21T04:00:53.237 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:00:53.237 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:53.237 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:53.238 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:53.238 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap1-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:53.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:53.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap1-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:54.277 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:54.279 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:54.407 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:54.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:54.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:00:54.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap2 2021-11-21T04:00:54.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap2 2021-11-21T04:00:54.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:54.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:54.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap2 2021-11-21T04:00:54.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:00:54.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:54.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:54.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:54.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap2 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:54.957 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:54.959 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap2 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:55.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:55.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:55.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:55.838 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:55.838 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap2-clean 2021-11-21T04:00:55.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap2-clean 2021-11-21T04:00:55.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:55.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:55.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap2-clean 2021-11-21T04:00:55.839 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:00:55.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:55.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:55.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:55.840 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap2-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:56.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:56.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap2-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:56.842 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:56.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:56.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:57.070 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:57.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:00:57.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap3 2021-11-21T04:00:57.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap3 2021-11-21T04:00:57.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:57.072 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:57.072 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap3 2021-11-21T04:00:57.072 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:00:57.072 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:57.073 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:57.073 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:57.073 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap3 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:57.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:57.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap3 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:58.150 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:58.153 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:58.280 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:58.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:58.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap3-clean 2021-11-21T04:00:58.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap3-clean 2021-11-21T04:00:58.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:58.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:58.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap3-clean 2021-11-21T04:00:58.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:00:58.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:58.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:58.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:58.381 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap3-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:58.822 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:58.825 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap3-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:59.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:00:59.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:59.674 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:59.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:00:59.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:00:59.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap4 2021-11-21T04:00:59.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap4 2021-11-21T04:00:59.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:00:59.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:00:59.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap4 2021-11-21T04:00:59.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:00:59.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:00:59.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:59.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:00:59.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap4 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:00.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:00.229 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap4 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:00.993 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:00.995 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:01.123 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:01.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:01.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap4-clean 2021-11-21T04:01:01.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap4-clean 2021-11-21T04:01:01.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:01.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:01.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap4-clean 2021-11-21T04:01:01.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:01:01.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:01.225 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:01.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:01.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap4-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:01.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:01.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap4-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:02.213 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:02.215 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:02.342 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:02.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:02.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:02.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap5 2021-11-21T04:01:02.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap5 2021-11-21T04:01:02.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:02.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:02.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap5 2021-11-21T04:01:02.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:01:02.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:02.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:02.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:02.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap5 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:02.908 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:02.910 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap5 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:03.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:03.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:03.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:03.803 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:03.803 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap5-clean 2021-11-21T04:01:03.803 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap5-clean 2021-11-21T04:01:03.803 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:03.804 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:03.804 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap5-clean 2021-11-21T04:01:03.804 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:01:03.804 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:03.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:03.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:03.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap5-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:04.265 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:04.268 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap5-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:04.861 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:04.864 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:04.994 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:05.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:05.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:05.096 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap6 2021-11-21T04:01:05.096 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap6 2021-11-21T04:01:05.097 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:05.097 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:05.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap6 2021-11-21T04:01:05.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:01:05.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:05.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:05.100 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:05.100 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap6 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:05.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:05.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap6 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:06.218 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:06.221 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:06.353 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:06.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:06.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap6-clean 2021-11-21T04:01:06.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap6-clean 2021-11-21T04:01:06.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:06.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:06.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap6-clean 2021-11-21T04:01:06.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:01:06.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:06.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:06.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:06.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap6-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:06.914 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:06.914 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap6-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:07.492 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:07.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:07.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:07.726 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:07.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:07.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap7 2021-11-21T04:01:07.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap7 2021-11-21T04:01:07.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:07.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:07.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap7 2021-11-21T04:01:07.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:01:07.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:07.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:07.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:07.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap7 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:08.177 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:08.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap7 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:08.944 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:08.946 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:09.074 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:09.172 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:09.172 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap7-clean 2021-11-21T04:01:09.172 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap7-clean 2021-11-21T04:01:09.173 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:09.173 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:09.173 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap7-clean 2021-11-21T04:01:09.173 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:01:09.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:09.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:09.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:09.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap7-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:09.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:09.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap7-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:10.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:10.400 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:10.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:10.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:10.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:10.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap8 2021-11-21T04:01:10.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap8 2021-11-21T04:01:10.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:10.660 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:10.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap8 2021-11-21T04:01:10.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:01:10.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:10.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:10.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:10.662 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap8 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:11.090 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:11.093 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap8 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:11.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:11.990 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:12.125 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:12.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:12.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap8-clean 2021-11-21T04:01:12.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap8-clean 2021-11-21T04:01:12.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:12.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:12.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap8-clean 2021-11-21T04:01:12.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:01:12.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:12.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:12.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:12.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap8-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:12.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:12.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap8-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:13.234 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:13.236 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:13.367 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:13.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:13.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:13.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap9 2021-11-21T04:01:13.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap9 2021-11-21T04:01:13.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:13.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:13.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap9 2021-11-21T04:01:13.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:01:13.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:13.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:13.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:13.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap9 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:13.915 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:13.918 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap9 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:14.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:14.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:14.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:14.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:14.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap9-clean 2021-11-21T04:01:14.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap9-clean 2021-11-21T04:01:14.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:14.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:14.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap9-clean 2021-11-21T04:01:14.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:01:14.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:14.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:14.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:14.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap9-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:15.198 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:15.202 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap9-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:15.759 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:15.761 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:15.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:15.991 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:15.991 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:15.991 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap10 2021-11-21T04:01:15.991 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap10 2021-11-21T04:01:15.992 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:15.992 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:15.992 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap10 2021-11-21T04:01:15.992 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:01:15.993 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:15.993 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:15.993 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:15.993 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap10 /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:16.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:16.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap10 /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:17.085 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:17.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:17.219 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:17.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:17.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap10-clean 2021-11-21T04:01:17.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ compare_image_snaps mirror test snap10-clean 2021-11-21T04:01:17.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:17.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:17.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap_name=snap10-clean 2021-11-21T04:01:17.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local ret=0 2021-11-21T04:01:17.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local rmt_export=/tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:17.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local loc_export=/tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:17.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:17.320 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 -p mirror export test@snap10-clean /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export 2021-11-21T04:01:17.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:17.788 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster1 -p mirror export test@snap10-clean /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:18.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-21T04:01:18.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ cmp /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:18.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rm -f /tmp/tmp.5VD92ZyI1X/cluster2-mirror-test.export /tmp/tmp.5VD92ZyI1X/cluster1-mirror-test.export 2021-11-21T04:01:18.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:18.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ seq 1 10 2021-11-21T04:01:18.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:18.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap1 2021-11-21T04:01:18.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap1 2021-11-21T04:01:18.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:18.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:18.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:18.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap1 2021-11-21T04:01:18.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap1 2021-11-21T04:01:19.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:19.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap1-clean 2021-11-21T04:01:19.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap1-clean 2021-11-21T04:01:19.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:19.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:19.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:19.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap1-clean 2021-11-21T04:01:19.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap1-clean 2021-11-21T04:01:20.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:20.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:20.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap2 2021-11-21T04:01:20.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap2 2021-11-21T04:01:20.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:20.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:20.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:20.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap2 2021-11-21T04:01:20.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap2 2021-11-21T04:01:21.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:21.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap2-clean 2021-11-21T04:01:21.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap2-clean 2021-11-21T04:01:21.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:21.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:21.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:21.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap2-clean 2021-11-21T04:01:21.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap2-clean 2021-11-21T04:01:22.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:22.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:22.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap3 2021-11-21T04:01:22.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap3 2021-11-21T04:01:22.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:22.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:22.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:22.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap3 2021-11-21T04:01:22.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap3 2021-11-21T04:01:23.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:23.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap3-clean 2021-11-21T04:01:23.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap3-clean 2021-11-21T04:01:23.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:23.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:23.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:23.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap3-clean 2021-11-21T04:01:23.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap3-clean 2021-11-21T04:01:24.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:24.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:24.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap4 2021-11-21T04:01:24.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap4 2021-11-21T04:01:24.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:24.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:24.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:24.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap4 2021-11-21T04:01:24.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap4 2021-11-21T04:01:25.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:25.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap4-clean 2021-11-21T04:01:25.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap4-clean 2021-11-21T04:01:25.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:25.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:25.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:25.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap4-clean 2021-11-21T04:01:25.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap4-clean 2021-11-21T04:01:25.605 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.6091994802384705) > weight (0.25) 2021-11-21T04:01:25.606 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.724289158157611) > weight (0.25) 2021-11-21T04:01:25.606 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.5744371713859628) > weight (0.25) 2021-11-21T04:01:25.606 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.3 with skip (0.9568050967620154) > weight (0.25) 2021-11-21T04:01:25.606 INFO:tasks.rbd_mirror_thrash:waiting for 109 secs before thrashing 2021-11-21T04:01:26.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:26.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:26.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap5 2021-11-21T04:01:26.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap5 2021-11-21T04:01:26.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:26.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:26.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:26.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap5 2021-11-21T04:01:26.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap5 2021-11-21T04:01:27.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:27.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap5-clean 2021-11-21T04:01:27.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap5-clean 2021-11-21T04:01:27.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:27.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:27.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:27.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap5-clean 2021-11-21T04:01:27.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap5-clean 2021-11-21T04:01:28.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:28.389 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:28.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap6 2021-11-21T04:01:28.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap6 2021-11-21T04:01:28.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:28.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:28.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:28.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap6 2021-11-21T04:01:28.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap6 2021-11-21T04:01:29.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:29.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap6-clean 2021-11-21T04:01:29.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap6-clean 2021-11-21T04:01:29.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:29.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:29.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:29.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap6-clean 2021-11-21T04:01:29.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap6-clean 2021-11-21T04:01:30.382 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:30.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:30.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap7 2021-11-21T04:01:30.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap7 2021-11-21T04:01:30.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:30.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:30.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:30.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap7 2021-11-21T04:01:30.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap7 2021-11-21T04:01:31.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:31.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap7-clean 2021-11-21T04:01:31.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap7-clean 2021-11-21T04:01:31.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:31.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:31.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:31.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap7-clean 2021-11-21T04:01:31.398 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap7-clean 2021-11-21T04:01:32.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:32.400 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:32.400 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap8 2021-11-21T04:01:32.400 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap8 2021-11-21T04:01:32.400 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:32.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:32.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:32.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap8 2021-11-21T04:01:32.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap8 2021-11-21T04:01:33.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:33.400 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap8-clean 2021-11-21T04:01:33.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap8-clean 2021-11-21T04:01:33.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:33.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:33.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:33.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap8-clean 2021-11-21T04:01:33.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap8-clean 2021-11-21T04:01:34.398 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:34.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:34.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap9 2021-11-21T04:01:34.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap9 2021-11-21T04:01:34.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:34.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:34.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:34.405 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap9 2021-11-21T04:01:34.405 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap9 2021-11-21T04:01:35.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:35.382 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap9-clean 2021-11-21T04:01:35.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap9-clean 2021-11-21T04:01:35.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:35.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:35.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:35.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap9-clean 2021-11-21T04:01:35.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap9-clean 2021-11-21T04:01:36.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:36.423 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 10` 2021-11-21T04:01:36.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap10 2021-11-21T04:01:36.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap10 2021-11-21T04:01:36.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:36.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:36.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:36.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap10 2021-11-21T04:01:36.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap10 2021-11-21T04:01:37.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:37.407 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap10-clean 2021-11-21T04:01:37.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_snapshot cluster2 mirror test snap10-clean 2021-11-21T04:01:37.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:37.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:37.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:37.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local snap=snap10-clean 2021-11-21T04:01:37.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap10-clean 2021-11-21T04:01:38.404 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing snap: 100% complete...done. 2021-11-21T04:01:38.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_image_retry cluster2 mirror test 2021-11-21T04:01:38.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:38.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:38.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:38.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0 1 2 4 8 16 32 2021-11-21T04:01:38.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0 2021-11-21T04:01:38.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ remove_image cluster2 mirror test 2021-11-21T04:01:38.412 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:38.412 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:38.412 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:38.412 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 snap purge mirror/test 2021-11-21T04:01:38.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 rm mirror/test 2021-11-21T04:01:39.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2021-11-21T04:01:39.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:39.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ wait_for_image_present cluster1 mirror test deleted 2021-11-21T04:01:39.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:01:39.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:39.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:39.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local state=deleted 2021-11-21T04:01:39.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image_id= 2021-11-21T04:01:39.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local s 2021-11-21T04:01:39.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test -n '' 2021-11-21T04:01:39.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ get_image_id cluster1 mirror test 2021-11-21T04:01:39.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T04:01:39.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local pool=mirror 2021-11-21T04:01:39.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local image=test 2021-11-21T04:01:39.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster=cluster1 info mirror/test 2021-11-21T04:01:39.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -ne 's/^.*block_name_prefix: rbd_data\.//p' 2021-11-21T04:01:39.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image_id=10a2324c201b 2021-11-21T04:01:39.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.1 1 2 4 8 8 8 8 8 8 8 8 16 16 32 32 2021-11-21T04:01:39.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 0.1 2021-11-21T04:01:39.674 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_present cluster1 mirror test deleted 10a2324c201b 2021-11-21T04:01:39.674 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:01:39.674 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:39.675 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:39.675 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=deleted 2021-11-21T04:01:39.675 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image_id=10a2324c201b 2021-11-21T04:01:39.675 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=deleted 2021-11-21T04:01:39.676 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_image_id 2021-11-21T04:01:39.676 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ get_image_id cluster1 mirror test 2021-11-21T04:01:39.676 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T04:01:39.676 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local pool=mirror 2021-11-21T04:01:39.677 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local image=test 2021-11-21T04:01:39.677 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster=cluster1 info mirror/test 2021-11-21T04:01:39.677 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -ne 's/^.*block_name_prefix: rbd_data\.//p' 2021-11-21T04:01:39.707 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_image_id=10a2324c201b 2021-11-21T04:01:39.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test -n 10a2324c201b 2021-11-21T04:01:39.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test -z 10a2324c201b -o 10a2324c201b = 10a2324c201b 2021-11-21T04:01:39.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_state=present 2021-11-21T04:01:39.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test deleted = present 2021-11-21T04:01:39.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for s in 0.1 1 2 4 8 8 8 8 8 8 8 8 16 16 32 32 2021-11-21T04:01:39.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ sleep 1 2021-11-21T04:01:40.708 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test_image_present cluster1 mirror test deleted 10a2324c201b 2021-11-21T04:01:40.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster1 2021-11-21T04:01:40.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:40.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=test 2021-11-21T04:01:40.709 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local test_state=deleted 2021-11-21T04:01:40.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image_id=10a2324c201b 2021-11-21T04:01:40.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_state=deleted 2021-11-21T04:01:40.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local current_image_id 2021-11-21T04:01:40.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ get_image_id cluster1 mirror test 2021-11-21T04:01:40.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster=cluster1 2021-11-21T04:01:40.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local pool=mirror 2021-11-21T04:01:40.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local image=test 2021-11-21T04:01:40.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster=cluster1 info mirror/test 2021-11-21T04:01:40.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ sed -ne 's/^.*block_name_prefix: rbd_data\.//p' 2021-11-21T04:01:40.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: error opening image test: (2) No such file or directory 2021-11-21T04:01:40.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ current_image_id= 2021-11-21T04:01:40.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test -n '' 2021-11-21T04:01:40.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ test deleted = deleted 2021-11-21T04:01:40.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:40.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ testlog 'TEST: create many images' 2021-11-21T04:01:40.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ tee -a /tmp/tmp.5VD92ZyI1X/rbd-mirror.test.log 2021-11-21T04:01:40.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ date '+%F %T' 2021-11-21T04:01:40.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ echo 2021-11-21 04:01:40 TEST: create many images 2021-11-21T04:01:40.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:2021-11-21 04:01:40 TEST: create many images 2021-11-21T04:01:40.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ snap_name=snap 2021-11-21T04:01:40.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ seq 1 50 2021-11-21T04:01:40.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:01:40.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_1 2021-11-21T04:01:40.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_1 snapshot 128M 2021-11-21T04:01:40.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:40.744 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:40.744 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:40.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:40.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_1 2021-11-21T04:01:40.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:40.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:01:40.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:01:40.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:40.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_1 128M 2021-11-21T04:01:40.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:40.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:40.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:40.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:40.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_1 2021-11-21T04:01:40.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:40.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:01:40.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:01:40.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:01:40.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:40.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_1 2021-11-21T04:01:40.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:01:40.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_1 snapshot 2021-11-21T04:01:40.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:40.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:40.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_1 2021-11-21T04:01:40.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:01:40.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_1 snapshot 2021-11-21T04:01:41.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:01:41.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:01:41.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_1 2021-11-21T04:01:41.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:41.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:41.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_1 2021-11-21T04:01:41.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:01:41.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=11 2021-11-21T04:01:41.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:01:41.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 11s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_1 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:01:41.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 22236160 bytes 2021-11-21T04:01:41.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 71421952 bytes 2021-11-21T04:01:41.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 139417600 bytes 2021-11-21T04:01:41.827 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 184289280 bytes 2021-11-21T04:01:41.899 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 222039040 bytes 2021-11-21T04:01:42.000 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 286000128 bytes 2021-11-21T04:01:42.072 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 325084160 bytes 2021-11-21T04:01:42.151 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 371827712 bytes 2021-11-21T04:01:42.289 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 462958592 bytes 2021-11-21T04:01:42.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 484732928 bytes 2021-11-21T04:01:42.389 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 485351424 bytes 2021-11-21T04:01:42.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 534796288 bytes 2021-11-21T04:01:42.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 601097216 bytes 2021-11-21T04:01:42.671 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 651702272 bytes 2021-11-21T04:01:42.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 674291712 bytes 2021-11-21T04:01:42.869 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 791398400 bytes 2021-11-21T04:01:42.964 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 842086400 bytes 2021-11-21T04:01:43.054 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 895108096 bytes 2021-11-21T04:01:43.094 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 898846720 bytes 2021-11-21T04:01:43.144 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 914637824 bytes 2021-11-21T04:01:43.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 964549632 bytes 2021-11-21T04:01:43.307 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 1011378176 bytes 2021-11-21T04:01:43.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1077968896 bytes 2021-11-21T04:01:43.492 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1139524608 bytes 2021-11-21T04:01:43.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1200161792 bytes 2021-11-21T04:01:43.676 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1234385920 bytes 2021-11-21T04:01:43.738 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1257093120 bytes 2021-11-21T04:01:43.800 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1285104640 bytes 2021-11-21T04:01:43.853 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1299290112 bytes 2021-11-21T04:01:43.981 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1391852544 bytes 2021-11-21T04:01:44.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1394488320 bytes 2021-11-21T04:01:44.138 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1468587008 bytes 2021-11-21T04:01:44.202 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1510615040 bytes 2021-11-21T04:01:44.306 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1574355968 bytes 2021-11-21T04:01:44.345 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1574980608 bytes 2021-11-21T04:01:44.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1614966784 bytes 2021-11-21T04:01:44.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1619601408 bytes 2021-11-21T04:01:44.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1694790656 bytes 2021-11-21T04:01:44.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1730299904 bytes 2021-11-21T04:01:44.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1806643200 bytes 2021-11-21T04:01:44.829 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1831177216 bytes 2021-11-21T04:01:44.890 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1882930176 bytes 2021-11-21T04:01:44.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1915664384 bytes 2021-11-21T04:01:45.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1916286976 bytes 2021-11-21T04:01:45.070 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1928439808 bytes 2021-11-21T04:01:45.120 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1941652480 bytes 2021-11-21T04:01:45.187 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1976833024 bytes 2021-11-21T04:01:45.264 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 2016551936 bytes 2021-11-21T04:01:45.328 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2040774656 bytes 2021-11-21T04:01:45.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2056650752 bytes 2021-11-21T04:01:45.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2132580352 bytes 2021-11-21T04:01:45.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2150517760 bytes 2021-11-21T04:01:45.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2166173696 bytes 2021-11-21T04:01:45.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2192583680 bytes 2021-11-21T04:01:45.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2285057024 bytes 2021-11-21T04:01:45.862 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2330319872 bytes 2021-11-21T04:01:45.922 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2353620992 bytes 2021-11-21T04:01:46.003 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2387707904 bytes 2021-11-21T04:01:46.085 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2450899968 bytes 2021-11-21T04:01:46.153 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2465388544 bytes 2021-11-21T04:01:46.253 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2528784384 bytes 2021-11-21T04:01:46.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2581458944 bytes 2021-11-21T04:01:46.388 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2601140224 bytes 2021-11-21T04:01:46.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2650356736 bytes 2021-11-21T04:01:46.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2693184512 bytes 2021-11-21T04:01:46.676 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2771153920 bytes 2021-11-21T04:01:46.725 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2785200128 bytes 2021-11-21T04:01:46.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2800802816 bytes 2021-11-21T04:01:46.915 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2895754240 bytes 2021-11-21T04:01:47.006 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2951513088 bytes 2021-11-21T04:01:47.101 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 3016724480 bytes 2021-11-21T04:01:47.214 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 3093997568 bytes 2021-11-21T04:01:47.294 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3137154048 bytes 2021-11-21T04:01:47.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3198909440 bytes 2021-11-21T04:01:47.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3229430784 bytes 2021-11-21T04:01:47.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3282053120 bytes 2021-11-21T04:01:47.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3293375488 bytes 2021-11-21T04:01:47.667 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3326128128 bytes 2021-11-21T04:01:47.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3340801024 bytes 2021-11-21T04:01:47.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3377047552 bytes 2021-11-21T04:01:47.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3393721344 bytes 2021-11-21T04:01:47.900 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3412503552 bytes 2021-11-21T04:01:47.977 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3454218240 bytes 2021-11-21T04:01:48.026 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3462554624 bytes 2021-11-21T04:01:48.135 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3533191168 bytes 2021-11-21T04:01:48.189 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3548380160 bytes 2021-11-21T04:01:48.237 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3560354816 bytes 2021-11-21T04:01:48.312 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3600927744 bytes 2021-11-21T04:01:48.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3648071680 bytes 2021-11-21T04:01:48.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3653942272 bytes 2021-11-21T04:01:48.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3658507264 bytes 2021-11-21T04:01:48.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3681597440 bytes 2021-11-21T04:01:48.651 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 3758534656 bytes 2021-11-21T04:01:48.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 3787240448 bytes 2021-11-21T04:01:48.793 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 3822859264 bytes 2021-11-21T04:01:48.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 3900190720 bytes 2021-11-21T04:01:49.021 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 3978502144 bytes 2021-11-21T04:01:49.065 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 4005176320 bytes 2021-11-21T04:01:49.153 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 4035935232 bytes 2021-11-21T04:01:49.194 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 4053126144 bytes 2021-11-21T04:01:49.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4099716096 bytes 2021-11-21T04:01:49.355 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4129230848 bytes 2021-11-21T04:01:49.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4173217792 bytes 2021-11-21T04:01:49.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4218609664 bytes 2021-11-21T04:01:49.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4271283200 bytes 2021-11-21T04:01:49.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4367335424 bytes 2021-11-21T04:01:49.833 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4422311936 bytes 2021-11-21T04:01:49.918 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4465352704 bytes 2021-11-21T04:01:50.026 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4536474624 bytes 2021-11-21T04:01:50.087 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4562944000 bytes 2021-11-21T04:01:50.193 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 4633339904 bytes 2021-11-21T04:01:50.251 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 4652329984 bytes 2021-11-21T04:01:50.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 4694164480 bytes 2021-11-21T04:01:50.389 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 4708118528 bytes 2021-11-21T04:01:50.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 4738003968 bytes 2021-11-21T04:01:50.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 4790014976 bytes 2021-11-21T04:01:50.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 4867526656 bytes 2021-11-21T04:01:50.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 4868126720 bytes 2021-11-21T04:01:50.759 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 4881113088 bytes 2021-11-21T04:01:50.878 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 4969767936 bytes 2021-11-21T04:01:50.924 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 4973873152 bytes 2021-11-21T04:01:51.007 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 5017256960 bytes 2021-11-21T04:01:51.297 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 5060839424 bytes 2021-11-21T04:01:51.371 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 5103341568 bytes 2021-11-21T04:01:51.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 5205051392 bytes 2021-11-21T04:01:51.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12600 IOs, 5268495360 bytes 2021-11-21T04:01:51.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12700 IOs, 5269111808 bytes 2021-11-21T04:01:51.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12800 IOs, 5337395200 bytes 2021-11-21T04:01:51.863 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12900 IOs, 5408291840 bytes 2021-11-21T04:01:51.918 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13000 IOs, 5428357120 bytes 2021-11-21T04:01:51.995 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13100 IOs, 5459267584 bytes 2021-11-21T04:01:52.097 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13200 IOs, 5525864448 bytes 2021-11-21T04:01:52.187 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13300 IOs, 5577852928 bytes 2021-11-21T04:01:52.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13400 IOs, 5645616128 bytes 2021-11-21T04:01:52.361 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13500 IOs, 5679894528 bytes 2021-11-21T04:01:52.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13600 IOs, 5715898368 bytes 2021-11-21T04:01:52.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:01:52.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:01:52.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:01:52.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:01:52.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:01:52.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_2 2021-11-21T04:01:52.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_2 snapshot 128M 2021-11-21T04:01:52.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:52.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:52.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:52.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:52.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_2 2021-11-21T04:01:52.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:52.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:01:52.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:01:52.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:52.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_2 128M 2021-11-21T04:01:52.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:52.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:52.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:52.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:52.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_2 2021-11-21T04:01:52.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:52.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:01:52.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:01:52.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:01:52.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:01:52.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_2 2021-11-21T04:01:52.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:01:52.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_2 snapshot 2021-11-21T04:01:52.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:52.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:52.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_2 2021-11-21T04:01:52.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:01:52.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_2 snapshot 2021-11-21T04:01:52.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:01:52.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:01:52.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_2 2021-11-21T04:01:52.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:01:52.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:01:52.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_2 2021-11-21T04:01:52.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:01:52.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=11 2021-11-21T04:01:52.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:01:52.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 11s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_2 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:01:52.744 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 57796608 bytes 2021-11-21T04:01:52.798 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 78870528 bytes 2021-11-21T04:01:52.875 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 123439104 bytes 2021-11-21T04:01:52.965 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 180664320 bytes 2021-11-21T04:01:53.022 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 204647424 bytes 2021-11-21T04:01:53.127 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 282201088 bytes 2021-11-21T04:01:53.202 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 319234048 bytes 2021-11-21T04:01:53.260 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 348559360 bytes 2021-11-21T04:01:53.338 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 385354752 bytes 2021-11-21T04:01:53.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 428451840 bytes 2021-11-21T04:01:53.493 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 473424896 bytes 2021-11-21T04:01:53.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 562058240 bytes 2021-11-21T04:01:53.723 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 636834816 bytes 2021-11-21T04:01:53.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 654184448 bytes 2021-11-21T04:01:53.886 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 732809216 bytes 2021-11-21T04:01:53.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 769178624 bytes 2021-11-21T04:01:54.077 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 836849664 bytes 2021-11-21T04:01:54.124 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 864360448 bytes 2021-11-21T04:01:54.257 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 948240384 bytes 2021-11-21T04:01:54.302 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 955737088 bytes 2021-11-21T04:01:54.363 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 978359296 bytes 2021-11-21T04:01:54.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 1033600000 bytes 2021-11-21T04:01:54.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1129359360 bytes 2021-11-21T04:01:54.693 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1208204288 bytes 2021-11-21T04:01:54.802 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1276370944 bytes 2021-11-21T04:01:54.895 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1339496448 bytes 2021-11-21T04:01:54.979 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1380743168 bytes 2021-11-21T04:01:55.035 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1403373568 bytes 2021-11-21T04:01:55.131 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1480228864 bytes 2021-11-21T04:01:55.253 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1552417792 bytes 2021-11-21T04:01:55.299 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1555906560 bytes 2021-11-21T04:01:55.368 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1608866816 bytes 2021-11-21T04:01:55.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1629626368 bytes 2021-11-21T04:01:55.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1663775744 bytes 2021-11-21T04:01:55.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1698686976 bytes 2021-11-21T04:01:55.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1871111168 bytes 2021-11-21T04:01:55.914 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1960872960 bytes 2021-11-21T04:01:55.969 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1978018816 bytes 2021-11-21T04:01:56.104 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 2077338624 bytes 2021-11-21T04:01:56.166 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 2105590784 bytes 2021-11-21T04:01:56.279 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 2167337984 bytes 2021-11-21T04:01:56.369 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 2221264896 bytes 2021-11-21T04:01:56.481 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 2222091264 bytes 2021-11-21T04:01:56.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 2230694912 bytes 2021-11-21T04:01:56.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 2328363008 bytes 2021-11-21T04:01:56.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 2373846016 bytes 2021-11-21T04:01:56.801 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 2388000768 bytes 2021-11-21T04:01:56.917 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 2468316160 bytes 2021-11-21T04:01:56.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2494732288 bytes 2021-11-21T04:01:57.100 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2578104320 bytes 2021-11-21T04:01:57.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2611016704 bytes 2021-11-21T04:01:57.211 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2611628032 bytes 2021-11-21T04:01:57.283 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2666801152 bytes 2021-11-21T04:01:57.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2708189184 bytes 2021-11-21T04:01:57.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2746646528 bytes 2021-11-21T04:01:57.522 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2777169920 bytes 2021-11-21T04:01:57.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2790743040 bytes 2021-11-21T04:01:57.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2834473984 bytes 2021-11-21T04:01:57.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2889216000 bytes 2021-11-21T04:01:57.824 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2923490304 bytes 2021-11-21T04:01:57.925 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2985275392 bytes 2021-11-21T04:01:58.049 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 3073556480 bytes 2021-11-21T04:01:58.151 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 3138359296 bytes 2021-11-21T04:01:58.229 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 3183539200 bytes 2021-11-21T04:01:58.298 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 3231024128 bytes 2021-11-21T04:01:58.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 3272974336 bytes 2021-11-21T04:01:58.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 3305953280 bytes 2021-11-21T04:01:58.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 3344312320 bytes 2021-11-21T04:01:58.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 3383839744 bytes 2021-11-21T04:01:58.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 3405265920 bytes 2021-11-21T04:01:58.818 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 3515191296 bytes 2021-11-21T04:01:58.867 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 3527828480 bytes 2021-11-21T04:01:58.914 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3528466432 bytes 2021-11-21T04:01:59.051 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3630652416 bytes 2021-11-21T04:01:59.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3718038528 bytes 2021-11-21T04:01:59.282 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3800406016 bytes 2021-11-21T04:01:59.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3871983616 bytes 2021-11-21T04:01:59.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3892496384 bytes 2021-11-21T04:01:59.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3894339584 bytes 2021-11-21T04:01:59.510 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.6890912515729385) > weight (0.25) 2021-11-21T04:01:59.511 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.5803453344828884) > weight (0.25) 2021-11-21T04:01:59.511 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.2 with skip (0.3261333501412442) > weight (0.25) 2021-11-21T04:01:59.511 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.3 with skip (0.563523624355714) > weight (0.25) 2021-11-21T04:01:59.511 INFO:tasks.rbd_mirror_thrash:waiting for 109 secs before thrashing 2021-11-21T04:01:59.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3966776320 bytes 2021-11-21T04:01:59.689 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 4015764480 bytes 2021-11-21T04:01:59.783 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 4076241920 bytes 2021-11-21T04:01:59.891 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 4141788160 bytes 2021-11-21T04:01:59.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 4196882432 bytes 2021-11-21T04:02:00.038 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 4209696768 bytes 2021-11-21T04:02:00.092 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 4222367744 bytes 2021-11-21T04:02:00.166 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 4259164160 bytes 2021-11-21T04:02:00.284 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 4341088256 bytes 2021-11-21T04:02:00.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 4365322240 bytes 2021-11-21T04:02:00.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 4373708800 bytes 2021-11-21T04:02:00.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 4460680192 bytes 2021-11-21T04:02:00.588 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 4496015360 bytes 2021-11-21T04:02:00.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 4511503360 bytes 2021-11-21T04:02:00.919 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 4534945792 bytes 2021-11-21T04:02:00.919 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 4574630912 bytes 2021-11-21T04:02:00.920 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 4613303296 bytes 2021-11-21T04:02:00.951 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 4681444352 bytes 2021-11-21T04:02:01.059 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 4737987584 bytes 2021-11-21T04:02:01.133 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 4759965696 bytes 2021-11-21T04:02:01.190 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 4775999488 bytes 2021-11-21T04:02:01.264 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4815808512 bytes 2021-11-21T04:02:01.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4827229184 bytes 2021-11-21T04:02:01.423 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4900071424 bytes 2021-11-21T04:02:01.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4942659584 bytes 2021-11-21T04:02:01.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4973046784 bytes 2021-11-21T04:02:01.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 5003297792 bytes 2021-11-21T04:02:01.825 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 5085032448 bytes 2021-11-21T04:02:01.951 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 5182729216 bytes 2021-11-21T04:02:02.116 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 5328695296 bytes 2021-11-21T04:02:02.234 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 5393187840 bytes 2021-11-21T04:02:02.289 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 5406318592 bytes 2021-11-21T04:02:02.369 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 5460515840 bytes 2021-11-21T04:02:02.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 5482534912 bytes 2021-11-21T04:02:02.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 5512017920 bytes 2021-11-21T04:02:02.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 5529017344 bytes 2021-11-21T04:02:02.675 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 5602498560 bytes 2021-11-21T04:02:02.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 5608237056 bytes 2021-11-21T04:02:02.763 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 5608845312 bytes 2021-11-21T04:02:02.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 5650468864 bytes 2021-11-21T04:02:02.912 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 5681898496 bytes 2021-11-21T04:02:02.960 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 5702295552 bytes 2021-11-21T04:02:03.042 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 5756224512 bytes 2021-11-21T04:02:03.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 5781686272 bytes 2021-11-21T04:02:03.164 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 5782305792 bytes 2021-11-21T04:02:03.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 5891787776 bytes 2021-11-21T04:02:03.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12600 IOs, 5950832640 bytes 2021-11-21T04:02:03.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12700 IOs, 6013314048 bytes 2021-11-21T04:02:03.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12800 IOs, 6021296128 bytes 2021-11-21T04:02:03.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:02:03.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:02:03.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:02:03.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:02:03.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:02:03.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_3 2021-11-21T04:02:03.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_3 snapshot 128M 2021-11-21T04:02:03.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:03.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:03.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:03.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:03.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_3 2021-11-21T04:02:03.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:03.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:02:03.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:02:03.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:03.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_3 128M 2021-11-21T04:02:03.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:03.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:03.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:03.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:03.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_3 2021-11-21T04:02:03.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:03.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:02:03.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:02:03.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:02:03.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:03.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_3 2021-11-21T04:02:03.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:02:03.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_3 snapshot 2021-11-21T04:02:03.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:03.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:03.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_3 2021-11-21T04:02:03.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:02:03.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_3 snapshot 2021-11-21T04:02:04.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:02:04.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:02:04.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_3 2021-11-21T04:02:04.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:04.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:04.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_3 2021-11-21T04:02:04.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:02:04.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=13 2021-11-21T04:02:04.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:02:04.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 13s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_3 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:02:04.793 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 92841984 bytes 2021-11-21T04:02:04.917 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 185018368 bytes 2021-11-21T04:02:05.005 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 247663616 bytes 2021-11-21T04:02:05.104 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 345940992 bytes 2021-11-21T04:02:05.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 412002304 bytes 2021-11-21T04:02:05.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 451947520 bytes 2021-11-21T04:02:05.419 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 519837696 bytes 2021-11-21T04:02:05.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 529402880 bytes 2021-11-21T04:02:05.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 542412800 bytes 2021-11-21T04:02:05.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 558543872 bytes 2021-11-21T04:02:05.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 596342784 bytes 2021-11-21T04:02:05.716 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 640899072 bytes 2021-11-21T04:02:05.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 649236480 bytes 2021-11-21T04:02:05.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 677182464 bytes 2021-11-21T04:02:05.918 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 728896512 bytes 2021-11-21T04:02:05.986 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 751819776 bytes 2021-11-21T04:02:06.068 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 797348864 bytes 2021-11-21T04:02:06.166 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 865501184 bytes 2021-11-21T04:02:06.262 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 917494784 bytes 2021-11-21T04:02:06.316 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 934732800 bytes 2021-11-21T04:02:06.367 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 967779328 bytes 2021-11-21T04:02:06.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 1029516288 bytes 2021-11-21T04:02:06.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1163293696 bytes 2021-11-21T04:02:06.796 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1187394560 bytes 2021-11-21T04:02:06.856 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1213931520 bytes 2021-11-21T04:02:06.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1296111616 bytes 2021-11-21T04:02:07.078 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1358149632 bytes 2021-11-21T04:02:07.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1438938112 bytes 2021-11-21T04:02:07.260 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1468063744 bytes 2021-11-21T04:02:07.346 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1521394688 bytes 2021-11-21T04:02:07.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1590749184 bytes 2021-11-21T04:02:07.522 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1635911680 bytes 2021-11-21T04:02:07.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1704030208 bytes 2021-11-21T04:02:07.667 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1706038272 bytes 2021-11-21T04:02:07.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1769038848 bytes 2021-11-21T04:02:07.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1852891136 bytes 2021-11-21T04:02:07.967 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1888655360 bytes 2021-11-21T04:02:08.013 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1898011648 bytes 2021-11-21T04:02:08.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1957413888 bytes 2021-11-21T04:02:08.214 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 2028744704 bytes 2021-11-21T04:02:08.283 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 2058987520 bytes 2021-11-21T04:02:08.398 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 2142177280 bytes 2021-11-21T04:02:08.474 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 2174683136 bytes 2021-11-21T04:02:08.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 2175303680 bytes 2021-11-21T04:02:08.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 2177914880 bytes 2021-11-21T04:02:08.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 2242361344 bytes 2021-11-21T04:02:08.698 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 2242978816 bytes 2021-11-21T04:02:08.791 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 2299637760 bytes 2021-11-21T04:02:08.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2349636608 bytes 2021-11-21T04:02:08.942 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2374096896 bytes 2021-11-21T04:02:09.011 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2421288960 bytes 2021-11-21T04:02:09.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2464380928 bytes 2021-11-21T04:02:09.161 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2480323584 bytes 2021-11-21T04:02:09.231 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2526286848 bytes 2021-11-21T04:02:09.309 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2565458944 bytes 2021-11-21T04:02:09.367 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2594641920 bytes 2021-11-21T04:02:09.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2660130816 bytes 2021-11-21T04:02:09.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2716259328 bytes 2021-11-21T04:02:09.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2739684352 bytes 2021-11-21T04:02:09.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2804059136 bytes 2021-11-21T04:02:09.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2843488256 bytes 2021-11-21T04:02:09.882 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2872511488 bytes 2021-11-21T04:02:09.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2933852160 bytes 2021-11-21T04:02:10.026 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2953748480 bytes 2021-11-21T04:02:10.116 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2995070976 bytes 2021-11-21T04:02:10.194 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 3039235072 bytes 2021-11-21T04:02:10.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 3117810688 bytes 2021-11-21T04:02:10.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 3192902656 bytes 2021-11-21T04:02:10.481 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 3207179264 bytes 2021-11-21T04:02:10.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 3241745408 bytes 2021-11-21T04:02:10.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 3283118080 bytes 2021-11-21T04:02:10.758 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 3370829824 bytes 2021-11-21T04:02:10.827 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3394918400 bytes 2021-11-21T04:02:10.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3448020992 bytes 2021-11-21T04:02:10.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3466021888 bytes 2021-11-21T04:02:11.067 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3527156736 bytes 2021-11-21T04:02:11.145 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3563714560 bytes 2021-11-21T04:02:11.234 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3616430080 bytes 2021-11-21T04:02:11.321 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3662893056 bytes 2021-11-21T04:02:11.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3719576576 bytes 2021-11-21T04:02:11.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3731082240 bytes 2021-11-21T04:02:11.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3771121664 bytes 2021-11-21T04:02:11.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3810105344 bytes 2021-11-21T04:02:11.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3864944640 bytes 2021-11-21T04:02:11.809 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3906638848 bytes 2021-11-21T04:02:11.910 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3971171328 bytes 2021-11-21T04:02:11.990 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 4011626496 bytes 2021-11-21T04:02:12.064 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 4044370944 bytes 2021-11-21T04:02:12.151 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 4094137344 bytes 2021-11-21T04:02:12.232 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 4135364608 bytes 2021-11-21T04:02:12.289 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 4154942464 bytes 2021-11-21T04:02:12.347 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 4173041664 bytes 2021-11-21T04:02:12.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 4264015872 bytes 2021-11-21T04:02:12.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 4288831488 bytes 2021-11-21T04:02:12.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 4316370944 bytes 2021-11-21T04:02:12.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 4407393280 bytes 2021-11-21T04:02:12.826 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 4457488384 bytes 2021-11-21T04:02:12.894 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 4487050240 bytes 2021-11-21T04:02:12.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 4533603328 bytes 2021-11-21T04:02:13.050 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 4565529600 bytes 2021-11-21T04:02:13.152 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4628423680 bytes 2021-11-21T04:02:13.308 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4754058240 bytes 2021-11-21T04:02:13.371 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4777069568 bytes 2021-11-21T04:02:13.418 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4780648448 bytes 2021-11-21T04:02:13.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4831329280 bytes 2021-11-21T04:02:13.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4857405440 bytes 2021-11-21T04:02:13.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4858013696 bytes 2021-11-21T04:02:13.726 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4926419968 bytes 2021-11-21T04:02:13.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4932734976 bytes 2021-11-21T04:02:13.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4994146304 bytes 2021-11-21T04:02:13.957 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 5032014848 bytes 2021-11-21T04:02:14.025 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 5059585024 bytes 2021-11-21T04:02:14.090 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 5083403264 bytes 2021-11-21T04:02:14.193 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 5152532480 bytes 2021-11-21T04:02:14.261 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 5176379392 bytes 2021-11-21T04:02:14.381 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 5257475072 bytes 2021-11-21T04:02:14.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 5281841152 bytes 2021-11-21T04:02:14.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 5339275264 bytes 2021-11-21T04:02:14.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 5399818240 bytes 2021-11-21T04:02:14.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 5469402112 bytes 2021-11-21T04:02:14.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 5524774912 bytes 2021-11-21T04:02:15.002 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 5641483264 bytes 2021-11-21T04:02:15.062 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 5659702272 bytes 2021-11-21T04:02:15.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 5669415936 bytes 2021-11-21T04:02:15.194 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 5715031040 bytes 2021-11-21T04:02:15.248 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12600 IOs, 5742533632 bytes 2021-11-21T04:02:15.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12700 IOs, 5842937856 bytes 2021-11-21T04:02:15.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12800 IOs, 5856902144 bytes 2021-11-21T04:02:15.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12900 IOs, 5891980288 bytes 2021-11-21T04:02:15.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13000 IOs, 5901312000 bytes 2021-11-21T04:02:15.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13100 IOs, 5956302848 bytes 2021-11-21T04:02:15.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13200 IOs, 5971710976 bytes 2021-11-21T04:02:15.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13300 IOs, 5985744896 bytes 2021-11-21T04:02:15.860 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13400 IOs, 6025705472 bytes 2021-11-21T04:02:15.925 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13500 IOs, 6072144896 bytes 2021-11-21T04:02:16.017 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13600 IOs, 6098866176 bytes 2021-11-21T04:02:16.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13700 IOs, 6143725568 bytes 2021-11-21T04:02:16.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13800 IOs, 6186566656 bytes 2021-11-21T04:02:16.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13900 IOs, 6187155456 bytes 2021-11-21T04:02:16.309 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14000 IOs, 6237586432 bytes 2021-11-21T04:02:16.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14100 IOs, 6275179520 bytes 2021-11-21T04:02:16.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14200 IOs, 6331245568 bytes 2021-11-21T04:02:16.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14300 IOs, 6347986944 bytes 2021-11-21T04:02:16.674 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14400 IOs, 6389901312 bytes 2021-11-21T04:02:16.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14500 IOs, 6414671872 bytes 2021-11-21T04:02:16.845 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14600 IOs, 6484798464 bytes 2021-11-21T04:02:16.916 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14700 IOs, 6517790720 bytes 2021-11-21T04:02:17.017 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14800 IOs, 6574555136 bytes 2021-11-21T04:02:17.126 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14900 IOs, 6653557760 bytes 2021-11-21T04:02:17.206 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15000 IOs, 6681294848 bytes 2021-11-21T04:02:17.248 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15100 IOs, 6681889792 bytes 2021-11-21T04:02:17.297 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15200 IOs, 6710222848 bytes 2021-11-21T04:02:17.400 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15300 IOs, 6748375040 bytes 2021-11-21T04:02:17.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15400 IOs, 6792652800 bytes 2021-11-21T04:02:17.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15500 IOs, 6835860480 bytes 2021-11-21T04:02:17.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:02:17.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:02:17.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:02:17.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:02:17.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:02:17.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_4 2021-11-21T04:02:17.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_4 snapshot 128M 2021-11-21T04:02:17.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:17.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:17.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:17.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:17.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_4 2021-11-21T04:02:17.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:17.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:02:17.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:02:17.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:17.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_4 128M 2021-11-21T04:02:17.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:17.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:17.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:17.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:17.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_4 2021-11-21T04:02:17.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:17.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:02:17.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:02:17.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:02:17.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:17.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_4 2021-11-21T04:02:17.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:02:17.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_4 snapshot 2021-11-21T04:02:17.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:17.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:17.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_4 2021-11-21T04:02:17.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:02:17.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_4 snapshot 2021-11-21T04:02:18.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:02:18.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:02:18.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_4 2021-11-21T04:02:18.600 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:18.601 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:18.601 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_4 2021-11-21T04:02:18.601 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:02:18.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=7 2021-11-21T04:02:18.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:02:18.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 7s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_4 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:02:18.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 56041472 bytes 2021-11-21T04:02:18.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 113945600 bytes 2021-11-21T04:02:18.928 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 146111488 bytes 2021-11-21T04:02:19.007 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 183942144 bytes 2021-11-21T04:02:19.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 264726528 bytes 2021-11-21T04:02:19.185 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 282616832 bytes 2021-11-21T04:02:19.229 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 292212736 bytes 2021-11-21T04:02:19.363 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 384958464 bytes 2021-11-21T04:02:19.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 423646208 bytes 2021-11-21T04:02:19.492 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 430315520 bytes 2021-11-21T04:02:19.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 466891776 bytes 2021-11-21T04:02:19.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 479362048 bytes 2021-11-21T04:02:19.686 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 495554560 bytes 2021-11-21T04:02:19.740 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 509523968 bytes 2021-11-21T04:02:19.796 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 527089664 bytes 2021-11-21T04:02:19.878 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 569504768 bytes 2021-11-21T04:02:19.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 596461568 bytes 2021-11-21T04:02:20.069 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 681287680 bytes 2021-11-21T04:02:20.113 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 684739584 bytes 2021-11-21T04:02:20.158 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 685698048 bytes 2021-11-21T04:02:20.219 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 707896320 bytes 2021-11-21T04:02:20.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 739544064 bytes 2021-11-21T04:02:20.366 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 769682432 bytes 2021-11-21T04:02:20.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 790711296 bytes 2021-11-21T04:02:20.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 795117568 bytes 2021-11-21T04:02:20.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 795753472 bytes 2021-11-21T04:02:20.599 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 838388736 bytes 2021-11-21T04:02:20.707 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 899107840 bytes 2021-11-21T04:02:20.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 965943296 bytes 2021-11-21T04:02:20.962 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1071518720 bytes 2021-11-21T04:02:21.040 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1106109440 bytes 2021-11-21T04:02:21.102 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1135574016 bytes 2021-11-21T04:02:21.163 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1156257792 bytes 2021-11-21T04:02:21.285 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1235896320 bytes 2021-11-21T04:02:21.373 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1287178240 bytes 2021-11-21T04:02:21.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1352161280 bytes 2021-11-21T04:02:21.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1401152512 bytes 2021-11-21T04:02:21.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1449989120 bytes 2021-11-21T04:02:21.832 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1505930240 bytes 2021-11-21T04:02:21.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1534733312 bytes 2021-11-21T04:02:21.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1566601216 bytes 2021-11-21T04:02:22.089 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1631593472 bytes 2021-11-21T04:02:22.209 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1720407040 bytes 2021-11-21T04:02:22.261 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1736363008 bytes 2021-11-21T04:02:22.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1813055488 bytes 2021-11-21T04:02:22.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1836686336 bytes 2021-11-21T04:02:22.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1861863424 bytes 2021-11-21T04:02:22.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 1876770816 bytes 2021-11-21T04:02:22.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 1929220096 bytes 2021-11-21T04:02:22.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 1962164224 bytes 2021-11-21T04:02:22.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 1988142080 bytes 2021-11-21T04:02:22.861 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 1992750080 bytes 2021-11-21T04:02:22.950 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2067241984 bytes 2021-11-21T04:02:23.052 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2095967232 bytes 2021-11-21T04:02:23.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2123551744 bytes 2021-11-21T04:02:23.182 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2150795264 bytes 2021-11-21T04:02:23.240 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2164016128 bytes 2021-11-21T04:02:23.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2280060928 bytes 2021-11-21T04:02:23.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2343345152 bytes 2021-11-21T04:02:23.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2343951360 bytes 2021-11-21T04:02:23.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2392997888 bytes 2021-11-21T04:02:23.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2412650496 bytes 2021-11-21T04:02:23.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2458597376 bytes 2021-11-21T04:02:23.896 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2478155776 bytes 2021-11-21T04:02:23.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2533224448 bytes 2021-11-21T04:02:24.075 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2565530624 bytes 2021-11-21T04:02:24.183 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2626055168 bytes 2021-11-21T04:02:24.278 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2691212288 bytes 2021-11-21T04:02:24.340 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2705290240 bytes 2021-11-21T04:02:24.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2705875968 bytes 2021-11-21T04:02:24.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 2791508992 bytes 2021-11-21T04:02:24.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 2851445760 bytes 2021-11-21T04:02:24.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 2899361792 bytes 2021-11-21T04:02:24.765 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 2922087424 bytes 2021-11-21T04:02:24.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 2957758464 bytes 2021-11-21T04:02:24.909 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 2977073152 bytes 2021-11-21T04:02:24.958 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 2985479168 bytes 2021-11-21T04:02:25.000 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 2986054656 bytes 2021-11-21T04:02:25.075 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3021839360 bytes 2021-11-21T04:02:25.224 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3112416256 bytes 2021-11-21T04:02:25.357 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3207206912 bytes 2021-11-21T04:02:25.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3234257920 bytes 2021-11-21T04:02:25.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3252045824 bytes 2021-11-21T04:02:25.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3318948864 bytes 2021-11-21T04:02:25.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:02:25.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:02:25.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:02:25.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:02:25.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:02:25.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_5 2021-11-21T04:02:25.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_5 snapshot 128M 2021-11-21T04:02:25.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:25.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:25.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:25.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:25.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_5 2021-11-21T04:02:25.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:25.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:02:25.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:02:25.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:25.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_5 128M 2021-11-21T04:02:25.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:25.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:25.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:25.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:25.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_5 2021-11-21T04:02:25.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:25.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:02:25.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:02:25.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:02:25.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:25.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_5 2021-11-21T04:02:26.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:02:26.736 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_5 snapshot 2021-11-21T04:02:26.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:26.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:26.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_5 2021-11-21T04:02:26.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:02:26.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_5 snapshot 2021-11-21T04:02:27.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:02:27.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:02:27.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_5 2021-11-21T04:02:27.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:27.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:27.427 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_5 2021-11-21T04:02:27.427 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:02:27.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=8 2021-11-21T04:02:27.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:02:27.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 8s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_5 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:02:27.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 72125440 bytes 2021-11-21T04:02:27.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 93436928 bytes 2021-11-21T04:02:27.826 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 94048256 bytes 2021-11-21T04:02:27.964 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 203513856 bytes 2021-11-21T04:02:28.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 214748160 bytes 2021-11-21T04:02:28.219 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 223263744 bytes 2021-11-21T04:02:28.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 262142976 bytes 2021-11-21T04:02:28.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 262761472 bytes 2021-11-21T04:02:28.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 336313344 bytes 2021-11-21T04:02:28.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 428655616 bytes 2021-11-21T04:02:28.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 441670656 bytes 2021-11-21T04:02:28.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 450162688 bytes 2021-11-21T04:02:28.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 470069248 bytes 2021-11-21T04:02:28.860 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 560279552 bytes 2021-11-21T04:02:28.933 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 597208064 bytes 2021-11-21T04:02:29.048 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 683289600 bytes 2021-11-21T04:02:29.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 766309376 bytes 2021-11-21T04:02:29.254 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 824606720 bytes 2021-11-21T04:02:29.338 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 855816192 bytes 2021-11-21T04:02:29.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 894004224 bytes 2021-11-21T04:02:29.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 905646080 bytes 2021-11-21T04:02:29.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 936332288 bytes 2021-11-21T04:02:29.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 961620992 bytes 2021-11-21T04:02:29.686 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1027481600 bytes 2021-11-21T04:02:29.789 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1104025600 bytes 2021-11-21T04:02:29.898 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1173595136 bytes 2021-11-21T04:02:30.005 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1227625472 bytes 2021-11-21T04:02:30.096 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1298065408 bytes 2021-11-21T04:02:30.180 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1323081728 bytes 2021-11-21T04:02:30.233 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1339068416 bytes 2021-11-21T04:02:30.291 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1379581952 bytes 2021-11-21T04:02:30.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1428218880 bytes 2021-11-21T04:02:30.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1460468736 bytes 2021-11-21T04:02:30.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1486478336 bytes 2021-11-21T04:02:30.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1487108096 bytes 2021-11-21T04:02:30.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1500888064 bytes 2021-11-21T04:02:30.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1551012864 bytes 2021-11-21T04:02:30.800 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1606935552 bytes 2021-11-21T04:02:30.848 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1623736320 bytes 2021-11-21T04:02:30.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1643085824 bytes 2021-11-21T04:02:30.976 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1685743616 bytes 2021-11-21T04:02:31.043 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1738322944 bytes 2021-11-21T04:02:31.148 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1780870144 bytes 2021-11-21T04:02:31.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1786616832 bytes 2021-11-21T04:02:31.277 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1838513152 bytes 2021-11-21T04:02:31.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1873949696 bytes 2021-11-21T04:02:31.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1940016128 bytes 2021-11-21T04:02:31.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 2007817216 bytes 2021-11-21T04:02:31.625 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2042819584 bytes 2021-11-21T04:02:31.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2053827584 bytes 2021-11-21T04:02:31.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2070092800 bytes 2021-11-21T04:02:31.831 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2111849472 bytes 2021-11-21T04:02:31.924 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2153254912 bytes 2021-11-21T04:02:32.001 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2194733056 bytes 2021-11-21T04:02:32.064 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2236226560 bytes 2021-11-21T04:02:32.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2274300928 bytes 2021-11-21T04:02:32.246 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2317990912 bytes 2021-11-21T04:02:32.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2325343232 bytes 2021-11-21T04:02:32.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2325943296 bytes 2021-11-21T04:02:32.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2386877440 bytes 2021-11-21T04:02:32.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2437024768 bytes 2021-11-21T04:02:32.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2538618880 bytes 2021-11-21T04:02:32.802 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2640504832 bytes 2021-11-21T04:02:32.888 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2689138688 bytes 2021-11-21T04:02:32.938 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2696497152 bytes 2021-11-21T04:02:33.049 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2772713472 bytes 2021-11-21T04:02:33.138 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2821859328 bytes 2021-11-21T04:02:33.218 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2879350784 bytes 2021-11-21T04:02:33.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2955587584 bytes 2021-11-21T04:02:33.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2961506304 bytes 2021-11-21T04:02:33.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 2973374464 bytes 2021-11-21T04:02:33.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 2978282496 bytes 2021-11-21T04:02:33.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3028188160 bytes 2021-11-21T04:02:33.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3082874880 bytes 2021-11-21T04:02:33.723 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3133607936 bytes 2021-11-21T04:02:33.783 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3162021888 bytes 2021-11-21T04:02:33.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3263564800 bytes 2021-11-21T04:02:34.030 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3331118080 bytes 2021-11-21T04:02:34.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3361646592 bytes 2021-11-21T04:02:34.208 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3433977856 bytes 2021-11-21T04:02:34.259 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3452222464 bytes 2021-11-21T04:02:34.309 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3456514048 bytes 2021-11-21T04:02:34.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3537386496 bytes 2021-11-21T04:02:34.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3585553408 bytes 2021-11-21T04:02:34.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3671655424 bytes 2021-11-21T04:02:34.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3720377344 bytes 2021-11-21T04:02:34.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3742234624 bytes 2021-11-21T04:02:34.855 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3808094208 bytes 2021-11-21T04:02:34.961 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3876086784 bytes 2021-11-21T04:02:35.044 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3891979264 bytes 2021-11-21T04:02:35.127 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3940639744 bytes 2021-11-21T04:02:35.233 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3989284864 bytes 2021-11-21T04:02:35.315 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 4037230592 bytes 2021-11-21T04:02:35.373 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 4067000320 bytes 2021-11-21T04:02:35.493 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 4142941184 bytes 2021-11-21T04:02:35.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:02:35.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:02:35.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:02:35.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:02:35.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:02:35.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_6 2021-11-21T04:02:35.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_6 snapshot 128M 2021-11-21T04:02:35.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:35.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:35.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:35.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:35.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_6 2021-11-21T04:02:35.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:35.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:02:35.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:02:35.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:35.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_6 128M 2021-11-21T04:02:35.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:35.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:35.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:35.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:35.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_6 2021-11-21T04:02:35.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:35.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:02:35.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:02:35.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:02:35.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:35.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_6 2021-11-21T04:02:35.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:02:35.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_6 snapshot 2021-11-21T04:02:35.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:35.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:35.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_6 2021-11-21T04:02:35.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:02:35.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_6 snapshot 2021-11-21T04:02:36.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:02:36.423 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:02:36.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_6 2021-11-21T04:02:36.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:36.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:36.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_6 2021-11-21T04:02:36.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:02:36.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=11 2021-11-21T04:02:36.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:02:36.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 11s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_6 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:02:36.588 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 95567872 bytes 2021-11-21T04:02:36.676 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 131207168 bytes 2021-11-21T04:02:36.762 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 181038080 bytes 2021-11-21T04:02:36.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 192110592 bytes 2021-11-21T04:02:36.862 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 202207232 bytes 2021-11-21T04:02:36.956 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 257653760 bytes 2021-11-21T04:02:37.076 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 334790656 bytes 2021-11-21T04:02:37.131 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 347705344 bytes 2021-11-21T04:02:37.217 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 397486080 bytes 2021-11-21T04:02:37.274 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 436495360 bytes 2021-11-21T04:02:37.337 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 442427392 bytes 2021-11-21T04:02:37.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 461450240 bytes 2021-11-21T04:02:37.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 564178944 bytes 2021-11-21T04:02:37.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 599912448 bytes 2021-11-21T04:02:37.682 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 658630656 bytes 2021-11-21T04:02:37.827 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 757380096 bytes 2021-11-21T04:02:37.902 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 799624192 bytes 2021-11-21T04:02:37.987 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 856868864 bytes 2021-11-21T04:02:38.075 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 898180096 bytes 2021-11-21T04:02:38.133 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 917498880 bytes 2021-11-21T04:02:38.210 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 950802432 bytes 2021-11-21T04:02:38.282 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 977915904 bytes 2021-11-21T04:02:38.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1017539584 bytes 2021-11-21T04:02:38.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1039850496 bytes 2021-11-21T04:02:38.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1099212800 bytes 2021-11-21T04:02:38.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1147973632 bytes 2021-11-21T04:02:38.686 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1173297152 bytes 2021-11-21T04:02:38.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1176224768 bytes 2021-11-21T04:02:38.788 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1209385984 bytes 2021-11-21T04:02:38.882 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1281775616 bytes 2021-11-21T04:02:38.959 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1297574912 bytes 2021-11-21T04:02:39.057 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1356361728 bytes 2021-11-21T04:02:39.156 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1418478592 bytes 2021-11-21T04:02:39.258 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1476987904 bytes 2021-11-21T04:02:39.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1540519936 bytes 2021-11-21T04:02:39.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1636210688 bytes 2021-11-21T04:02:39.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1703383040 bytes 2021-11-21T04:02:39.689 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1758424064 bytes 2021-11-21T04:02:39.802 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1831448576 bytes 2021-11-21T04:02:39.887 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1887486976 bytes 2021-11-21T04:02:39.987 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1931210752 bytes 2021-11-21T04:02:40.076 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1984137216 bytes 2021-11-21T04:02:40.143 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 2011530240 bytes 2021-11-21T04:02:40.247 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 2097411072 bytes 2021-11-21T04:02:40.330 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 2128773120 bytes 2021-11-21T04:02:40.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 2162034688 bytes 2021-11-21T04:02:40.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 2190829568 bytes 2021-11-21T04:02:40.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 2245912576 bytes 2021-11-21T04:02:40.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2263631872 bytes 2021-11-21T04:02:40.760 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2373365760 bytes 2021-11-21T04:02:40.910 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2434190336 bytes 2021-11-21T04:02:40.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2450143232 bytes 2021-11-21T04:02:41.025 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2481189888 bytes 2021-11-21T04:02:41.119 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2518215680 bytes 2021-11-21T04:02:41.169 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2525732864 bytes 2021-11-21T04:02:41.252 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2564585472 bytes 2021-11-21T04:02:41.322 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2593271808 bytes 2021-11-21T04:02:41.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2688937984 bytes 2021-11-21T04:02:41.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2754102272 bytes 2021-11-21T04:02:41.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2833087488 bytes 2021-11-21T04:02:41.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2883750912 bytes 2021-11-21T04:02:41.850 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2905837568 bytes 2021-11-21T04:02:41.914 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2926034944 bytes 2021-11-21T04:02:41.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2947739648 bytes 2021-11-21T04:02:42.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 3047503872 bytes 2021-11-21T04:02:42.153 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 3056721920 bytes 2021-11-21T04:02:42.213 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 3083415552 bytes 2021-11-21T04:02:42.306 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 3124692992 bytes 2021-11-21T04:02:42.405 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 3184122880 bytes 2021-11-21T04:02:42.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 3201162240 bytes 2021-11-21T04:02:42.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 3241375744 bytes 2021-11-21T04:02:42.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 3287877632 bytes 2021-11-21T04:02:42.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3336577024 bytes 2021-11-21T04:02:42.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3406448640 bytes 2021-11-21T04:02:42.927 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3475718144 bytes 2021-11-21T04:02:43.050 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3544255488 bytes 2021-11-21T04:02:43.126 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3576636416 bytes 2021-11-21T04:02:43.209 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3618530304 bytes 2021-11-21T04:02:43.261 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3641705472 bytes 2021-11-21T04:02:43.352 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3671036928 bytes 2021-11-21T04:02:43.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3747418112 bytes 2021-11-21T04:02:43.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3760422912 bytes 2021-11-21T04:02:43.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3809116160 bytes 2021-11-21T04:02:43.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3847674880 bytes 2021-11-21T04:02:43.796 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3925478400 bytes 2021-11-21T04:02:43.896 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3980269568 bytes 2021-11-21T04:02:43.968 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 4010425344 bytes 2021-11-21T04:02:44.017 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 4015830016 bytes 2021-11-21T04:02:44.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 4037760000 bytes 2021-11-21T04:02:44.165 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 4073454592 bytes 2021-11-21T04:02:44.221 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 4079265792 bytes 2021-11-21T04:02:44.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 4149748736 bytes 2021-11-21T04:02:44.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 4197625856 bytes 2021-11-21T04:02:44.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 4258576384 bytes 2021-11-21T04:02:44.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 4323202048 bytes 2021-11-21T04:02:44.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 4367739904 bytes 2021-11-21T04:02:44.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 4419787776 bytes 2021-11-21T04:02:44.851 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 4423547904 bytes 2021-11-21T04:02:44.923 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 4454924288 bytes 2021-11-21T04:02:44.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 4463426560 bytes 2021-11-21T04:02:45.090 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4536701952 bytes 2021-11-21T04:02:45.176 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4579088384 bytes 2021-11-21T04:02:45.274 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4635610112 bytes 2021-11-21T04:02:45.362 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4694808576 bytes 2021-11-21T04:02:45.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4757788672 bytes 2021-11-21T04:02:45.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4800293888 bytes 2021-11-21T04:02:45.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4814575616 bytes 2021-11-21T04:02:45.707 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4880875520 bytes 2021-11-21T04:02:45.808 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4914004992 bytes 2021-11-21T04:02:45.909 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4972903424 bytes 2021-11-21T04:02:46.043 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 5087289344 bytes 2021-11-21T04:02:46.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 5176624128 bytes 2021-11-21T04:02:46.256 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 5206996992 bytes 2021-11-21T04:02:46.341 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 5262713856 bytes 2021-11-21T04:02:46.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 5347855360 bytes 2021-11-21T04:02:46.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 5419971584 bytes 2021-11-21T04:02:46.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 5472759808 bytes 2021-11-21T04:02:46.804 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 5483816960 bytes 2021-11-21T04:02:46.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 5519039488 bytes 2021-11-21T04:02:46.964 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 5563917312 bytes 2021-11-21T04:02:47.035 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 5587011584 bytes 2021-11-21T04:02:47.135 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 5641419776 bytes 2021-11-21T04:02:47.203 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 5666971648 bytes 2021-11-21T04:02:47.283 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 5703421952 bytes 2021-11-21T04:02:47.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 5772871680 bytes 2021-11-21T04:02:47.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:02:47.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:02:47.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:02:47.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:02:47.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:02:47.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_7 2021-11-21T04:02:47.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_7 snapshot 128M 2021-11-21T04:02:47.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:47.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:47.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:47.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:47.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_7 2021-11-21T04:02:47.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:47.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:02:47.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:02:47.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:47.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_7 128M 2021-11-21T04:02:47.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:47.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:47.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:47.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:47.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_7 2021-11-21T04:02:47.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:47.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:02:47.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:02:47.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:02:47.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:47.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_7 2021-11-21T04:02:47.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:02:47.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_7 snapshot 2021-11-21T04:02:47.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:47.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:47.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_7 2021-11-21T04:02:47.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:02:47.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_7 snapshot 2021-11-21T04:02:47.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:02:47.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:02:47.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_7 2021-11-21T04:02:47.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:47.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:47.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_7 2021-11-21T04:02:47.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:02:47.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=8 2021-11-21T04:02:47.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:02:47.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 8s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_7 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:02:47.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 58496000 bytes 2021-11-21T04:02:47.807 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 104415232 bytes 2021-11-21T04:02:47.874 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 120117248 bytes 2021-11-21T04:02:47.942 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 151153664 bytes 2021-11-21T04:02:48.011 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 184145920 bytes 2021-11-21T04:02:48.063 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 215731200 bytes 2021-11-21T04:02:48.148 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 238360576 bytes 2021-11-21T04:02:48.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 273053696 bytes 2021-11-21T04:02:48.342 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 343887872 bytes 2021-11-21T04:02:48.397 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 360442880 bytes 2021-11-21T04:02:48.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 382598144 bytes 2021-11-21T04:02:48.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 476802048 bytes 2021-11-21T04:02:48.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 549040128 bytes 2021-11-21T04:02:48.807 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 611836928 bytes 2021-11-21T04:02:48.856 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 616593408 bytes 2021-11-21T04:02:48.993 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 718279680 bytes 2021-11-21T04:02:49.046 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 748171264 bytes 2021-11-21T04:02:49.133 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 772554752 bytes 2021-11-21T04:02:49.202 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 802889728 bytes 2021-11-21T04:02:49.282 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 850800640 bytes 2021-11-21T04:02:49.355 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 871275520 bytes 2021-11-21T04:02:49.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 925754368 bytes 2021-11-21T04:02:49.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 948285440 bytes 2021-11-21T04:02:49.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 988394496 bytes 2021-11-21T04:02:49.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1140282368 bytes 2021-11-21T04:02:49.902 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1216803840 bytes 2021-11-21T04:02:49.958 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1232532480 bytes 2021-11-21T04:02:50.057 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1295868928 bytes 2021-11-21T04:02:50.146 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1342298112 bytes 2021-11-21T04:02:50.218 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1375885312 bytes 2021-11-21T04:02:50.270 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1407058944 bytes 2021-11-21T04:02:50.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1479141376 bytes 2021-11-21T04:02:50.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1518185472 bytes 2021-11-21T04:02:50.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1528854528 bytes 2021-11-21T04:02:50.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1534191616 bytes 2021-11-21T04:02:50.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1595613184 bytes 2021-11-21T04:02:50.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1613757440 bytes 2021-11-21T04:02:50.861 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1725390848 bytes 2021-11-21T04:02:50.943 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1769165824 bytes 2021-11-21T04:02:51.052 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1821030400 bytes 2021-11-21T04:02:51.165 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1894935552 bytes 2021-11-21T04:02:51.244 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1928143872 bytes 2021-11-21T04:02:51.365 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 2016781312 bytes 2021-11-21T04:02:51.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 2089609216 bytes 2021-11-21T04:02:51.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 2090193920 bytes 2021-11-21T04:02:51.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 2147214336 bytes 2021-11-21T04:02:51.710 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 2188435456 bytes 2021-11-21T04:02:51.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 2251618304 bytes 2021-11-21T04:02:51.873 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2268901376 bytes 2021-11-21T04:02:51.970 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2326892544 bytes 2021-11-21T04:02:52.057 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2373365760 bytes 2021-11-21T04:02:52.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2453052416 bytes 2021-11-21T04:02:52.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2461094912 bytes 2021-11-21T04:02:52.314 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2509061120 bytes 2021-11-21T04:02:52.365 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2537344000 bytes 2021-11-21T04:02:52.481 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2595907584 bytes 2021-11-21T04:02:52.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2621255680 bytes 2021-11-21T04:02:52.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2664570880 bytes 2021-11-21T04:02:52.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2690254848 bytes 2021-11-21T04:02:52.819 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2751976448 bytes 2021-11-21T04:02:52.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2772390912 bytes 2021-11-21T04:02:52.940 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2789838848 bytes 2021-11-21T04:02:53.000 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2826544128 bytes 2021-11-21T04:02:53.068 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2848497664 bytes 2021-11-21T04:02:53.167 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2897187840 bytes 2021-11-21T04:02:53.212 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2901225472 bytes 2021-11-21T04:02:53.336 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2986885120 bytes 2021-11-21T04:02:53.390 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2996063232 bytes 2021-11-21T04:02:53.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 3015527424 bytes 2021-11-21T04:02:53.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 3053785088 bytes 2021-11-21T04:02:53.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 3090836480 bytes 2021-11-21T04:02:53.677 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 3122493440 bytes 2021-11-21T04:02:53.765 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3174862848 bytes 2021-11-21T04:02:53.846 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3205364736 bytes 2021-11-21T04:02:53.925 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3244156928 bytes 2021-11-21T04:02:53.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3264079872 bytes 2021-11-21T04:02:54.101 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3340052480 bytes 2021-11-21T04:02:54.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3425591296 bytes 2021-11-21T04:02:54.306 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3461004288 bytes 2021-11-21T04:02:54.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3530935296 bytes 2021-11-21T04:02:54.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3558828032 bytes 2021-11-21T04:02:54.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3595909120 bytes 2021-11-21T04:02:54.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3612082176 bytes 2021-11-21T04:02:54.689 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3632197632 bytes 2021-11-21T04:02:54.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3647821824 bytes 2021-11-21T04:02:54.823 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3678684160 bytes 2021-11-21T04:02:54.900 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3712380928 bytes 2021-11-21T04:02:54.970 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3748279296 bytes 2021-11-21T04:02:55.027 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3754865664 bytes 2021-11-21T04:02:55.108 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3792436224 bytes 2021-11-21T04:02:55.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3825494016 bytes 2021-11-21T04:02:55.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3889657856 bytes 2021-11-21T04:02:55.351 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 3911117824 bytes 2021-11-21T04:02:55.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 3972834304 bytes 2021-11-21T04:02:55.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 3992282112 bytes 2021-11-21T04:02:55.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:02:55.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:02:55.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:02:55.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:02:55.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:02:55.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_8 2021-11-21T04:02:55.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_8 snapshot 128M 2021-11-21T04:02:55.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:55.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:55.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:55.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:55.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_8 2021-11-21T04:02:55.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:55.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:02:55.593 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:02:55.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:55.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_8 128M 2021-11-21T04:02:55.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:55.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:55.594 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:55.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:55.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_8 2021-11-21T04:02:55.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:55.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:02:55.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:02:55.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:02:55.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:02:55.596 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_8 2021-11-21T04:02:55.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:02:55.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_8 snapshot 2021-11-21T04:02:55.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:55.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:55.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_8 2021-11-21T04:02:55.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:02:55.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_8 snapshot 2021-11-21T04:02:56.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:02:56.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:02:56.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_8 2021-11-21T04:02:56.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:02:56.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:02:56.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_8 2021-11-21T04:02:56.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:02:56.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=9 2021-11-21T04:02:56.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:02:56.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 9s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_8 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:02:56.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 12306432 bytes 2021-11-21T04:02:56.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 23567360 bytes 2021-11-21T04:02:56.686 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 47002624 bytes 2021-11-21T04:02:56.765 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 84370432 bytes 2021-11-21T04:02:56.834 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 113596416 bytes 2021-11-21T04:02:56.936 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 170983424 bytes 2021-11-21T04:02:57.058 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 211131392 bytes 2021-11-21T04:02:57.193 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 354881536 bytes 2021-11-21T04:02:57.322 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 442763264 bytes 2021-11-21T04:02:57.410 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 497891328 bytes 2021-11-21T04:02:57.474 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 520683520 bytes 2021-11-21T04:02:57.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 570638336 bytes 2021-11-21T04:02:57.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 609143808 bytes 2021-11-21T04:02:57.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 684909568 bytes 2021-11-21T04:02:57.899 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 763137024 bytes 2021-11-21T04:02:57.954 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 776242176 bytes 2021-11-21T04:02:58.100 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 825390080 bytes 2021-11-21T04:02:58.206 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 887578624 bytes 2021-11-21T04:02:58.272 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 915171328 bytes 2021-11-21T04:02:58.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 942697472 bytes 2021-11-21T04:02:58.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 965663744 bytes 2021-11-21T04:02:58.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 1030531072 bytes 2021-11-21T04:02:58.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1043888128 bytes 2021-11-21T04:02:58.687 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1129310208 bytes 2021-11-21T04:02:58.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1210431488 bytes 2021-11-21T04:02:58.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1223901184 bytes 2021-11-21T04:02:58.980 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1287716864 bytes 2021-11-21T04:02:59.037 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1302901760 bytes 2021-11-21T04:02:59.081 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1303513088 bytes 2021-11-21T04:02:59.200 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1384839168 bytes 2021-11-21T04:02:59.275 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1419407360 bytes 2021-11-21T04:02:59.340 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1438708736 bytes 2021-11-21T04:02:59.407 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1462480896 bytes 2021-11-21T04:02:59.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1476690944 bytes 2021-11-21T04:02:59.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1491317760 bytes 2021-11-21T04:02:59.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1499482112 bytes 2021-11-21T04:02:59.664 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1553069056 bytes 2021-11-21T04:02:59.739 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1582443520 bytes 2021-11-21T04:02:59.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1583074304 bytes 2021-11-21T04:02:59.861 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1621295104 bytes 2021-11-21T04:02:59.938 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1659628544 bytes 2021-11-21T04:03:00.003 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1682600960 bytes 2021-11-21T04:03:00.125 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1760206848 bytes 2021-11-21T04:03:00.197 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1788753920 bytes 2021-11-21T04:03:00.262 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1811349504 bytes 2021-11-21T04:03:00.356 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1866349568 bytes 2021-11-21T04:03:00.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1888506880 bytes 2021-11-21T04:03:00.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 1931671552 bytes 2021-11-21T04:03:00.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 1979800576 bytes 2021-11-21T04:03:00.688 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2018318336 bytes 2021-11-21T04:03:00.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2070345728 bytes 2021-11-21T04:03:00.868 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2110648320 bytes 2021-11-21T04:03:00.953 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2155156480 bytes 2021-11-21T04:03:01.020 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2183243776 bytes 2021-11-21T04:03:01.090 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2207122432 bytes 2021-11-21T04:03:01.204 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2277134336 bytes 2021-11-21T04:03:01.270 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2308102144 bytes 2021-11-21T04:03:01.365 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2357990400 bytes 2021-11-21T04:03:01.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2388832256 bytes 2021-11-21T04:03:01.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2408687616 bytes 2021-11-21T04:03:01.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2409288704 bytes 2021-11-21T04:03:01.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2409924608 bytes 2021-11-21T04:03:01.664 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2452475904 bytes 2021-11-21T04:03:01.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2473481216 bytes 2021-11-21T04:03:01.852 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2535308288 bytes 2021-11-21T04:03:01.925 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2560100352 bytes 2021-11-21T04:03:01.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2583605248 bytes 2021-11-21T04:03:02.056 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2604273664 bytes 2021-11-21T04:03:02.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2615114752 bytes 2021-11-21T04:03:02.199 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2659047424 bytes 2021-11-21T04:03:02.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 2699258880 bytes 2021-11-21T04:03:02.359 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 2727171072 bytes 2021-11-21T04:03:02.426 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 2748319744 bytes 2021-11-21T04:03:02.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 2803222528 bytes 2021-11-21T04:03:02.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 2807954432 bytes 2021-11-21T04:03:02.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 2808558592 bytes 2021-11-21T04:03:02.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 2874446848 bytes 2021-11-21T04:03:02.795 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 2893146112 bytes 2021-11-21T04:03:02.856 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 2910606336 bytes 2021-11-21T04:03:02.962 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 2973573120 bytes 2021-11-21T04:03:03.040 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3009882112 bytes 2021-11-21T04:03:03.116 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3043691520 bytes 2021-11-21T04:03:03.187 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3068557312 bytes 2021-11-21T04:03:03.263 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3102778368 bytes 2021-11-21T04:03:03.361 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3155320832 bytes 2021-11-21T04:03:03.409 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3176690688 bytes 2021-11-21T04:03:03.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3218363392 bytes 2021-11-21T04:03:03.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3278534656 bytes 2021-11-21T04:03:03.724 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3354243072 bytes 2021-11-21T04:03:03.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3359925248 bytes 2021-11-21T04:03:03.902 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3441762304 bytes 2021-11-21T04:03:03.996 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3489245184 bytes 2021-11-21T04:03:04.115 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 3564417024 bytes 2021-11-21T04:03:04.174 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 3579245568 bytes 2021-11-21T04:03:04.263 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 3621791744 bytes 2021-11-21T04:03:04.337 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 3654418432 bytes 2021-11-21T04:03:04.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 3723020288 bytes 2021-11-21T04:03:04.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 3827089408 bytes 2021-11-21T04:03:04.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 3859537920 bytes 2021-11-21T04:03:04.723 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 3876882432 bytes 2021-11-21T04:03:04.815 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 3922944000 bytes 2021-11-21T04:03:04.863 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 3924941824 bytes 2021-11-21T04:03:04.919 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 3936574464 bytes 2021-11-21T04:03:04.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 3964479488 bytes 2021-11-21T04:03:05.080 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4019015680 bytes 2021-11-21T04:03:05.134 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4019642368 bytes 2021-11-21T04:03:05.254 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4098793472 bytes 2021-11-21T04:03:05.355 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4155560960 bytes 2021-11-21T04:03:05.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:03:05.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:03:05.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:03:05.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:03:05.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:03:05.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_9 2021-11-21T04:03:05.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_9 snapshot 128M 2021-11-21T04:03:05.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:05.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:05.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:05.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:05.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_9 2021-11-21T04:03:05.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:05.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:03:05.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:03:05.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:05.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_9 128M 2021-11-21T04:03:05.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:05.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:05.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:05.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:05.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_9 2021-11-21T04:03:05.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:05.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:03:05.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:03:05.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:03:05.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:05.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_9 2021-11-21T04:03:05.478 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:03:05.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_9 snapshot 2021-11-21T04:03:05.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:05.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:05.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_9 2021-11-21T04:03:05.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:03:05.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_9 snapshot 2021-11-21T04:03:06.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:03:06.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:03:06.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_9 2021-11-21T04:03:06.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:06.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:06.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_9 2021-11-21T04:03:06.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:03:06.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=9 2021-11-21T04:03:06.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:03:06.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 9s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_9 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:03:06.601 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 60685312 bytes 2021-11-21T04:03:06.697 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 115858432 bytes 2021-11-21T04:03:06.820 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 151015424 bytes 2021-11-21T04:03:06.902 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 191845376 bytes 2021-11-21T04:03:07.017 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 250599424 bytes 2021-11-21T04:03:07.077 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 263794688 bytes 2021-11-21T04:03:07.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 341039104 bytes 2021-11-21T04:03:07.277 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 380189696 bytes 2021-11-21T04:03:07.417 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 479593472 bytes 2021-11-21T04:03:07.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 517176320 bytes 2021-11-21T04:03:07.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 554899456 bytes 2021-11-21T04:03:07.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 653238272 bytes 2021-11-21T04:03:07.798 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 678477824 bytes 2021-11-21T04:03:07.866 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 700086272 bytes 2021-11-21T04:03:07.911 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 703080448 bytes 2021-11-21T04:03:08.000 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 761317376 bytes 2021-11-21T04:03:08.106 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 818206720 bytes 2021-11-21T04:03:08.191 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 858343424 bytes 2021-11-21T04:03:08.275 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 921993216 bytes 2021-11-21T04:03:08.366 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 958900224 bytes 2021-11-21T04:03:08.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 1003312128 bytes 2021-11-21T04:03:08.604 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 1101937664 bytes 2021-11-21T04:03:08.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1174238208 bytes 2021-11-21T04:03:08.885 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1291490304 bytes 2021-11-21T04:03:08.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1360503808 bytes 2021-11-21T04:03:09.074 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1397889024 bytes 2021-11-21T04:03:09.142 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1423170560 bytes 2021-11-21T04:03:09.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1470247936 bytes 2021-11-21T04:03:09.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1506051072 bytes 2021-11-21T04:03:09.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1555821568 bytes 2021-11-21T04:03:09.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1564324864 bytes 2021-11-21T04:03:09.523 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1599538176 bytes 2021-11-21T04:03:09.583 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1611833344 bytes 2021-11-21T04:03:09.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1612445696 bytes 2021-11-21T04:03:09.705 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1646259200 bytes 2021-11-21T04:03:09.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1667476480 bytes 2021-11-21T04:03:09.846 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1703738368 bytes 2021-11-21T04:03:09.957 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1773040640 bytes 2021-11-21T04:03:10.058 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1852375040 bytes 2021-11-21T04:03:10.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1919909888 bytes 2021-11-21T04:03:10.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1960442880 bytes 2021-11-21T04:03:10.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 2076420096 bytes 2021-11-21T04:03:10.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 2122248192 bytes 2021-11-21T04:03:10.696 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 2209246208 bytes 2021-11-21T04:03:10.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 2209857536 bytes 2021-11-21T04:03:10.891 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 2299959296 bytes 2021-11-21T04:03:10.942 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 2309211136 bytes 2021-11-21T04:03:11.042 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 2369712128 bytes 2021-11-21T04:03:11.126 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2407630848 bytes 2021-11-21T04:03:11.218 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2455737344 bytes 2021-11-21T04:03:11.299 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2494274560 bytes 2021-11-21T04:03:11.393 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2567365632 bytes 2021-11-21T04:03:11.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2613411840 bytes 2021-11-21T04:03:11.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2659204096 bytes 2021-11-21T04:03:11.658 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2687924224 bytes 2021-11-21T04:03:11.827 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2783228928 bytes 2021-11-21T04:03:11.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2807213056 bytes 2021-11-21T04:03:11.953 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2824955904 bytes 2021-11-21T04:03:12.052 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2885962752 bytes 2021-11-21T04:03:12.133 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2922654720 bytes 2021-11-21T04:03:12.183 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2927928320 bytes 2021-11-21T04:03:12.241 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2942689280 bytes 2021-11-21T04:03:12.309 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2959826944 bytes 2021-11-21T04:03:12.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 3050494976 bytes 2021-11-21T04:03:12.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 3130915840 bytes 2021-11-21T04:03:12.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 3188913152 bytes 2021-11-21T04:03:12.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 3209973760 bytes 2021-11-21T04:03:12.819 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 3246109696 bytes 2021-11-21T04:03:12.888 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 3266086912 bytes 2021-11-21T04:03:12.979 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 3325326336 bytes 2021-11-21T04:03:13.049 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 3347273728 bytes 2021-11-21T04:03:13.121 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 3376247808 bytes 2021-11-21T04:03:13.258 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3479842816 bytes 2021-11-21T04:03:13.367 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3546701824 bytes 2021-11-21T04:03:13.423 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3557374976 bytes 2021-11-21T04:03:13.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3599970304 bytes 2021-11-21T04:03:13.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3665976320 bytes 2021-11-21T04:03:13.686 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3690516480 bytes 2021-11-21T04:03:13.790 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3751531520 bytes 2021-11-21T04:03:13.876 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3788773376 bytes 2021-11-21T04:03:13.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3850848256 bytes 2021-11-21T04:03:14.063 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3887875072 bytes 2021-11-21T04:03:14.133 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3914597376 bytes 2021-11-21T04:03:14.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3921184768 bytes 2021-11-21T04:03:14.256 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3946395648 bytes 2021-11-21T04:03:14.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3966821376 bytes 2021-11-21T04:03:14.398 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3996848128 bytes 2021-11-21T04:03:14.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 4036004864 bytes 2021-11-21T04:03:14.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 4101846016 bytes 2021-11-21T04:03:14.608 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.6667110403811345) > weight (0.25) 2021-11-21T04:03:14.608 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.2526006197195869) > weight (0.25) 2021-11-21T04:03:14.608 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.2 2021-11-21T04:03:14.609 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Sent signal 15 2021-11-21T04:03:14.610 INFO:tasks.rbd_mirror_thrash:waiting for 6 secs before reviving daemons 2021-11-21T04:03:14.610 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.gibba043.stderr:2021-11-21T04:03:14.611+0000 7fe7bb651700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 (PID: 35160) UID: 1000 2021-11-21T04:03:14.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 4114781184 bytes 2021-11-21T04:03:14.723 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 4124467200 bytes 2021-11-21T04:03:14.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 4137001984 bytes 2021-11-21T04:03:14.810 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.gibba043.stderr:daemon-helper: command failed with exit status 1 2021-11-21T04:03:14.867 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 4177956864 bytes 2021-11-21T04:03:14.958 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 4226564096 bytes 2021-11-21T04:03:15.073 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 4298641408 bytes 2021-11-21T04:03:15.175 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 4366352384 bytes 2021-11-21T04:03:15.319 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 4467099648 bytes 2021-11-21T04:03:15.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 4495294464 bytes 2021-11-21T04:03:15.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:03:15.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:03:15.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:03:15.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:03:15.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:03:15.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_10 2021-11-21T04:03:15.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_10 snapshot 128M 2021-11-21T04:03:15.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:15.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:15.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:15.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:15.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_10 2021-11-21T04:03:15.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:15.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:03:15.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:03:15.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:15.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_10 128M 2021-11-21T04:03:15.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:15.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:15.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:15.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:15.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_10 2021-11-21T04:03:15.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:15.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:03:15.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:03:15.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:03:15.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:15.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_10 2021-11-21T04:03:15.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:03:15.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_10 snapshot 2021-11-21T04:03:15.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:15.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:15.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_10 2021-11-21T04:03:15.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:03:15.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_10 snapshot 2021-11-21T04:03:16.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:03:16.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:03:16.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_10 2021-11-21T04:03:16.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:16.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:16.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_10 2021-11-21T04:03:16.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:03:16.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=8 2021-11-21T04:03:16.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:03:16.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 8s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_10 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:03:16.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 27401216 bytes 2021-11-21T04:03:16.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 75423744 bytes 2021-11-21T04:03:16.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 136208384 bytes 2021-11-21T04:03:16.807 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 147910656 bytes 2021-11-21T04:03:16.942 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 242383872 bytes 2021-11-21T04:03:17.043 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 309143552 bytes 2021-11-21T04:03:17.120 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 343561216 bytes 2021-11-21T04:03:17.219 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 405779456 bytes 2021-11-21T04:03:17.263 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 408064000 bytes 2021-11-21T04:03:17.359 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 468442112 bytes 2021-11-21T04:03:17.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 527628288 bytes 2021-11-21T04:03:17.506 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:2021-11-21T04:03:17.489+0000 7f73e3c50700 -1 reset not still connected to 0x55a3a2a11ad0 2021-11-21T04:03:17.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 564441088 bytes 2021-11-21T04:03:17.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 577521664 bytes 2021-11-21T04:03:17.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 600166400 bytes 2021-11-21T04:03:17.694 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 600779776 bytes 2021-11-21T04:03:17.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 652877824 bytes 2021-11-21T04:03:17.886 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 712232960 bytes 2021-11-21T04:03:17.936 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 720783360 bytes 2021-11-21T04:03:18.055 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 803638272 bytes 2021-11-21T04:03:18.170 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 878734336 bytes 2021-11-21T04:03:18.270 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 937609216 bytes 2021-11-21T04:03:18.345 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 969949184 bytes 2021-11-21T04:03:18.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1037835264 bytes 2021-11-21T04:03:18.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1069551616 bytes 2021-11-21T04:03:18.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1076684800 bytes 2021-11-21T04:03:18.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1087269888 bytes 2021-11-21T04:03:18.722 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1140349952 bytes 2021-11-21T04:03:18.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1156199424 bytes 2021-11-21T04:03:18.844 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1176821760 bytes 2021-11-21T04:03:18.943 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1230817280 bytes 2021-11-21T04:03:19.066 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1304818688 bytes 2021-11-21T04:03:19.131 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1339212800 bytes 2021-11-21T04:03:19.255 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1416873984 bytes 2021-11-21T04:03:19.314 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1435320320 bytes 2021-11-21T04:03:19.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1542773760 bytes 2021-11-21T04:03:19.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1667662848 bytes 2021-11-21T04:03:19.684 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1692077056 bytes 2021-11-21T04:03:19.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1718594560 bytes 2021-11-21T04:03:19.819 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1743368192 bytes 2021-11-21T04:03:19.932 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1806083072 bytes 2021-11-21T04:03:19.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1812986880 bytes 2021-11-21T04:03:20.077 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1856701440 bytes 2021-11-21T04:03:20.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1918412800 bytes 2021-11-21T04:03:20.245 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1939074048 bytes 2021-11-21T04:03:20.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1998990336 bytes 2021-11-21T04:03:20.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 2043756544 bytes 2021-11-21T04:03:20.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 2122191872 bytes 2021-11-21T04:03:20.611 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.2 2021-11-21T04:03:20.611 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T04:03:20.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-21T04:03:20.612 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.2 2021-11-21T04:03:20.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Restarting daemon 2021-11-21T04:03:20.613 DEBUG:teuthology.orchestra.run.gibba043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 2021-11-21T04:03:20.730 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Started 2021-11-21T04:03:20.730 INFO:tasks.rbd_mirror_thrash:waiting for 113 secs before thrashing 2021-11-21T04:03:20.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 2168453120 bytes 2021-11-21T04:03:20.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2222058496 bytes 2021-11-21T04:03:20.845 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2294230016 bytes 2021-11-21T04:03:20.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2389601280 bytes 2021-11-21T04:03:21.084 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2459907072 bytes 2021-11-21T04:03:21.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2490194944 bytes 2021-11-21T04:03:21.259 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2549337088 bytes 2021-11-21T04:03:21.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2582307840 bytes 2021-11-21T04:03:21.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2636220416 bytes 2021-11-21T04:03:21.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2679671808 bytes 2021-11-21T04:03:21.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2778506240 bytes 2021-11-21T04:03:21.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2789582848 bytes 2021-11-21T04:03:21.832 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2873161728 bytes 2021-11-21T04:03:21.964 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2948006912 bytes 2021-11-21T04:03:22.060 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 3000861696 bytes 2021-11-21T04:03:22.140 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 3042381824 bytes 2021-11-21T04:03:22.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 3151281152 bytes 2021-11-21T04:03:22.406 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 3228776448 bytes 2021-11-21T04:03:22.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 3299190784 bytes 2021-11-21T04:03:22.601 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 3349267456 bytes 2021-11-21T04:03:22.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 3402919936 bytes 2021-11-21T04:03:22.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 3441921024 bytes 2021-11-21T04:03:22.888 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 3492527104 bytes 2021-11-21T04:03:22.989 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 3554993152 bytes 2021-11-21T04:03:23.056 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 3578901504 bytes 2021-11-21T04:03:23.118 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3620354048 bytes 2021-11-21T04:03:23.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3748114432 bytes 2021-11-21T04:03:23.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3785533440 bytes 2021-11-21T04:03:23.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3816126464 bytes 2021-11-21T04:03:23.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3867923456 bytes 2021-11-21T04:03:23.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3887109120 bytes 2021-11-21T04:03:23.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3897503744 bytes 2021-11-21T04:03:23.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3921178624 bytes 2021-11-21T04:03:23.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3960557568 bytes 2021-11-21T04:03:23.948 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 4042933248 bytes 2021-11-21T04:03:24.031 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 4081091584 bytes 2021-11-21T04:03:24.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 4104072192 bytes 2021-11-21T04:03:24.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 4210032640 bytes 2021-11-21T04:03:24.298 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 4217822208 bytes 2021-11-21T04:03:24.357 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 4231612416 bytes 2021-11-21T04:03:24.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 4232218624 bytes 2021-11-21T04:03:24.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:03:24.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:03:24.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:03:24.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:03:24.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:03:24.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_11 2021-11-21T04:03:24.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_11 snapshot 128M 2021-11-21T04:03:24.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:24.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:24.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:24.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:24.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_11 2021-11-21T04:03:24.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:24.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:03:24.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:03:24.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:24.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_11 128M 2021-11-21T04:03:24.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:24.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:24.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:24.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:24.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_11 2021-11-21T04:03:24.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:24.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:03:24.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:03:24.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:03:24.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:24.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_11 2021-11-21T04:03:24.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:03:24.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_11 snapshot 2021-11-21T04:03:24.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:24.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:24.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_11 2021-11-21T04:03:24.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:03:24.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_11 snapshot 2021-11-21T04:03:24.616 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:03:24.625 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:03:24.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_11 2021-11-21T04:03:24.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:24.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:24.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_11 2021-11-21T04:03:24.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:03:24.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=10 2021-11-21T04:03:24.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:03:24.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 10s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_11 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:03:24.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 56681472 bytes 2021-11-21T04:03:24.865 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 90411008 bytes 2021-11-21T04:03:24.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 170315776 bytes 2021-11-21T04:03:25.076 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 249041920 bytes 2021-11-21T04:03:25.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 303346688 bytes 2021-11-21T04:03:25.262 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 340454400 bytes 2021-11-21T04:03:25.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 378926080 bytes 2021-11-21T04:03:25.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 424558592 bytes 2021-11-21T04:03:25.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 471718912 bytes 2021-11-21T04:03:25.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 507121664 bytes 2021-11-21T04:03:25.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 532697088 bytes 2021-11-21T04:03:25.763 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 584427520 bytes 2021-11-21T04:03:25.853 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 630549504 bytes 2021-11-21T04:03:25.903 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 637756416 bytes 2021-11-21T04:03:25.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 674170880 bytes 2021-11-21T04:03:26.105 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 756548608 bytes 2021-11-21T04:03:26.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 840715264 bytes 2021-11-21T04:03:26.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 879688704 bytes 2021-11-21T04:03:26.391 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 936935424 bytes 2021-11-21T04:03:26.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 977454080 bytes 2021-11-21T04:03:26.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 1017945088 bytes 2021-11-21T04:03:26.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 1077701632 bytes 2021-11-21T04:03:26.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1123589120 bytes 2021-11-21T04:03:26.956 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1223477248 bytes 2021-11-21T04:03:27.053 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1281709056 bytes 2021-11-21T04:03:27.201 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1392069632 bytes 2021-11-21T04:03:27.341 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1495158784 bytes 2021-11-21T04:03:27.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1595196416 bytes 2021-11-21T04:03:27.630 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1612486656 bytes 2021-11-21T04:03:27.674 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1636027392 bytes 2021-11-21T04:03:27.800 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1699042304 bytes 2021-11-21T04:03:27.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1738113024 bytes 2021-11-21T04:03:27.948 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1763300352 bytes 2021-11-21T04:03:28.023 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1791757312 bytes 2021-11-21T04:03:28.088 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1814252544 bytes 2021-11-21T04:03:28.150 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1831330816 bytes 2021-11-21T04:03:28.196 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1831944192 bytes 2021-11-21T04:03:28.243 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1844325376 bytes 2021-11-21T04:03:28.315 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1863075840 bytes 2021-11-21T04:03:28.362 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1863675904 bytes 2021-11-21T04:03:28.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1881079808 bytes 2021-11-21T04:03:28.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1884994560 bytes 2021-11-21T04:03:28.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1947369472 bytes 2021-11-21T04:03:28.673 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1984536576 bytes 2021-11-21T04:03:28.764 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 2035422208 bytes 2021-11-21T04:03:28.830 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 2059913216 bytes 2021-11-21T04:03:28.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 2086270976 bytes 2021-11-21T04:03:28.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 2108596224 bytes 2021-11-21T04:03:29.074 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2164212736 bytes 2021-11-21T04:03:29.135 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2189149184 bytes 2021-11-21T04:03:29.201 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2205641728 bytes 2021-11-21T04:03:29.360 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2317174784 bytes 2021-11-21T04:03:29.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2360788992 bytes 2021-11-21T04:03:29.492 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2377459712 bytes 2021-11-21T04:03:29.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2417826816 bytes 2021-11-21T04:03:29.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2499780608 bytes 2021-11-21T04:03:29.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2510419968 bytes 2021-11-21T04:03:29.825 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2518416384 bytes 2021-11-21T04:03:29.887 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2547856384 bytes 2021-11-21T04:03:29.957 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2560480256 bytes 2021-11-21T04:03:30.051 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2607299584 bytes 2021-11-21T04:03:30.117 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2632044544 bytes 2021-11-21T04:03:30.229 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2705029120 bytes 2021-11-21T04:03:30.283 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2717195264 bytes 2021-11-21T04:03:30.351 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2739951616 bytes 2021-11-21T04:03:30.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2823260160 bytes 2021-11-21T04:03:30.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2868071424 bytes 2021-11-21T04:03:30.617 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2890398720 bytes 2021-11-21T04:03:30.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2897828864 bytes 2021-11-21T04:03:30.759 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2932180992 bytes 2021-11-21T04:03:30.848 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 2978269184 bytes 2021-11-21T04:03:30.918 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 3005076480 bytes 2021-11-21T04:03:31.044 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3084405760 bytes 2021-11-21T04:03:31.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3091597312 bytes 2021-11-21T04:03:31.165 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3113133056 bytes 2021-11-21T04:03:31.259 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3170779136 bytes 2021-11-21T04:03:31.327 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3184953344 bytes 2021-11-21T04:03:31.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3204431872 bytes 2021-11-21T04:03:31.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3249636352 bytes 2021-11-21T04:03:31.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3250254848 bytes 2021-11-21T04:03:31.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3282624512 bytes 2021-11-21T04:03:31.686 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3317879808 bytes 2021-11-21T04:03:31.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3333438464 bytes 2021-11-21T04:03:31.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3348045824 bytes 2021-11-21T04:03:31.940 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3404111872 bytes 2021-11-21T04:03:32.015 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3436483584 bytes 2021-11-21T04:03:32.123 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3518605312 bytes 2021-11-21T04:03:32.206 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3554920448 bytes 2021-11-21T04:03:32.264 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3555548160 bytes 2021-11-21T04:03:32.332 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3582162944 bytes 2021-11-21T04:03:32.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3653670912 bytes 2021-11-21T04:03:32.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3660240896 bytes 2021-11-21T04:03:32.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 3664920576 bytes 2021-11-21T04:03:32.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 3705134080 bytes 2021-11-21T04:03:32.724 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 3744578560 bytes 2021-11-21T04:03:32.827 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 3797832704 bytes 2021-11-21T04:03:32.903 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 3834848256 bytes 2021-11-21T04:03:33.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 3902673920 bytes 2021-11-21T04:03:33.107 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 3950468096 bytes 2021-11-21T04:03:33.172 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 3982635008 bytes 2021-11-21T04:03:33.270 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4030705664 bytes 2021-11-21T04:03:33.357 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4070192128 bytes 2021-11-21T04:03:33.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4099877888 bytes 2021-11-21T04:03:33.492 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4119308288 bytes 2021-11-21T04:03:33.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4177193984 bytes 2021-11-21T04:03:33.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4264273920 bytes 2021-11-21T04:03:33.850 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4339908608 bytes 2021-11-21T04:03:33.898 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4340512768 bytes 2021-11-21T04:03:33.987 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4407510016 bytes 2021-11-21T04:03:34.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4431343616 bytes 2021-11-21T04:03:34.184 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 4545682432 bytes 2021-11-21T04:03:34.282 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 4582376448 bytes 2021-11-21T04:03:34.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 4665018368 bytes 2021-11-21T04:03:34.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 4738588672 bytes 2021-11-21T04:03:34.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 4745721856 bytes 2021-11-21T04:03:34.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:03:34.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:03:34.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:03:34.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:03:34.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:03:34.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_12 2021-11-21T04:03:34.633 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_12 snapshot 128M 2021-11-21T04:03:34.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:34.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:34.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:34.634 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:34.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_12 2021-11-21T04:03:34.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:34.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:03:34.635 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:03:34.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:34.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_12 128M 2021-11-21T04:03:34.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:34.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:34.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:34.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:34.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_12 2021-11-21T04:03:34.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:34.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:03:34.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:03:34.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:03:34.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:34.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_12 2021-11-21T04:03:34.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:03:34.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_12 snapshot 2021-11-21T04:03:34.665 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:34.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:34.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_12 2021-11-21T04:03:34.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:03:34.666 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_12 snapshot 2021-11-21T04:03:35.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:03:35.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:03:35.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_12 2021-11-21T04:03:35.642 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:35.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:35.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_12 2021-11-21T04:03:35.643 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:03:35.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=13 2021-11-21T04:03:35.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:03:35.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 13s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_12 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:03:35.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 39136256 bytes 2021-11-21T04:03:35.860 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 92917760 bytes 2021-11-21T04:03:36.008 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 190816256 bytes 2021-11-21T04:03:36.052 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 191405056 bytes 2021-11-21T04:03:36.116 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 211170304 bytes 2021-11-21T04:03:36.172 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 223792128 bytes 2021-11-21T04:03:36.236 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 247363584 bytes 2021-11-21T04:03:36.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 299681792 bytes 2021-11-21T04:03:36.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 332446720 bytes 2021-11-21T04:03:36.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 339481600 bytes 2021-11-21T04:03:36.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 372185088 bytes 2021-11-21T04:03:36.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 405971968 bytes 2021-11-21T04:03:36.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 420630528 bytes 2021-11-21T04:03:36.717 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 451768320 bytes 2021-11-21T04:03:36.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 458984448 bytes 2021-11-21T04:03:36.876 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 518218752 bytes 2021-11-21T04:03:36.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 554703872 bytes 2021-11-21T04:03:36.995 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 555345920 bytes 2021-11-21T04:03:37.042 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 559844352 bytes 2021-11-21T04:03:37.151 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 626492416 bytes 2021-11-21T04:03:37.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 703449088 bytes 2021-11-21T04:03:37.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 722350080 bytes 2021-11-21T04:03:37.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 780181504 bytes 2021-11-21T04:03:37.687 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 813443072 bytes 2021-11-21T04:03:37.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 854541312 bytes 2021-11-21T04:03:37.861 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 902201344 bytes 2021-11-21T04:03:37.928 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 932282368 bytes 2021-11-21T04:03:38.207 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 981427200 bytes 2021-11-21T04:03:38.255 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 988847104 bytes 2021-11-21T04:03:38.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1010913280 bytes 2021-11-21T04:03:38.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1029704704 bytes 2021-11-21T04:03:38.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1072052224 bytes 2021-11-21T04:03:38.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1130313728 bytes 2021-11-21T04:03:38.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1171953664 bytes 2021-11-21T04:03:38.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1181740032 bytes 2021-11-21T04:03:38.763 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1201077248 bytes 2021-11-21T04:03:38.852 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1241537536 bytes 2021-11-21T04:03:38.904 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1249675264 bytes 2021-11-21T04:03:39.047 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1352922112 bytes 2021-11-21T04:03:39.130 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1394196480 bytes 2021-11-21T04:03:39.212 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1433151488 bytes 2021-11-21T04:03:39.276 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1463400448 bytes 2021-11-21T04:03:39.402 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1542495232 bytes 2021-11-21T04:03:39.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1623580672 bytes 2021-11-21T04:03:39.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1710954496 bytes 2021-11-21T04:03:39.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1753876480 bytes 2021-11-21T04:03:39.801 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1776482304 bytes 2021-11-21T04:03:39.855 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 1788413952 bytes 2021-11-21T04:03:39.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 1834310656 bytes 2021-11-21T04:03:40.061 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 1911150592 bytes 2021-11-21T04:03:40.075 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:2021-11-21T04:03:40.076+0000 7f73eaaa3700 -1 bdev(0x55a39e826e00 /var/lib/ceph/osd/cluster2-0/block) _aio_thread got r=-28 ((28) No space left on device) 2021-11-21T04:03:40.076 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f73eaaa3700 time 2021-11-21T04:03:40.077306+0000 2021-11-21T04:03:40.076 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: 575: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-21T04:03:40.077 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:03:40.077 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55a3925556fe] 2021-11-21T04:03:40.077 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2: (KernelDevice::_aio_thread()+0x125e) [0x55a392c2b9ce] 2021-11-21T04:03:40.077 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a392c36721] 2021-11-21T04:03:40.078 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 4: (()+0x814a) [0x7f73f58f614a] 2021-11-21T04:03:40.078 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 5: (clone()+0x43) [0x7f73f462df23] 2021-11-21T04:03:40.078 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:2021-11-21T04:03:40.077+0000 7f73eaaa3700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f73eaaa3700 time 2021-11-21T04:03:40.077306+0000 2021-11-21T04:03:40.078 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: 575: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-21T04:03:40.079 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2021-11-21T04:03:40.079 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:03:40.079 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55a3925556fe] 2021-11-21T04:03:40.079 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2: (KernelDevice::_aio_thread()+0x125e) [0x55a392c2b9ce] 2021-11-21T04:03:40.080 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a392c36721] 2021-11-21T04:03:40.080 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 4: (()+0x814a) [0x7f73f58f614a] 2021-11-21T04:03:40.080 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 5: (clone()+0x43) [0x7f73f462df23] 2021-11-21T04:03:40.080 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2021-11-21T04:03:40.080 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:*** Caught signal (Aborted) ** 2021-11-21T04:03:40.081 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: in thread 7f73eaaa3700 thread_name:bstore_aio 2021-11-21T04:03:40.081 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:03:40.082 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 1: (()+0x12b20) [0x7f73f5900b20] 2021-11-21T04:03:40.082 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2: (gsignal()+0x10f) [0x7f73f45687ff] 2021-11-21T04:03:40.082 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 3: (abort()+0x127) [0x7f73f4552c35] 2021-11-21T04:03:40.082 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b6) [0x55a3925557cf] 2021-11-21T04:03:40.083 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 5: (KernelDevice::_aio_thread()+0x125e) [0x55a392c2b9ce] 2021-11-21T04:03:40.083 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a392c36721] 2021-11-21T04:03:40.083 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 7: (()+0x814a) [0x7f73f58f614a] 2021-11-21T04:03:40.083 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 8: (clone()+0x43) [0x7f73f462df23] 2021-11-21T04:03:40.084 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:2021-11-21T04:03:40.078+0000 7f73eaaa3700 -1 *** Caught signal (Aborted) ** 2021-11-21T04:03:40.084 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: in thread 7f73eaaa3700 thread_name:bstore_aio 2021-11-21T04:03:40.084 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2021-11-21T04:03:40.084 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:03:40.085 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 1: (()+0x12b20) [0x7f73f5900b20] 2021-11-21T04:03:40.085 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2: (gsignal()+0x10f) [0x7f73f45687ff] 2021-11-21T04:03:40.085 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 3: (abort()+0x127) [0x7f73f4552c35] 2021-11-21T04:03:40.085 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b6) [0x55a3925557cf] 2021-11-21T04:03:40.086 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 5: (KernelDevice::_aio_thread()+0x125e) [0x55a392c2b9ce] 2021-11-21T04:03:40.086 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a392c36721] 2021-11-21T04:03:40.086 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 7: (()+0x814a) [0x7f73f58f614a] 2021-11-21T04:03:40.086 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 8: (clone()+0x43) [0x7f73f462df23] 2021-11-21T04:03:40.086 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-21T04:03:40.087 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2021-11-21T04:03:40.088 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: -293> 2021-11-21T04:03:40.076+0000 7f73eaaa3700 -1 bdev(0x55a39e826e00 /var/lib/ceph/osd/cluster2-0/block) _aio_thread got r=-28 ((28) No space left on device) 2021-11-21T04:03:40.088 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: -111> 2021-11-21T04:03:40.077+0000 7f73eaaa3700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f73eaaa3700 time 2021-11-21T04:03:40.077306+0000 2021-11-21T04:03:40.089 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: 575: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-21T04:03:40.089 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2021-11-21T04:03:40.089 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:03:40.089 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55a3925556fe] 2021-11-21T04:03:40.090 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2: (KernelDevice::_aio_thread()+0x125e) [0x55a392c2b9ce] 2021-11-21T04:03:40.090 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a392c36721] 2021-11-21T04:03:40.090 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 4: (()+0x814a) [0x7f73f58f614a] 2021-11-21T04:03:40.090 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 5: (clone()+0x43) [0x7f73f462df23] 2021-11-21T04:03:40.091 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2021-11-21T04:03:40.091 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 0> 2021-11-21T04:03:40.078+0000 7f73eaaa3700 -1 *** Caught signal (Aborted) ** 2021-11-21T04:03:40.091 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: in thread 7f73eaaa3700 thread_name:bstore_aio 2021-11-21T04:03:40.091 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2021-11-21T04:03:40.092 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:03:40.092 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 1: (()+0x12b20) [0x7f73f5900b20] 2021-11-21T04:03:40.092 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2: (gsignal()+0x10f) [0x7f73f45687ff] 2021-11-21T04:03:40.092 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 3: (abort()+0x127) [0x7f73f4552c35] 2021-11-21T04:03:40.092 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b6) [0x55a3925557cf] 2021-11-21T04:03:40.093 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 5: (KernelDevice::_aio_thread()+0x125e) [0x55a392c2b9ce] 2021-11-21T04:03:40.093 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a392c36721] 2021-11-21T04:03:40.093 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 7: (()+0x814a) [0x7f73f58f614a] 2021-11-21T04:03:40.093 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 8: (clone()+0x43) [0x7f73f462df23] 2021-11-21T04:03:40.094 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-21T04:03:40.094 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2021-11-21T04:03:40.097 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: -529> 2021-11-21T04:03:40.076+0000 7f73eaaa3700 -1 bdev(0x55a39e826e00 /var/lib/ceph/osd/cluster2-0/block) _aio_thread got r=-28 ((28) No space left on device) 2021-11-21T04:03:40.097 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: -347> 2021-11-21T04:03:40.077+0000 7f73eaaa3700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f73eaaa3700 time 2021-11-21T04:03:40.077306+0000 2021-11-21T04:03:40.097 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: 575: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-21T04:03:40.098 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2021-11-21T04:03:40.098 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:03:40.098 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55a3925556fe] 2021-11-21T04:03:40.098 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2: (KernelDevice::_aio_thread()+0x125e) [0x55a392c2b9ce] 2021-11-21T04:03:40.098 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a392c36721] 2021-11-21T04:03:40.099 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 4: (()+0x814a) [0x7f73f58f614a] 2021-11-21T04:03:40.099 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 5: (clone()+0x43) [0x7f73f462df23] 2021-11-21T04:03:40.099 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2021-11-21T04:03:40.099 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: -236> 2021-11-21T04:03:40.078+0000 7f73eaaa3700 -1 *** Caught signal (Aborted) ** 2021-11-21T04:03:40.100 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: in thread 7f73eaaa3700 thread_name:bstore_aio 2021-11-21T04:03:40.100 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2021-11-21T04:03:40.100 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:03:40.100 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 1: (()+0x12b20) [0x7f73f5900b20] 2021-11-21T04:03:40.100 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2: (gsignal()+0x10f) [0x7f73f45687ff] 2021-11-21T04:03:40.101 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 3: (abort()+0x127) [0x7f73f4552c35] 2021-11-21T04:03:40.101 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b6) [0x55a3925557cf] 2021-11-21T04:03:40.101 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 5: (KernelDevice::_aio_thread()+0x125e) [0x55a392c2b9ce] 2021-11-21T04:03:40.101 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a392c36721] 2021-11-21T04:03:40.102 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 7: (()+0x814a) [0x7f73f58f614a] 2021-11-21T04:03:40.102 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 8: (clone()+0x43) [0x7f73f462df23] 2021-11-21T04:03:40.102 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-21T04:03:40.102 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr: 2021-11-21T04:03:40.293 INFO:tasks.ceph.cluster2.osd.0.gibba043.stderr:daemon-helper: command failed with exit status 5 2021-11-21T04:03:41.664 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 1920504832 bytes 2021-11-21T04:03:41.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 1992515584 bytes 2021-11-21T04:03:41.821 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2045497344 bytes 2021-11-21T04:03:41.929 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2091077632 bytes 2021-11-21T04:03:41.978 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2102796288 bytes 2021-11-21T04:03:42.053 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2151895040 bytes 2021-11-21T04:03:42.122 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2189159424 bytes 2021-11-21T04:03:42.188 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2236361728 bytes 2021-11-21T04:03:42.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2247157760 bytes 2021-11-21T04:03:42.299 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2292490240 bytes 2021-11-21T04:03:42.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2403691520 bytes 2021-11-21T04:03:42.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2472245248 bytes 2021-11-21T04:03:42.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2507651072 bytes 2021-11-21T04:03:42.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2538288128 bytes 2021-11-21T04:03:42.694 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2591038464 bytes 2021-11-21T04:03:42.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2647322624 bytes 2021-11-21T04:03:42.851 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2700996608 bytes 2021-11-21T04:03:42.915 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2735835136 bytes 2021-11-21T04:03:42.966 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2760049664 bytes 2021-11-21T04:03:43.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 2809511936 bytes 2021-11-21T04:03:43.102 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 2866221056 bytes 2021-11-21T04:03:43.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 2893990912 bytes 2021-11-21T04:03:43.207 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 2912760832 bytes 2021-11-21T04:03:43.281 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 2962273280 bytes 2021-11-21T04:03:43.340 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3008592896 bytes 2021-11-21T04:03:43.412 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3042030592 bytes 2021-11-21T04:03:43.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~0s 2021-11-21T04:03:43.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3111214080 bytes 2021-11-21T04:03:43.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3111871488 bytes 2021-11-21T04:03:43.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3187305472 bytes 2021-11-21T04:03:43.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3245243392 bytes 2021-11-21T04:03:43.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3272361984 bytes 2021-11-21T04:03:43.859 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3353409536 bytes 2021-11-21T04:03:43.913 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3375462400 bytes 2021-11-21T04:03:43.958 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3396435968 bytes 2021-11-21T04:03:44.052 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3482681344 bytes 2021-11-21T04:03:44.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3584803840 bytes 2021-11-21T04:03:44.264 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3680778240 bytes 2021-11-21T04:03:44.358 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3755430912 bytes 2021-11-21T04:03:44.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3807582208 bytes 2021-11-21T04:03:44.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3857062912 bytes 2021-11-21T04:03:44.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3907112960 bytes 2021-11-21T04:03:44.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3975990272 bytes 2021-11-21T04:03:44.735 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 4010499072 bytes 2021-11-21T04:03:44.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 4032142336 bytes 2021-11-21T04:03:44.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 4073656320 bytes 2021-11-21T04:03:45.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 4121600000 bytes 2021-11-21T04:03:45.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 4196315136 bytes 2021-11-21T04:03:45.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 4206772224 bytes 2021-11-21T04:03:45.737 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 4287623168 bytes 2021-11-21T04:03:45.797 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 4325641216 bytes 2021-11-21T04:03:45.849 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4348351488 bytes 2021-11-21T04:03:45.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4384220160 bytes 2021-11-21T04:03:45.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4432203776 bytes 2021-11-21T04:03:46.056 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4490461184 bytes 2021-11-21T04:03:46.133 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4567622656 bytes 2021-11-21T04:03:46.193 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4608158720 bytes 2021-11-21T04:03:46.281 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4669059072 bytes 2021-11-21T04:03:46.362 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4739030016 bytes 2021-11-21T04:03:46.396 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4739651584 bytes 2021-11-21T04:03:46.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4791926784 bytes 2021-11-21T04:03:46.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 4831972352 bytes 2021-11-21T04:03:46.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 4890084352 bytes 2021-11-21T04:03:46.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 4975819776 bytes 2021-11-21T04:03:46.790 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 5070247936 bytes 2021-11-21T04:03:46.887 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 5077595136 bytes 2021-11-21T04:03:46.927 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 5082862592 bytes 2021-11-21T04:03:46.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 5094557696 bytes 2021-11-21T04:03:47.041 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 5146192896 bytes 2021-11-21T04:03:47.133 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 5232109568 bytes 2021-11-21T04:03:47.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 5250985984 bytes 2021-11-21T04:03:47.258 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 5303521280 bytes 2021-11-21T04:03:47.296 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 5304143872 bytes 2021-11-21T04:03:47.381 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 5367810048 bytes 2021-11-21T04:03:47.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 5395465216 bytes 2021-11-21T04:03:47.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 5443394560 bytes 2021-11-21T04:03:47.557 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12600 IOs, 5490500608 bytes 2021-11-21T04:03:47.661 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12700 IOs, 5558353920 bytes 2021-11-21T04:03:47.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12800 IOs, 5609441280 bytes 2021-11-21T04:03:47.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12900 IOs, 5610052608 bytes 2021-11-21T04:03:47.843 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13000 IOs, 5658490880 bytes 2021-11-21T04:03:47.883 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13100 IOs, 5659119616 bytes 2021-11-21T04:03:47.945 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13200 IOs, 5706541056 bytes 2021-11-21T04:03:47.990 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13300 IOs, 5707174912 bytes 2021-11-21T04:03:48.089 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13400 IOs, 5807556608 bytes 2021-11-21T04:03:48.175 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13500 IOs, 5877513216 bytes 2021-11-21T04:03:48.231 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13600 IOs, 5905799168 bytes 2021-11-21T04:03:48.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13700 IOs, 5961410560 bytes 2021-11-21T04:03:48.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13800 IOs, 6022166528 bytes 2021-11-21T04:03:48.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13900 IOs, 6059676672 bytes 2021-11-21T04:03:48.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14000 IOs, 6077782016 bytes 2021-11-21T04:03:48.512 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.6841959290788507) > weight (0.25) 2021-11-21T04:03:48.513 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.9151924287654505) > weight (0.25) 2021-11-21T04:03:48.513 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.2 with skip (0.6854241598481828) > weight (0.25) 2021-11-21T04:03:48.513 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.3 with skip (0.8137804785449821) > weight (0.25) 2021-11-21T04:03:48.513 INFO:tasks.rbd_mirror_thrash:waiting for 113 secs before thrashing 2021-11-21T04:03:48.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14100 IOs, 6133852160 bytes 2021-11-21T04:03:48.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:03:48.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:03:48.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:03:48.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:03:48.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:03:48.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_13 2021-11-21T04:03:48.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_13 snapshot 128M 2021-11-21T04:03:48.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:48.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:48.651 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:48.651 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:48.651 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_13 2021-11-21T04:03:48.651 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:48.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:03:48.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:03:48.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:48.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_13 128M 2021-11-21T04:03:48.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:48.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:48.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:48.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:48.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_13 2021-11-21T04:03:48.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:48.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:03:48.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:03:48.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:03:48.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:48.656 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_13 2021-11-21T04:03:48.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:03:48.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_13 snapshot 2021-11-21T04:03:48.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:48.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:48.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_13 2021-11-21T04:03:48.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:03:48.681 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_13 snapshot 2021-11-21T04:03:48.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~5s 2021-11-21T04:03:49.675 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:03:49.684 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:03:49.684 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_13 2021-11-21T04:03:49.684 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:49.684 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:49.685 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_13 2021-11-21T04:03:49.685 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:03:49.685 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=7 2021-11-21T04:03:49.686 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:03:49.686 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 7s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_13 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:03:49.811 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 78123008 bytes 2021-11-21T04:03:49.861 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 108952576 bytes 2021-11-21T04:03:49.943 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 212667392 bytes 2021-11-21T04:03:50.005 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 253679616 bytes 2021-11-21T04:03:50.038 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 258522112 bytes 2021-11-21T04:03:50.079 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 272645120 bytes 2021-11-21T04:03:50.118 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 299992064 bytes 2021-11-21T04:03:50.167 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 346722304 bytes 2021-11-21T04:03:50.261 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 444916736 bytes 2021-11-21T04:03:50.305 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 468803584 bytes 2021-11-21T04:03:50.358 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 508270592 bytes 2021-11-21T04:03:50.421 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 580488192 bytes 2021-11-21T04:03:50.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 581341184 bytes 2021-11-21T04:03:50.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 661041152 bytes 2021-11-21T04:03:50.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 680054784 bytes 2021-11-21T04:03:50.636 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 705691648 bytes 2021-11-21T04:03:50.699 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 766372864 bytes 2021-11-21T04:03:50.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 842126336 bytes 2021-11-21T04:03:50.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 897404928 bytes 2021-11-21T04:03:50.888 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 945019904 bytes 2021-11-21T04:03:50.931 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 966781952 bytes 2021-11-21T04:03:50.990 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 1020476416 bytes 2021-11-21T04:03:51.065 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1096584192 bytes 2021-11-21T04:03:51.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1130770432 bytes 2021-11-21T04:03:51.161 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1162472448 bytes 2021-11-21T04:03:51.210 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1189735424 bytes 2021-11-21T04:03:51.264 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1232605184 bytes 2021-11-21T04:03:51.320 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1284130816 bytes 2021-11-21T04:03:51.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1349023744 bytes 2021-11-21T04:03:51.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1430773760 bytes 2021-11-21T04:03:51.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1443267584 bytes 2021-11-21T04:03:51.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1465139200 bytes 2021-11-21T04:03:51.603 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1493305344 bytes 2021-11-21T04:03:51.659 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1521658880 bytes 2021-11-21T04:03:51.725 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1570385920 bytes 2021-11-21T04:03:51.763 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1582675968 bytes 2021-11-21T04:03:51.814 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1614619648 bytes 2021-11-21T04:03:51.865 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1649591296 bytes 2021-11-21T04:03:51.919 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1661481984 bytes 2021-11-21T04:03:51.951 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1662102528 bytes 2021-11-21T04:03:51.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1669935104 bytes 2021-11-21T04:03:52.059 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1735917568 bytes 2021-11-21T04:03:52.116 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 1782903808 bytes 2021-11-21T04:03:52.152 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 1794574336 bytes 2021-11-21T04:03:52.202 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 1831432192 bytes 2021-11-21T04:03:52.264 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 1911199744 bytes 2021-11-21T04:03:52.309 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 1921446912 bytes 2021-11-21T04:03:52.349 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 1934835712 bytes 2021-11-21T04:03:52.416 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 1996535808 bytes 2021-11-21T04:03:52.471 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2021733376 bytes 2021-11-21T04:03:52.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2102581248 bytes 2021-11-21T04:03:52.595 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2137530368 bytes 2021-11-21T04:03:52.663 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2196591616 bytes 2021-11-21T04:03:52.718 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2234776576 bytes 2021-11-21T04:03:52.813 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2351640576 bytes 2021-11-21T04:03:52.860 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2381615104 bytes 2021-11-21T04:03:52.899 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2410656768 bytes 2021-11-21T04:03:52.991 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2512333824 bytes 2021-11-21T04:03:53.037 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2548514816 bytes 2021-11-21T04:03:53.085 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2565836800 bytes 2021-11-21T04:03:53.138 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2591572992 bytes 2021-11-21T04:03:53.196 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2659566592 bytes 2021-11-21T04:03:53.250 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2679826432 bytes 2021-11-21T04:03:53.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2697895936 bytes 2021-11-21T04:03:53.338 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2719411200 bytes 2021-11-21T04:03:53.401 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 2774464512 bytes 2021-11-21T04:03:53.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 2850197504 bytes 2021-11-21T04:03:53.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 2912418816 bytes 2021-11-21T04:03:53.602 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 2949781504 bytes 2021-11-21T04:03:53.657 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 3007314944 bytes 2021-11-21T04:03:53.707 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 3024173056 bytes 2021-11-21T04:03:53.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 3038034944 bytes 2021-11-21T04:03:53.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3048887296 bytes 2021-11-21T04:03:53.841 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3088635904 bytes 2021-11-21T04:03:53.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3123975168 bytes 2021-11-21T04:03:53.936 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3144856576 bytes 2021-11-21T04:03:53.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3174064128 bytes 2021-11-21T04:03:54.042 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3222524928 bytes 2021-11-21T04:03:54.105 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3283616768 bytes 2021-11-21T04:03:54.162 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3316764672 bytes 2021-11-21T04:03:54.211 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3371614208 bytes 2021-11-21T04:03:54.274 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3401731072 bytes 2021-11-21T04:03:54.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~11s 2021-11-21T04:03:54.315 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3426427904 bytes 2021-11-21T04:03:54.368 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3444632576 bytes 2021-11-21T04:03:54.415 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3473177600 bytes 2021-11-21T04:03:54.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3495506944 bytes 2021-11-21T04:03:54.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3511364608 bytes 2021-11-21T04:03:54.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3581365248 bytes 2021-11-21T04:03:54.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3622980608 bytes 2021-11-21T04:03:54.672 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3641033728 bytes 2021-11-21T04:03:54.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3717165056 bytes 2021-11-21T04:03:54.797 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3749763072 bytes 2021-11-21T04:03:54.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 3761021952 bytes 2021-11-21T04:03:54.890 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 3791663104 bytes 2021-11-21T04:03:54.944 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 3827618816 bytes 2021-11-21T04:03:55.003 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 3864240128 bytes 2021-11-21T04:03:55.063 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 3909436416 bytes 2021-11-21T04:03:55.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 3934825472 bytes 2021-11-21T04:03:55.170 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 3976288256 bytes 2021-11-21T04:03:55.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 4022946816 bytes 2021-11-21T04:03:55.263 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4038398976 bytes 2021-11-21T04:03:55.341 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4111000576 bytes 2021-11-21T04:03:55.394 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4152584192 bytes 2021-11-21T04:03:55.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4206101504 bytes 2021-11-21T04:03:55.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4232169472 bytes 2021-11-21T04:03:55.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4303080448 bytes 2021-11-21T04:03:55.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4343211008 bytes 2021-11-21T04:03:55.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4437386240 bytes 2021-11-21T04:03:55.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4447241216 bytes 2021-11-21T04:03:55.791 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4459398144 bytes 2021-11-21T04:03:55.828 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 4463823872 bytes 2021-11-21T04:03:55.914 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 4556573696 bytes 2021-11-21T04:03:55.947 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 4558179328 bytes 2021-11-21T04:03:56.019 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 4634586112 bytes 2021-11-21T04:03:56.075 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 4686698496 bytes 2021-11-21T04:03:56.139 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 4727867392 bytes 2021-11-21T04:03:56.199 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 4778425344 bytes 2021-11-21T04:03:56.262 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 4833780736 bytes 2021-11-21T04:03:56.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 4888944640 bytes 2021-11-21T04:03:56.371 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 4914922496 bytes 2021-11-21T04:03:56.425 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 4951846912 bytes 2021-11-21T04:03:56.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 4965935104 bytes 2021-11-21T04:03:56.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 5049988096 bytes 2021-11-21T04:03:56.632 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 5150016512 bytes 2021-11-21T04:03:56.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 5162368000 bytes 2021-11-21T04:03:56.689 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:03:56.690 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:03:56.690 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:03:56.690 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:03:56.690 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:03:56.691 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_14 2021-11-21T04:03:56.691 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_14 snapshot 128M 2021-11-21T04:03:56.691 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:56.691 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:56.692 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:56.692 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:56.692 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_14 2021-11-21T04:03:56.692 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:56.693 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:03:56.693 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:03:56.693 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:56.693 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_14 128M 2021-11-21T04:03:56.694 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:56.694 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:56.694 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:56.694 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:56.694 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_14 2021-11-21T04:03:56.695 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:56.695 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:03:56.695 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:03:56.695 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:03:56.696 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:03:56.696 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_14 2021-11-21T04:03:56.721 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:03:56.721 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_14 snapshot 2021-11-21T04:03:56.721 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:56.722 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:56.722 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_14 2021-11-21T04:03:56.722 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:03:56.723 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_14 snapshot 2021-11-21T04:03:57.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:03:57.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:03:57.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_14 2021-11-21T04:03:57.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:03:57.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:03:57.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_14 2021-11-21T04:03:57.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:03:57.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=12 2021-11-21T04:03:57.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:03:57.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 12s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_14 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:03:57.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 65088512 bytes 2021-11-21T04:03:57.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 78853120 bytes 2021-11-21T04:03:57.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 154977280 bytes 2021-11-21T04:03:57.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 172782592 bytes 2021-11-21T04:03:57.888 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 294853632 bytes 2021-11-21T04:03:57.952 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 321482752 bytes 2021-11-21T04:03:58.045 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 400394240 bytes 2021-11-21T04:03:58.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 439317504 bytes 2021-11-21T04:03:58.193 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 500632576 bytes 2021-11-21T04:03:58.233 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 511886336 bytes 2021-11-21T04:03:58.295 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 548830208 bytes 2021-11-21T04:03:58.358 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 614038528 bytes 2021-11-21T04:03:58.411 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 620375040 bytes 2021-11-21T04:03:58.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 686251008 bytes 2021-11-21T04:03:58.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 714798080 bytes 2021-11-21T04:03:58.618 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 739212288 bytes 2021-11-21T04:03:58.706 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 818206720 bytes 2021-11-21T04:03:58.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 852377600 bytes 2021-11-21T04:03:58.823 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 881509376 bytes 2021-11-21T04:03:58.858 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 882187264 bytes 2021-11-21T04:03:58.939 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 938888192 bytes 2021-11-21T04:03:58.992 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 960539648 bytes 2021-11-21T04:03:59.107 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1064020992 bytes 2021-11-21T04:03:59.165 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1118543872 bytes 2021-11-21T04:03:59.216 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1148739584 bytes 2021-11-21T04:03:59.297 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1200545792 bytes 2021-11-21T04:03:59.362 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1238949888 bytes 2021-11-21T04:03:59.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1315614720 bytes 2021-11-21T04:03:59.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1403101184 bytes 2021-11-21T04:03:59.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1500226560 bytes 2021-11-21T04:03:59.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~16s 2021-11-21T04:03:59.711 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1524105216 bytes 2021-11-21T04:03:59.788 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1595447296 bytes 2021-11-21T04:03:59.887 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1651325952 bytes 2021-11-21T04:03:59.943 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1679880192 bytes 2021-11-21T04:03:59.992 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1693194240 bytes 2021-11-21T04:04:00.068 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1758411776 bytes 2021-11-21T04:04:00.129 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3700 IOs, 1770542080 bytes 2021-11-21T04:04:00.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3800 IOs, 1788827648 bytes 2021-11-21T04:04:00.241 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3900 IOs, 1820864512 bytes 2021-11-21T04:04:00.284 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4000 IOs, 1833249792 bytes 2021-11-21T04:04:00.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4100 IOs, 1921765376 bytes 2021-11-21T04:04:00.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4200 IOs, 1960322048 bytes 2021-11-21T04:04:00.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4300 IOs, 2037151744 bytes 2021-11-21T04:04:00.592 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4400 IOs, 2075375616 bytes 2021-11-21T04:04:00.674 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4500 IOs, 2137128960 bytes 2021-11-21T04:04:00.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4600 IOs, 2228802560 bytes 2021-11-21T04:04:00.848 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4700 IOs, 2269207552 bytes 2021-11-21T04:04:00.915 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4800 IOs, 2312894464 bytes 2021-11-21T04:04:00.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:4900 IOs, 2349078528 bytes 2021-11-21T04:04:01.034 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5000 IOs, 2385095680 bytes 2021-11-21T04:04:01.130 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5100 IOs, 2455572480 bytes 2021-11-21T04:04:01.176 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5200 IOs, 2467477504 bytes 2021-11-21T04:04:01.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5300 IOs, 2492351488 bytes 2021-11-21T04:04:01.299 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5400 IOs, 2542826496 bytes 2021-11-21T04:04:01.358 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5500 IOs, 2598108160 bytes 2021-11-21T04:04:01.414 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5600 IOs, 2610225152 bytes 2021-11-21T04:04:01.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5700 IOs, 2621605888 bytes 2021-11-21T04:04:01.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5800 IOs, 2678196224 bytes 2021-11-21T04:04:01.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:5900 IOs, 2726878208 bytes 2021-11-21T04:04:01.675 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6000 IOs, 2756087808 bytes 2021-11-21T04:04:01.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6100 IOs, 2805173248 bytes 2021-11-21T04:04:01.800 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6200 IOs, 2821719040 bytes 2021-11-21T04:04:01.886 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6300 IOs, 2908765184 bytes 2021-11-21T04:04:01.942 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6400 IOs, 2925580288 bytes 2021-11-21T04:04:02.009 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6500 IOs, 2974610432 bytes 2021-11-21T04:04:02.056 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6600 IOs, 3005040640 bytes 2021-11-21T04:04:02.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6700 IOs, 3027014656 bytes 2021-11-21T04:04:02.187 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6800 IOs, 3098739712 bytes 2021-11-21T04:04:02.268 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:6900 IOs, 3172612096 bytes 2021-11-21T04:04:02.324 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7000 IOs, 3204719616 bytes 2021-11-21T04:04:02.403 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7100 IOs, 3267236864 bytes 2021-11-21T04:04:02.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7200 IOs, 3287067648 bytes 2021-11-21T04:04:02.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7300 IOs, 3325028352 bytes 2021-11-21T04:04:02.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7400 IOs, 3364556800 bytes 2021-11-21T04:04:02.631 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7500 IOs, 3389412352 bytes 2021-11-21T04:04:02.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7600 IOs, 3403600896 bytes 2021-11-21T04:04:02.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7700 IOs, 3437101056 bytes 2021-11-21T04:04:02.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7800 IOs, 3451839488 bytes 2021-11-21T04:04:02.843 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:7900 IOs, 3493786624 bytes 2021-11-21T04:04:02.898 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8000 IOs, 3509832704 bytes 2021-11-21T04:04:02.932 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8100 IOs, 3510448128 bytes 2021-11-21T04:04:02.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8200 IOs, 3534157824 bytes 2021-11-21T04:04:03.026 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8300 IOs, 3534769152 bytes 2021-11-21T04:04:03.141 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8400 IOs, 3642929152 bytes 2021-11-21T04:04:03.183 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8500 IOs, 3658310656 bytes 2021-11-21T04:04:03.262 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8600 IOs, 3709203456 bytes 2021-11-21T04:04:03.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8700 IOs, 3797245952 bytes 2021-11-21T04:04:03.420 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8800 IOs, 3845222400 bytes 2021-11-21T04:04:03.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:8900 IOs, 3847116800 bytes 2021-11-21T04:04:03.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9000 IOs, 3850234880 bytes 2021-11-21T04:04:03.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9100 IOs, 3904180224 bytes 2021-11-21T04:04:03.627 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9200 IOs, 3925361664 bytes 2021-11-21T04:04:03.668 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9300 IOs, 3936034816 bytes 2021-11-21T04:04:03.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9400 IOs, 3981000704 bytes 2021-11-21T04:04:03.793 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9500 IOs, 4004951040 bytes 2021-11-21T04:04:03.843 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9600 IOs, 4039372800 bytes 2021-11-21T04:04:03.921 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9700 IOs, 4104662016 bytes 2021-11-21T04:04:04.015 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9800 IOs, 4168553472 bytes 2021-11-21T04:04:04.067 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:9900 IOs, 4184312832 bytes 2021-11-21T04:04:04.120 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10000 IOs, 4222023680 bytes 2021-11-21T04:04:04.216 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10100 IOs, 4283198464 bytes 2021-11-21T04:04:04.253 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10200 IOs, 4283823104 bytes 2021-11-21T04:04:04.363 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10300 IOs, 4384749568 bytes 2021-11-21T04:04:04.424 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10400 IOs, 4430827520 bytes 2021-11-21T04:04:04.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10500 IOs, 4490807296 bytes 2021-11-21T04:04:04.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10600 IOs, 4529277952 bytes 2021-11-21T04:04:04.624 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10700 IOs, 4537946112 bytes 2021-11-21T04:04:04.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10800 IOs, 4610666496 bytes 2021-11-21T04:04:04.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:10900 IOs, 4661591040 bytes 2021-11-21T04:04:04.847 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11000 IOs, 4696805376 bytes 2021-11-21T04:04:04.937 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11100 IOs, 4773437440 bytes 2021-11-21T04:04:04.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11200 IOs, 4774050816 bytes 2021-11-21T04:04:05.046 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11300 IOs, 4813540352 bytes 2021-11-21T04:04:05.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~22s 2021-11-21T04:04:05.146 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11400 IOs, 4897864704 bytes 2021-11-21T04:04:05.233 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11500 IOs, 4963539968 bytes 2021-11-21T04:04:05.306 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11600 IOs, 5020079104 bytes 2021-11-21T04:04:05.353 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11700 IOs, 5032866816 bytes 2021-11-21T04:04:05.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11800 IOs, 5110789120 bytes 2021-11-21T04:04:05.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:11900 IOs, 5128378368 bytes 2021-11-21T04:04:05.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12000 IOs, 5140712448 bytes 2021-11-21T04:04:05.599 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12100 IOs, 5178762240 bytes 2021-11-21T04:04:05.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12200 IOs, 5307827200 bytes 2021-11-21T04:04:05.791 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12300 IOs, 5339767808 bytes 2021-11-21T04:04:05.830 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12400 IOs, 5340376064 bytes 2021-11-21T04:04:05.899 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12500 IOs, 5395310592 bytes 2021-11-21T04:04:05.999 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12600 IOs, 5465748480 bytes 2021-11-21T04:04:06.053 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12700 IOs, 5508945920 bytes 2021-11-21T04:04:06.151 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12800 IOs, 5555686400 bytes 2021-11-21T04:04:06.206 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:12900 IOs, 5581607936 bytes 2021-11-21T04:04:06.272 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13000 IOs, 5617045504 bytes 2021-11-21T04:04:06.331 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13100 IOs, 5644894208 bytes 2021-11-21T04:04:06.422 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13200 IOs, 5713138688 bytes 2021-11-21T04:04:06.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13300 IOs, 5791412224 bytes 2021-11-21T04:04:06.597 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13400 IOs, 5829654528 bytes 2021-11-21T04:04:06.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13500 IOs, 5830265856 bytes 2021-11-21T04:04:06.681 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13600 IOs, 5844678656 bytes 2021-11-21T04:04:06.760 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13700 IOs, 5903011840 bytes 2021-11-21T04:04:06.796 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13800 IOs, 5910329344 bytes 2021-11-21T04:04:06.943 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:13900 IOs, 5927785472 bytes 2021-11-21T04:04:06.993 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14000 IOs, 5945048064 bytes 2021-11-21T04:04:07.027 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14100 IOs, 5945657344 bytes 2021-11-21T04:04:07.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14200 IOs, 6002297856 bytes 2021-11-21T04:04:07.151 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14300 IOs, 6014376960 bytes 2021-11-21T04:04:07.198 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14400 IOs, 6028589056 bytes 2021-11-21T04:04:07.256 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14500 IOs, 6064502784 bytes 2021-11-21T04:04:07.306 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14600 IOs, 6089716736 bytes 2021-11-21T04:04:07.368 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14700 IOs, 6119172096 bytes 2021-11-21T04:04:07.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14800 IOs, 6196617216 bytes 2021-11-21T04:04:07.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:14900 IOs, 6251152384 bytes 2021-11-21T04:04:07.628 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15000 IOs, 6316719104 bytes 2021-11-21T04:04:07.719 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15100 IOs, 6387294208 bytes 2021-11-21T04:04:07.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15200 IOs, 6407557120 bytes 2021-11-21T04:04:07.824 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15300 IOs, 6432177152 bytes 2021-11-21T04:04:07.863 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15400 IOs, 6432812032 bytes 2021-11-21T04:04:07.916 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15500 IOs, 6465805312 bytes 2021-11-21T04:04:07.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15600 IOs, 6494983168 bytes 2021-11-21T04:04:08.050 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15700 IOs, 6534740992 bytes 2021-11-21T04:04:08.106 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15800 IOs, 6557213696 bytes 2021-11-21T04:04:08.197 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:15900 IOs, 6659747840 bytes 2021-11-21T04:04:08.274 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16000 IOs, 6704432128 bytes 2021-11-21T04:04:08.372 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16100 IOs, 6788694016 bytes 2021-11-21T04:04:08.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16200 IOs, 6851118080 bytes 2021-11-21T04:04:08.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16300 IOs, 6933858304 bytes 2021-11-21T04:04:08.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16400 IOs, 6963038208 bytes 2021-11-21T04:04:08.676 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16500 IOs, 7007151104 bytes 2021-11-21T04:04:08.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16600 IOs, 7033540608 bytes 2021-11-21T04:04:08.807 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16700 IOs, 7097712640 bytes 2021-11-21T04:04:08.891 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16800 IOs, 7143270400 bytes 2021-11-21T04:04:08.941 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:16900 IOs, 7156340736 bytes 2021-11-21T04:04:09.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17000 IOs, 7216178176 bytes 2021-11-21T04:04:09.096 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17100 IOs, 7280571392 bytes 2021-11-21T04:04:09.147 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17200 IOs, 7305892864 bytes 2021-11-21T04:04:09.236 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17300 IOs, 7408831488 bytes 2021-11-21T04:04:09.334 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17400 IOs, 7464195072 bytes 2021-11-21T04:04:09.395 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:17500 IOs, 7508354048 bytes 2021-11-21T04:04:09.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:04:09.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:04:09.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:04:09.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:04:09.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:04:09.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_15 2021-11-21T04:04:09.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_15 snapshot 128M 2021-11-21T04:04:09.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:04:09.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:09.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:04:09.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:09.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_15 2021-11-21T04:04:09.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:09.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:04:09.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:04:09.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:09.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_15 128M 2021-11-21T04:04:09.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:04:09.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:09.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:04:09.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:09.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_15 2021-11-21T04:04:09.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:09.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:04:09.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:04:09.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:04:09.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:09.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_15 2021-11-21T04:04:09.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' image = image ']' 2021-11-21T04:04:09.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ enable_mirror cluster2 mirror image_15 snapshot 2021-11-21T04:04:09.669 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:04:09.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:04:09.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_15 2021-11-21T04:04:09.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:04:09.670 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_15 snapshot 2021-11-21T04:04:10.518 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~27s 2021-11-21T04:04:10.629 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirroring enabled 2021-11-21T04:04:10.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n '' ']' 2021-11-21T04:04:10.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ stress_write_image cluster2 mirror image_15 2021-11-21T04:04:10.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:04:10.638 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:04:10.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_15 2021-11-21T04:04:10.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-21T04:04:10.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local duration=14 2021-11-21T04:04:10.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set +e 2021-11-21T04:04:10.640 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ timeout 14s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_15 --debug-rbd=20 --debug-journaler=20 2021-11-21T04:04:10.798 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:100 IOs, 102100992 bytes 2021-11-21T04:04:10.854 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:200 IOs, 135468032 bytes 2021-11-21T04:04:10.929 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:300 IOs, 211557376 bytes 2021-11-21T04:04:10.989 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:400 IOs, 271919104 bytes 2021-11-21T04:04:11.051 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:500 IOs, 321707008 bytes 2021-11-21T04:04:11.330 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:600 IOs, 395689984 bytes 2021-11-21T04:04:11.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:700 IOs, 424011776 bytes 2021-11-21T04:04:11.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:800 IOs, 479708160 bytes 2021-11-21T04:04:11.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:900 IOs, 491808768 bytes 2021-11-21T04:04:11.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1000 IOs, 534387712 bytes 2021-11-21T04:04:11.637 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1100 IOs, 614080512 bytes 2021-11-21T04:04:11.707 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1200 IOs, 685756416 bytes 2021-11-21T04:04:11.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1300 IOs, 725713920 bytes 2021-11-21T04:04:11.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1400 IOs, 791196672 bytes 2021-11-21T04:04:12.055 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1500 IOs, 822993920 bytes 2021-11-21T04:04:12.140 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1600 IOs, 886079488 bytes 2021-11-21T04:04:12.215 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1700 IOs, 961921024 bytes 2021-11-21T04:04:12.280 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1800 IOs, 1005056000 bytes 2021-11-21T04:04:12.335 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:1900 IOs, 1042143232 bytes 2021-11-21T04:04:12.392 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2000 IOs, 1078566912 bytes 2021-11-21T04:04:12.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2100 IOs, 1112554496 bytes 2021-11-21T04:04:12.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2200 IOs, 1145160704 bytes 2021-11-21T04:04:12.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2300 IOs, 1194096640 bytes 2021-11-21T04:04:12.626 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2400 IOs, 1222475776 bytes 2021-11-21T04:04:12.697 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2500 IOs, 1275927552 bytes 2021-11-21T04:04:12.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2600 IOs, 1348894720 bytes 2021-11-21T04:04:12.828 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2700 IOs, 1368768512 bytes 2021-11-21T04:04:12.879 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2800 IOs, 1398117376 bytes 2021-11-21T04:04:12.926 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:2900 IOs, 1428146176 bytes 2021-11-21T04:04:12.988 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3000 IOs, 1472223232 bytes 2021-11-21T04:04:13.049 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3100 IOs, 1514400768 bytes 2021-11-21T04:04:13.091 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3200 IOs, 1532557312 bytes 2021-11-21T04:04:13.139 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3300 IOs, 1569220608 bytes 2021-11-21T04:04:13.191 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3400 IOs, 1586296832 bytes 2021-11-21T04:04:13.277 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3500 IOs, 1658813440 bytes 2021-11-21T04:04:13.321 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:2021-11-21T04:04:13.322+0000 7ff415345700 -1 bdev(0x55b24191ee00 /var/lib/ceph/osd/cluster2-1/block) _aio_thread got r=-28 ((28) No space left on device) 2021-11-21T04:04:13.322 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ff415345700 time 2021-11-21T04:04:13.323194+0000 2021-11-21T04:04:13.322 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: 575: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-21T04:04:13.322 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:04:13.323 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55b2355f36fe] 2021-11-21T04:04:13.323 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2: (KernelDevice::_aio_thread()+0x125e) [0x55b235cc99ce] 2021-11-21T04:04:13.323 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b235cd4721] 2021-11-21T04:04:13.323 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 4: (()+0x814a) [0x7ff42019814a] 2021-11-21T04:04:13.324 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 5: (clone()+0x43) [0x7ff41eecff23] 2021-11-21T04:04:13.324 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:2021-11-21T04:04:13.323+0000 7ff415345700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ff415345700 time 2021-11-21T04:04:13.323194+0000 2021-11-21T04:04:13.324 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: 575: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-21T04:04:13.324 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2021-11-21T04:04:13.325 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:04:13.325 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55b2355f36fe] 2021-11-21T04:04:13.325 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2: (KernelDevice::_aio_thread()+0x125e) [0x55b235cc99ce] 2021-11-21T04:04:13.325 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b235cd4721] 2021-11-21T04:04:13.325 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 4: (()+0x814a) [0x7ff42019814a] 2021-11-21T04:04:13.326 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 5: (clone()+0x43) [0x7ff41eecff23] 2021-11-21T04:04:13.326 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2021-11-21T04:04:13.326 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:*** Caught signal (Aborted) ** 2021-11-21T04:04:13.326 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: in thread 7ff415345700 thread_name:bstore_aio 2021-11-21T04:04:13.327 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:04:13.327 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 1: (()+0x12b20) [0x7ff4201a2b20] 2021-11-21T04:04:13.328 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2: (gsignal()+0x10f) [0x7ff41ee0a7ff] 2021-11-21T04:04:13.328 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 3: (abort()+0x127) [0x7ff41edf4c35] 2021-11-21T04:04:13.328 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b6) [0x55b2355f37cf] 2021-11-21T04:04:13.328 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 5: (KernelDevice::_aio_thread()+0x125e) [0x55b235cc99ce] 2021-11-21T04:04:13.328 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b235cd4721] 2021-11-21T04:04:13.329 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 7: (()+0x814a) [0x7ff42019814a] 2021-11-21T04:04:13.329 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 8: (clone()+0x43) [0x7ff41eecff23] 2021-11-21T04:04:13.329 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:2021-11-21T04:04:13.324+0000 7ff415345700 -1 *** Caught signal (Aborted) ** 2021-11-21T04:04:13.329 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: in thread 7ff415345700 thread_name:bstore_aio 2021-11-21T04:04:13.330 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2021-11-21T04:04:13.330 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:04:13.330 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 1: (()+0x12b20) [0x7ff4201a2b20] 2021-11-21T04:04:13.330 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2: (gsignal()+0x10f) [0x7ff41ee0a7ff] 2021-11-21T04:04:13.330 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 3: (abort()+0x127) [0x7ff41edf4c35] 2021-11-21T04:04:13.331 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b6) [0x55b2355f37cf] 2021-11-21T04:04:13.331 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 5: (KernelDevice::_aio_thread()+0x125e) [0x55b235cc99ce] 2021-11-21T04:04:13.331 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b235cd4721] 2021-11-21T04:04:13.331 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 7: (()+0x814a) [0x7ff42019814a] 2021-11-21T04:04:13.332 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 8: (clone()+0x43) [0x7ff41eecff23] 2021-11-21T04:04:13.332 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-21T04:04:13.332 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2021-11-21T04:04:13.334 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: -333> 2021-11-21T04:04:13.322+0000 7ff415345700 -1 bdev(0x55b24191ee00 /var/lib/ceph/osd/cluster2-1/block) _aio_thread got r=-28 ((28) No space left on device) 2021-11-21T04:04:13.334 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: -182> 2021-11-21T04:04:13.323+0000 7ff415345700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ff415345700 time 2021-11-21T04:04:13.323194+0000 2021-11-21T04:04:13.334 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: 575: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-21T04:04:13.335 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2021-11-21T04:04:13.335 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:04:13.335 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55b2355f36fe] 2021-11-21T04:04:13.335 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2: (KernelDevice::_aio_thread()+0x125e) [0x55b235cc99ce] 2021-11-21T04:04:13.336 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b235cd4721] 2021-11-21T04:04:13.336 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 4: (()+0x814a) [0x7ff42019814a] 2021-11-21T04:04:13.336 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 5: (clone()+0x43) [0x7ff41eecff23] 2021-11-21T04:04:13.336 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2021-11-21T04:04:13.337 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 0> 2021-11-21T04:04:13.324+0000 7ff415345700 -1 *** Caught signal (Aborted) ** 2021-11-21T04:04:13.337 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: in thread 7ff415345700 thread_name:bstore_aio 2021-11-21T04:04:13.337 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2021-11-21T04:04:13.337 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:04:13.337 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 1: (()+0x12b20) [0x7ff4201a2b20] 2021-11-21T04:04:13.338 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2: (gsignal()+0x10f) [0x7ff41ee0a7ff] 2021-11-21T04:04:13.338 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 3: (abort()+0x127) [0x7ff41edf4c35] 2021-11-21T04:04:13.338 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b6) [0x55b2355f37cf] 2021-11-21T04:04:13.338 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 5: (KernelDevice::_aio_thread()+0x125e) [0x55b235cc99ce] 2021-11-21T04:04:13.339 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b235cd4721] 2021-11-21T04:04:13.339 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 7: (()+0x814a) [0x7ff42019814a] 2021-11-21T04:04:13.339 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 8: (clone()+0x43) [0x7ff41eecff23] 2021-11-21T04:04:13.339 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-21T04:04:13.339 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2021-11-21T04:04:13.342 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: -1334> 2021-11-21T04:04:13.322+0000 7ff415345700 -1 bdev(0x55b24191ee00 /var/lib/ceph/osd/cluster2-1/block) _aio_thread got r=-28 ((28) No space left on device) 2021-11-21T04:04:13.342 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: -1183> 2021-11-21T04:04:13.323+0000 7ff415345700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ff415345700 time 2021-11-21T04:04:13.323194+0000 2021-11-21T04:04:13.343 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/15.2.15-32-gb0aaed0f/rpm/el8/BUILD/ceph-15.2.15-32-gb0aaed0f/src/os/bluestore/KernelDevice.cc: 575: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-21T04:04:13.343 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2021-11-21T04:04:13.343 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:04:13.343 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x55b2355f36fe] 2021-11-21T04:04:13.344 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2: (KernelDevice::_aio_thread()+0x125e) [0x55b235cc99ce] 2021-11-21T04:04:13.344 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b235cd4721] 2021-11-21T04:04:13.344 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 4: (()+0x814a) [0x7ff42019814a] 2021-11-21T04:04:13.344 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 5: (clone()+0x43) [0x7ff41eecff23] 2021-11-21T04:04:13.345 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2021-11-21T04:04:13.345 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: -1001> 2021-11-21T04:04:13.324+0000 7ff415345700 -1 *** Caught signal (Aborted) ** 2021-11-21T04:04:13.345 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: in thread 7ff415345700 thread_name:bstore_aio 2021-11-21T04:04:13.345 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2021-11-21T04:04:13.345 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:04:13.346 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 1: (()+0x12b20) [0x7ff4201a2b20] 2021-11-21T04:04:13.346 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2: (gsignal()+0x10f) [0x7ff41ee0a7ff] 2021-11-21T04:04:13.346 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 3: (abort()+0x127) [0x7ff41edf4c35] 2021-11-21T04:04:13.346 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b6) [0x55b2355f37cf] 2021-11-21T04:04:13.347 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 5: (KernelDevice::_aio_thread()+0x125e) [0x55b235cc99ce] 2021-11-21T04:04:13.347 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b235cd4721] 2021-11-21T04:04:13.347 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 7: (()+0x814a) [0x7ff42019814a] 2021-11-21T04:04:13.347 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 8: (clone()+0x43) [0x7ff41eecff23] 2021-11-21T04:04:13.348 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-21T04:04:13.348 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr: 2021-11-21T04:04:13.534 INFO:tasks.ceph.cluster2.osd.1.gibba043.stderr:daemon-helper: command failed with exit status 5 2021-11-21T04:04:14.639 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:3600 IOs, 1694361600 bytes 2021-11-21T04:04:15.821 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~32s 2021-11-21T04:04:15.821 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~0s 2021-11-21T04:04:18.434 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:04:18.435+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:04:21.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~38s 2021-11-21T04:04:21.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~5s 2021-11-21T04:04:23.435 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:04:23.436+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:04:24.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ error_code=124 2021-11-21T04:04:24.644 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ set -e 2021-11-21T04:04:24.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' 124 -eq 124 ']' 2021-11-21T04:04:24.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ return 0 2021-11-21T04:04:24.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-21T04:04:24.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ image=image_16 2021-11-21T04:04:24.645 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image_and_enable_mirror cluster2 mirror image_16 snapshot 128M 2021-11-21T04:04:24.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:04:24.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:24.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:04:24.646 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:24.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_16 2021-11-21T04:04:24.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:24.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local mode=snapshot 2021-11-21T04:04:24.647 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n snapshot ']' 2021-11-21T04:04:24.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:24.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ create_image cluster2 mirror image_16 128M 2021-11-21T04:04:24.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local cluster=cluster2 2021-11-21T04:04:24.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:24.648 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local pool=mirror 2021-11-21T04:04:24.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:24.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local image=image_16 2021-11-21T04:04:24.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:24.649 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ local size=128 2021-11-21T04:04:24.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ '[' -n 128M ']' 2021-11-21T04:04:24.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ size=128M 2021-11-21T04:04:24.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ shift 2021-11-21T04:04:24.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock,object-map,fast-diff mirror/image_16 2021-11-21T04:04:26.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~43s 2021-11-21T04:04:26.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~11s 2021-11-21T04:04:28.436 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:04:28.437+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:04:31.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~48s 2021-11-21T04:04:31.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~16s 2021-11-21T04:04:33.438 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:04:33.439+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:04:37.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~54s 2021-11-21T04:04:37.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~21s 2021-11-21T04:04:38.439 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:04:38.440+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:04:42.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~59s 2021-11-21T04:04:42.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~27s 2021-11-21T04:04:43.441 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:04:43.442+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:04:47.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~64s 2021-11-21T04:04:47.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~32s 2021-11-21T04:04:48.442 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:04:48.444+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:04:52.947 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~70s 2021-11-21T04:04:52.948 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~37s 2021-11-21T04:04:53.444 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:04:53.445+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:04:58.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~75s 2021-11-21T04:04:58.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~42s 2021-11-21T04:04:58.446 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:04:58.447+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:05:03.447 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:05:03.449+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:05:03.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~80s 2021-11-21T04:05:03.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~48s 2021-11-21T04:05:08.449 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:05:08.450+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:05:08.859 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~85s 2021-11-21T04:05:08.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~53s 2021-11-21T04:05:13.450 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:05:13.451+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:05:13.732 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.0 2021-11-21T04:05:13.732 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Sent signal 15 2021-11-21T04:05:13.733 INFO:tasks.rbd_mirror_thrash:waiting for 8 secs before reviving daemons 2021-11-21T04:05:13.733 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr:2021-11-21T04:05:13.734+0000 7f4b91482700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 (PID: 37632) UID: 1000 2021-11-21T04:05:14.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~91s 2021-11-21T04:05:14.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~58s 2021-11-21T04:05:18.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:05:18.452+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:05:19.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~96s 2021-11-21T04:05:19.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~64s 2021-11-21T04:05:21.734 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.0 2021-11-21T04:05:21.734 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T04:05:23.454 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:05:23.454+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:05:24.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~101s 2021-11-21T04:05:24.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~69s 2021-11-21T04:05:28.455 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:05:28.455+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:05:30.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~107s 2021-11-21T04:05:30.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~74s 2021-11-21T04:05:33.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:05:33.457+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:05:35.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~112s 2021-11-21T04:05:35.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~80s 2021-11-21T04:05:38.458 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:05:38.458+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:05:40.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~117s 2021-11-21T04:05:40.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~85s 2021-11-21T04:05:41.515 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2021-11-21T04:05:41.515 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2021-11-21T04:05:41.516 INFO:tasks.rbd_mirror_thrash:waiting for 6 secs before reviving daemons 2021-11-21T04:05:41.517 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr:2021-11-21T04:05:41.517+0000 7fa84b926700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 39263) UID: 1000 2021-11-21T04:05:43.458 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:05:43.459+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:05:45.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~123s 2021-11-21T04:05:45.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~90s 2021-11-21T04:05:47.517 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2021-11-21T04:05:47.517 INFO:teuthology.orchestra.run:waiting for 600 2021-11-21T04:05:48.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:05:48.460+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:05:51.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~128s 2021-11-21T04:05:51.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~95s 2021-11-21T04:05:53.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:05:53.462+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:05:56.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~133s 2021-11-21T04:05:56.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~101s 2021-11-21T04:05:58.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:05:58.463+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:06:01.898 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~138s 2021-11-21T04:06:01.898 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~106s 2021-11-21T04:06:03.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:06:03.465+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:06:07.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~144s 2021-11-21T04:06:07.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~111s 2021-11-21T04:06:08.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:06:08.467+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:06:12.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~149s 2021-11-21T04:06:12.510 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~117s 2021-11-21T04:06:13.468 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:06:13.468+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:06:17.814 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~154s 2021-11-21T04:06:17.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~122s 2021-11-21T04:06:18.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:06:18.470+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:06:23.118 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~160s 2021-11-21T04:06:23.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~127s 2021-11-21T04:06:23.471 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:06:23.472+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:06:28.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~165s 2021-11-21T04:06:28.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~133s 2021-11-21T04:06:28.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:06:28.474+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:06:33.475 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:06:33.475+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:06:33.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~170s 2021-11-21T04:06:33.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~138s 2021-11-21T04:06:38.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:06:38.477+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:06:39.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~176s 2021-11-21T04:06:39.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~143s 2021-11-21T04:06:40.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:06:40.736+0000 7f6b9d3dc700 -1 reset not still connected to 0x560571fb0a90 2021-11-21T04:06:40.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:06:40.736+0000 7f6b9d3dc700 -1 reset not still connected to 0x560572f37e10 2021-11-21T04:06:40.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:06:40.736+0000 7f6b9d3dc700 -1 reset not still connected to 0x560575d3e4e0 2021-11-21T04:06:40.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:06:40.736+0000 7f6b9d3dc700 -1 reset not still connected to 0x560575d3fe10 2021-11-21T04:06:40.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:06:40.736+0000 7f6b9d3dc700 -1 reset not still connected to 0x56057a284f70 2021-11-21T04:06:43.477 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:06:43.478+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:06:44.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~181s 2021-11-21T04:06:44.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~149s 2021-11-21T04:06:48.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:06:48.480+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:06:49.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~186s 2021-11-21T04:06:49.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~154s 2021-11-21T04:06:53.481 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:06:53.482+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:06:54.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~192s 2021-11-21T04:06:54.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~159s 2021-11-21T04:06:58.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:06:58.483+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:07:00.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~197s 2021-11-21T04:07:00.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~164s 2021-11-21T04:07:03.484 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:07:03.485+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:07:05.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~202s 2021-11-21T04:07:05.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~170s 2021-11-21T04:07:08.486 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:07:08.487+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:07:10.850 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~207s 2021-11-21T04:07:10.851 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~175s 2021-11-21T04:07:13.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:07:13.488+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:07:16.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~213s 2021-11-21T04:07:16.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~180s 2021-11-21T04:07:18.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:07:18.490+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:07:21.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~218s 2021-11-21T04:07:21.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~186s 2021-11-21T04:07:23.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:07:23.491+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:07:26.762 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~223s 2021-11-21T04:07:26.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~191s 2021-11-21T04:07:28.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:07:28.493+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:07:32.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~229s 2021-11-21T04:07:32.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~196s 2021-11-21T04:07:33.493 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:07:33.494+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:07:37.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~234s 2021-11-21T04:07:37.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~202s 2021-11-21T04:07:38.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:07:38.496+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:07:42.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~239s 2021-11-21T04:07:42.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~207s 2021-11-21T04:07:43.497 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:07:43.498+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:07:47.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~245s 2021-11-21T04:07:47.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~212s 2021-11-21T04:07:48.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:07:48.499+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:07:53.281 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~250s 2021-11-21T04:07:53.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~217s 2021-11-21T04:07:53.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:07:53.500+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:07:58.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:07:58.502+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:07:58.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~255s 2021-11-21T04:07:58.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~223s 2021-11-21T04:08:03.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:08:03.504+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:08:03.889 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~260s 2021-11-21T04:08:03.890 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~228s 2021-11-21T04:08:08.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:08:08.505+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:08:09.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~266s 2021-11-21T04:08:09.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~233s 2021-11-21T04:08:13.505 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:08:13.506+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:08:14.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~271s 2021-11-21T04:08:14.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~239s 2021-11-21T04:08:18.507 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:08:18.507+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:08:19.800 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~276s 2021-11-21T04:08:19.800 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~244s 2021-11-21T04:08:23.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:08:23.508+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:08:25.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~282s 2021-11-21T04:08:25.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~249s 2021-11-21T04:08:28.510 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:08:28.510+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:08:30.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~287s 2021-11-21T04:08:30.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~255s 2021-11-21T04:08:33.511 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:08:33.512+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:08:35.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~292s 2021-11-21T04:08:35.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~260s 2021-11-21T04:08:38.513 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:08:38.513+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:08:41.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~298s 2021-11-21T04:08:41.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~265s 2021-11-21T04:08:43.515 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:08:43.515+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:08:46.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~303s 2021-11-21T04:08:46.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~270s 2021-11-21T04:08:46.320 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2021-11-21T04:08:46.320 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/daemonwatchdog.py", line 37, in _run self.watch() File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/daemonwatchdog.py", line 113, in watch self.bark() File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/daemonwatchdog.py", line 53, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/config.py", line 256, in __getattr__ raise AttributeError(name) AttributeError: mounts 2021-11-21T04:08:48.516 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:08:48.517+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:08:53.520 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:08:53.518+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:08:58.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:08:58.520+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:09:03.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:09:03.521+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:09:08.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:09:08.523+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:09:13.524 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:09:13.524+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:09:18.525 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:09:18.526+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:09:23.526 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:09:23.527+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:09:28.528 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:09:28.529+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:09:33.530 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:09:33.531+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:09:38.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:09:38.533+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:09:43.533 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:09:43.533+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:09:48.535 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:09:48.536+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:09:53.536 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:09:53.537+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:09:58.538 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:09:58.539+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:10:03.540 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:10:03.541+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:10:08.542 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:10:08.542+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:10:13.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:10:13.543+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:10:18.545 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:10:18.546+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:10:23.546 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:10:23.546+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:10:28.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:10:28.548+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:10:33.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:10:33.550+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:10:38.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:10:38.551+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:10:43.554 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:10:43.553+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:10:48.554 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:10:48.555+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:10:53.555 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:10:53.557+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:10:58.557 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:10:58.558+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:11:03.559 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:11:03.560+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:11:08.560 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:11:08.560+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:11:13.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:11:13.562+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:11:18.563 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:11:18.563+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:11:23.565 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:11:23.565+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:11:28.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:11:28.567+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:11:33.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:11:33.568+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:11:38.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:11:38.569+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:11:43.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:11:43.570+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:11:48.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:11:48.572+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:11:53.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:11:53.574+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:11:58.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:11:58.575+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:12:03.577 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:12:03.577+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:12:08.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:12:08.579+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:12:13.580 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:12:13.581+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:12:18.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:12:18.582+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:12:23.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:12:23.583+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:12:28.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:12:28.585+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:12:33.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:12:33.587+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:12:38.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:12:38.589+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:12:43.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:12:43.591+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:12:48.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:12:48.592+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:12:53.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:12:53.593+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:12:58.594 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:12:58.595+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:13:03.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:13:03.596+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:13:08.597 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:13:08.598+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:13:13.599 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:13:13.600+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:13:18.601 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:13:18.602+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:13:23.603 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:13:23.603+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:13:28.604 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:13:28.604+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:13:33.605 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:13:33.605+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:13:38.606 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:13:38.607+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:13:45.799 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:13:45.800+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:13:50.800 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:13:50.800+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:13:55.801 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:13:55.801+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:14:00.801 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:14:00.801+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:14:05.802 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:14:05.802+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:14:10.803 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:14:10.803+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:14:15.804 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:14:15.804+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:14:16.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:16.152+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:17.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:17.147+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:18.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:18.188+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:19.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:19.227+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:20.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:20.263+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:20.805 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:14:20.806+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:14:21.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:21.253+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:22.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:22.294+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:23.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:23.340+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:24.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:24.356+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:25.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:25.317+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:25.806 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:14:25.806+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:14:26.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:26.276+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:27.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:27.317+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:28.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:28.274+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:29.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:29.268+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:30.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:30.268+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:30.807 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:14:30.807+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:14:31.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:31.236+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:32.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:32.238+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:33.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:33.231+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:34.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:34.240+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:35.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:35.205+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:35.808 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:14:35.808+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:14:36.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:36.213+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:37.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:37.192+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:38.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:38.207+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:39.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:39.248+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:40.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:40.254+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:40.809 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:14:40.809+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:14:41.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:41.268+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:42.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:42.232+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:43.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:43.255+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:44.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:44.247+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:45.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:45.220+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:45.810 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:14:45.810+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:14:46.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:46.263+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:47.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:47.266+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:48.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:48.270+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:49.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:49.228+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:50.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:50.215+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:50.811 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:14:50.811+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:14:51.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:51.244+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 22 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:52.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:52.291+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 22 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:53.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:53.314+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 22 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:54.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:54.304+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 22 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:55.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:55.329+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 22 slow ops, oldest is osd_op(client.4395.0:1931 3.15 3.5bf5e895 (undecoded) ondisk+write+known_if_redirected e128) 2021-11-21T04:14:55.811 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:14:55.812+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:14:56.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:56.371+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 225 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:14:57.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:57.380+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 225 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:14:58.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:58.404+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:14:59.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:14:59.441+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:00.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:00.479+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:00.812 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:15:00.812+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:15:01.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:01.457+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:02.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:02.413+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:03.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:03.366+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:04.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:04.326+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:05.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:05.345+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:05.813 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:15:05.813+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:15:06.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:06.396+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:07.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:07.438+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:08.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:08.459+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:09.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:09.434+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:10.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:10.483+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:10.814 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:15:10.814+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:15:11.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:11.495+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:12.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:12.510+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:13.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:13.523+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:14.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:14.494+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:15.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:15.481+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:15.816 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:15:15.816+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:15:16.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:16.499+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:17.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:17.536+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:18.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:18.520+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:19.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:19.536+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:20.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:20.539+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:20.816 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:15:20.816+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:15:21.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:21.555+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:22.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:22.599+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:23.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:23.567+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:24.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:24.588+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:25.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:25.590+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:25.817 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:15:25.817+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:15:25.879 INFO:tasks.rbd_mirror_thrash:Failed to stop cluster1.client.mirror.0 2021-11-21T04:15:25.880 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Sent signal 6 2021-11-21T04:15:25.881 ERROR:tasks.rbd_mirror_thrash:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/rbd_mirror_thrash.py", line 84, in _run self.do_thrash() File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/rbd_mirror_thrash.py", line 156, in do_thrash run.wait([daemon.proc], timeout=600) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (100) after waiting for 600 seconds 2021-11-21T04:15:25.882 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr:*** Caught signal (Aborted) ** 2021-11-21T04:15:25.882 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: in thread 7f4ba1c15680 thread_name:rbd-mirror 2021-11-21T04:15:25.882 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:15:25.883 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 1: (()+0x12b20) [0x7f4b97896b20] 2021-11-21T04:15:25.883 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 2: (()+0x963d) [0x7f4b9788d63d] 2021-11-21T04:15:25.883 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 3: (Thread::join(void**)+0x31) [0x7f4b9876fc71] 2021-11-21T04:15:25.883 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 4: (rbd::mirror::PoolReplayer::shut_down()+0x28a) [0x5646dfb6101a] 2021-11-21T04:15:25.884 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 5: (rbd::mirror::PoolReplayer::~PoolReplayer()+0x12) [0x5646dfb61072] 2021-11-21T04:15:25.884 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 6: (std::_Rb_tree, std::pair const, std::unique_ptr, std::default_delete > > >, std::_Select1st const, std::unique_ptr, std::default_delete > > > >, std::less >, std::allocator const, std::unique_ptr, std::default_delete > > > > >::_M_erase(std::_Rb_tree_node const, std::unique_ptr, std::default_delete > > > >*)+0x41) [0x5646dfb58701] 2021-11-21T04:15:25.884 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 7: (rbd::mirror::Mirror::~Mirror()+0xc5) [0x5646dfb529b5] 2021-11-21T04:15:25.884 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 8: (main()+0x4da) [0x5646dfb4176a] 2021-11-21T04:15:25.884 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 9: (__libc_start_main()+0xf3) [0x7f4b95cb07b3] 2021-11-21T04:15:25.885 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 10: (_start()+0x2e) [0x5646dfb4fade] 2021-11-21T04:15:25.885 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr:2021-11-21T04:15:25.882+0000 7f4ba1c15680 -1 *** Caught signal (Aborted) ** 2021-11-21T04:15:25.885 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: in thread 7f4ba1c15680 thread_name:rbd-mirror 2021-11-21T04:15:25.885 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 2021-11-21T04:15:25.886 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:15:25.886 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 1: (()+0x12b20) [0x7f4b97896b20] 2021-11-21T04:15:25.886 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 2: (()+0x963d) [0x7f4b9788d63d] 2021-11-21T04:15:25.886 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 3: (Thread::join(void**)+0x31) [0x7f4b9876fc71] 2021-11-21T04:15:25.886 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 4: (rbd::mirror::PoolReplayer::shut_down()+0x28a) [0x5646dfb6101a] 2021-11-21T04:15:25.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 5: (rbd::mirror::PoolReplayer::~PoolReplayer()+0x12) [0x5646dfb61072] 2021-11-21T04:15:25.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 6: (std::_Rb_tree, std::pair const, std::unique_ptr, std::default_delete > > >, std::_Select1st const, std::unique_ptr, std::default_delete > > > >, std::less >, std::allocator const, std::unique_ptr, std::default_delete > > > > >::_M_erase(std::_Rb_tree_node const, std::unique_ptr, std::default_delete > > > >*)+0x41) [0x5646dfb58701] 2021-11-21T04:15:25.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 7: (rbd::mirror::Mirror::~Mirror()+0xc5) [0x5646dfb529b5] 2021-11-21T04:15:25.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 8: (main()+0x4da) [0x5646dfb4176a] 2021-11-21T04:15:25.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 9: (__libc_start_main()+0xf3) [0x7f4b95cb07b3] 2021-11-21T04:15:25.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 10: (_start()+0x2e) [0x5646dfb4fade] 2021-11-21T04:15:25.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-21T04:15:25.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 2021-11-21T04:15:25.889 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: -4616> 2021-11-21T04:05:13.734+0000 7f4b91482700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 (PID: 37632) UID: 1000 2021-11-21T04:15:25.891 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 0> 2021-11-21T04:15:25.882+0000 7f4ba1c15680 -1 *** Caught signal (Aborted) ** 2021-11-21T04:15:25.891 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: in thread 7f4ba1c15680 thread_name:rbd-mirror 2021-11-21T04:15:25.891 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 2021-11-21T04:15:25.892 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:15:25.892 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 1: (()+0x12b20) [0x7f4b97896b20] 2021-11-21T04:15:25.892 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 2: (()+0x963d) [0x7f4b9788d63d] 2021-11-21T04:15:25.892 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 3: (Thread::join(void**)+0x31) [0x7f4b9876fc71] 2021-11-21T04:15:25.893 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 4: (rbd::mirror::PoolReplayer::shut_down()+0x28a) [0x5646dfb6101a] 2021-11-21T04:15:25.893 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 5: (rbd::mirror::PoolReplayer::~PoolReplayer()+0x12) [0x5646dfb61072] 2021-11-21T04:15:25.893 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 6: (std::_Rb_tree, std::pair const, std::unique_ptr, std::default_delete > > >, std::_Select1st const, std::unique_ptr, std::default_delete > > > >, std::less >, std::allocator const, std::unique_ptr, std::default_delete > > > > >::_M_erase(std::_Rb_tree_node const, std::unique_ptr, std::default_delete > > > >*)+0x41) [0x5646dfb58701] 2021-11-21T04:15:25.893 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 7: (rbd::mirror::Mirror::~Mirror()+0xc5) [0x5646dfb529b5] 2021-11-21T04:15:25.894 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 8: (main()+0x4da) [0x5646dfb4176a] 2021-11-21T04:15:25.894 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 9: (__libc_start_main()+0xf3) [0x7f4b95cb07b3] 2021-11-21T04:15:25.894 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 10: (_start()+0x2e) [0x5646dfb4fade] 2021-11-21T04:15:25.894 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-21T04:15:25.894 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 2021-11-21T04:15:25.895 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr:*** Caught signal (Segmentation fault) ** 2021-11-21T04:15:25.895 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: in thread 7f4ba1c15680 thread_name:rbd-mirror 2021-11-21T04:15:25.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:15:25.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 1: (()+0x12b20) [0x7f4b97896b20] 2021-11-21T04:15:25.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 2: (pthread_getname_np()+0x48) [0x7f4b97897d98] 2021-11-21T04:15:25.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 3: (ceph::logging::Log::dump_recent()+0x428) [0x7f4b989ec478] 2021-11-21T04:15:25.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 4: (()+0x7cbc0b) [0x5646e0084c0b] 2021-11-21T04:15:25.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 5: (()+0x12b20) [0x7f4b97896b20] 2021-11-21T04:15:25.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 6: (()+0x963d) [0x7f4b9788d63d] 2021-11-21T04:15:25.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 7: (Thread::join(void**)+0x31) [0x7f4b9876fc71] 2021-11-21T04:15:25.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 8: (rbd::mirror::PoolReplayer::shut_down()+0x28a) [0x5646dfb6101a] 2021-11-21T04:15:25.898 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 9: (rbd::mirror::PoolReplayer::~PoolReplayer()+0x12) [0x5646dfb61072] 2021-11-21T04:15:25.898 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 10: (std::_Rb_tree, std::pair const, std::unique_ptr, std::default_delete > > >, std::_Select1st const, std::unique_ptr, std::default_delete > > > >, std::less >, std::allocator const, std::unique_ptr, std::default_delete > > > > >::_M_erase(std::_Rb_tree_node const, std::unique_ptr, std::default_delete > > > >*)+0x41) [0x5646dfb58701] 2021-11-21T04:15:25.898 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 11: (rbd::mirror::Mirror::~Mirror()+0xc5) [0x5646dfb529b5] 2021-11-21T04:15:25.899 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 12: (main()+0x4da) [0x5646dfb4176a] 2021-11-21T04:15:25.899 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 13: (__libc_start_main()+0xf3) [0x7f4b95cb07b3] 2021-11-21T04:15:25.899 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr: 14: (_start()+0x2e) [0x5646dfb4fade] 2021-11-21T04:15:26.081 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba043.stderr:daemon-helper: command crashed with signal 11 2021-11-21T04:15:26.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:26.546+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:27.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:27.533+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:28.175 INFO:tasks.daemonwatchdog.daemon_watchdog:thrasher.rbd_mirror.[cluster1] failed 2021-11-21T04:15:28.176 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2021-11-21T04:15:28.176 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/daemonwatchdog.py", line 37, in _run self.watch() File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/daemonwatchdog.py", line 113, in watch self.bark() File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/daemonwatchdog.py", line 53, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/config.py", line 256, in __getattr__ raise AttributeError(name) AttributeError: mounts 2021-11-21T04:15:28.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:28.526+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:29.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:29.515+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:30.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:30.525+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:30.818 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:15:30.819+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:15:31.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:31.531+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:32.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:32.539+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:33.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:33.504+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:34.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:34.534+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:35.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:35.565+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:35.819 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:15:35.820+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:15:36.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:36.612+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:37.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:37.594+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:38.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:38.615+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:39.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:39.568+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:40.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:40.596+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:40.821 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:15:40.821+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:15:41.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:41.597+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:42.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:42.608+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:43.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:43.579+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:44.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:44.534+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:45.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:45.557+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:45.822 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:15:45.822+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:15:46.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:46.596+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:47.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:47.564+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:48.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:48.584+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:49.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:49.627+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:50.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:50.585+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:50.823 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:15:50.823+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:15:51.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:51.594+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:51.667 INFO:tasks.rbd_mirror_thrash:Failed to stop cluster2.client.mirror.0 2021-11-21T04:15:51.667 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 6 2021-11-21T04:15:51.668 ERROR:tasks.rbd_mirror_thrash:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/rbd_mirror_thrash.py", line 84, in _run self.do_thrash() File "/home/teuthworker/src/github.com_ceph_ceph_b0aaed0fe8cdfe99c82a70b230004934b51091ff/qa/tasks/rbd_mirror_thrash.py", line 156, in do_thrash run.wait([daemon.proc], timeout=600) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (100) after waiting for 600 seconds 2021-11-21T04:15:51.668 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr:*** Caught signal (Aborted) ** 2021-11-21T04:15:51.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: in thread 7fa85c0b9680 thread_name:rbd-mirror 2021-11-21T04:15:51.674 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:15:51.675 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 1: (()+0x12b20) [0x7fa851d3ab20] 2021-11-21T04:15:51.675 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 2: (pthread_cond_wait()+0x1fc) [0x7fa851d362fc] 2021-11-21T04:15:51.675 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 3: (std::condition_variable::wait(std::unique_lock&)+0x10) [0x7fa850b4a8f0] 2021-11-21T04:15:51.676 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 4: (()+0x99fd3) [0x7fa85bbe0fd3] 2021-11-21T04:15:51.676 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 5: (librados::v14_2_0::IoCtx::operate(std::__cxx11::basic_string, std::allocator > const&, librados::v14_2_0::ObjectReadOperation*, ceph::buffer::v15_2_0::list*)+0x62) [0x7fa85bbb5462] 2021-11-21T04:15:51.676 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 6: (librbd::cls_client::mirror_mode_get(librados::v14_2_0::IoCtx*, cls::rbd::MirrorMode*)+0x96) [0x55f0522e7746] 2021-11-21T04:15:51.676 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 7: (rbd::mirror::ClusterWatcher::read_pool_peers(std::map >, std::less, std::allocator > > > >*)+0x5de) [0x55f051e2901e] 2021-11-21T04:15:51.677 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 8: (rbd::mirror::ClusterWatcher::refresh_pools()+0x22d) [0x55f051e2b04d] 2021-11-21T04:15:51.677 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 9: (rbd::mirror::Mirror::run()+0x1d8) [0x55f051def2a8] 2021-11-21T04:15:51.677 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 10: (main()+0x455) [0x55f051dd96e5] 2021-11-21T04:15:51.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 11: (__libc_start_main()+0xf3) [0x7fa8501547b3] 2021-11-21T04:15:51.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 12: (_start()+0x2e) [0x55f051de7ade] 2021-11-21T04:15:51.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr:2021-11-21T04:15:51.675+0000 7fa85c0b9680 -1 *** Caught signal (Aborted) ** 2021-11-21T04:15:51.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: in thread 7fa85c0b9680 thread_name:rbd-mirror 2021-11-21T04:15:51.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 2021-11-21T04:15:51.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:15:51.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 1: (()+0x12b20) [0x7fa851d3ab20] 2021-11-21T04:15:51.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 2: (pthread_cond_wait()+0x1fc) [0x7fa851d362fc] 2021-11-21T04:15:51.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 3: (std::condition_variable::wait(std::unique_lock&)+0x10) [0x7fa850b4a8f0] 2021-11-21T04:15:51.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 4: (()+0x99fd3) [0x7fa85bbe0fd3] 2021-11-21T04:15:51.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 5: (librados::v14_2_0::IoCtx::operate(std::__cxx11::basic_string, std::allocator > const&, librados::v14_2_0::ObjectReadOperation*, ceph::buffer::v15_2_0::list*)+0x62) [0x7fa85bbb5462] 2021-11-21T04:15:51.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 6: (librbd::cls_client::mirror_mode_get(librados::v14_2_0::IoCtx*, cls::rbd::MirrorMode*)+0x96) [0x55f0522e7746] 2021-11-21T04:15:51.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 7: (rbd::mirror::ClusterWatcher::read_pool_peers(std::map >, std::less, std::allocator > > > >*)+0x5de) [0x55f051e2901e] 2021-11-21T04:15:51.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 8: (rbd::mirror::ClusterWatcher::refresh_pools()+0x22d) [0x55f051e2b04d] 2021-11-21T04:15:51.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 9: (rbd::mirror::Mirror::run()+0x1d8) [0x55f051def2a8] 2021-11-21T04:15:51.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 10: (main()+0x455) [0x55f051dd96e5] 2021-11-21T04:15:51.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 11: (__libc_start_main()+0xf3) [0x7fa8501547b3] 2021-11-21T04:15:51.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 12: (_start()+0x2e) [0x55f051de7ade] 2021-11-21T04:15:51.682 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-21T04:15:51.682 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 2021-11-21T04:15:51.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: -3604> 2021-11-21T04:05:41.517+0000 7fa84b926700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 39263) UID: 1000 2021-11-21T04:15:51.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 0> 2021-11-21T04:15:51.675+0000 7fa85c0b9680 -1 *** Caught signal (Aborted) ** 2021-11-21T04:15:51.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: in thread 7fa85c0b9680 thread_name:rbd-mirror 2021-11-21T04:15:51.684 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 2021-11-21T04:15:51.684 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:15:51.684 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 1: (()+0x12b20) [0x7fa851d3ab20] 2021-11-21T04:15:51.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 2: (pthread_cond_wait()+0x1fc) [0x7fa851d362fc] 2021-11-21T04:15:51.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 3: (std::condition_variable::wait(std::unique_lock&)+0x10) [0x7fa850b4a8f0] 2021-11-21T04:15:51.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 4: (()+0x99fd3) [0x7fa85bbe0fd3] 2021-11-21T04:15:51.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 5: (librados::v14_2_0::IoCtx::operate(std::__cxx11::basic_string, std::allocator > const&, librados::v14_2_0::ObjectReadOperation*, ceph::buffer::v15_2_0::list*)+0x62) [0x7fa85bbb5462] 2021-11-21T04:15:51.686 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 6: (librbd::cls_client::mirror_mode_get(librados::v14_2_0::IoCtx*, cls::rbd::MirrorMode*)+0x96) [0x55f0522e7746] 2021-11-21T04:15:51.686 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 7: (rbd::mirror::ClusterWatcher::read_pool_peers(std::map >, std::less, std::allocator > > > >*)+0x5de) [0x55f051e2901e] 2021-11-21T04:15:51.686 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 8: (rbd::mirror::ClusterWatcher::refresh_pools()+0x22d) [0x55f051e2b04d] 2021-11-21T04:15:51.686 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 9: (rbd::mirror::Mirror::run()+0x1d8) [0x55f051def2a8] 2021-11-21T04:15:51.686 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 10: (main()+0x455) [0x55f051dd96e5] 2021-11-21T04:15:51.687 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 11: (__libc_start_main()+0xf3) [0x7fa8501547b3] 2021-11-21T04:15:51.687 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 12: (_start()+0x2e) [0x55f051de7ade] 2021-11-21T04:15:51.687 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-21T04:15:51.687 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 2021-11-21T04:15:51.688 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: -8891> 2021-11-21T04:05:41.517+0000 7fa84b926700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 39263) UID: 1000 2021-11-21T04:15:51.689 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: -8890> 2021-11-21T04:15:51.675+0000 7fa85c0b9680 -1 *** Caught signal (Aborted) ** 2021-11-21T04:15:51.689 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: in thread 7fa85c0b9680 thread_name:rbd-mirror 2021-11-21T04:15:51.689 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 2021-11-21T04:15:51.689 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable) 2021-11-21T04:15:51.689 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 1: (()+0x12b20) [0x7fa851d3ab20] 2021-11-21T04:15:51.690 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 2: (pthread_cond_wait()+0x1fc) [0x7fa851d362fc] 2021-11-21T04:15:51.690 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 3: (std::condition_variable::wait(std::unique_lock&)+0x10) [0x7fa850b4a8f0] 2021-11-21T04:15:51.690 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 4: (()+0x99fd3) [0x7fa85bbe0fd3] 2021-11-21T04:15:51.690 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 5: (librados::v14_2_0::IoCtx::operate(std::__cxx11::basic_string, std::allocator > const&, librados::v14_2_0::ObjectReadOperation*, ceph::buffer::v15_2_0::list*)+0x62) [0x7fa85bbb5462] 2021-11-21T04:15:51.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 6: (librbd::cls_client::mirror_mode_get(librados::v14_2_0::IoCtx*, cls::rbd::MirrorMode*)+0x96) [0x55f0522e7746] 2021-11-21T04:15:51.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 7: (rbd::mirror::ClusterWatcher::read_pool_peers(std::map >, std::less, std::allocator > > > >*)+0x5de) [0x55f051e2901e] 2021-11-21T04:15:51.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 8: (rbd::mirror::ClusterWatcher::refresh_pools()+0x22d) [0x55f051e2b04d] 2021-11-21T04:15:51.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 9: (rbd::mirror::Mirror::run()+0x1d8) [0x55f051def2a8] 2021-11-21T04:15:51.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 10: (main()+0x455) [0x55f051dd96e5] 2021-11-21T04:15:51.692 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 11: (__libc_start_main()+0xf3) [0x7fa8501547b3] 2021-11-21T04:15:51.692 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 12: (_start()+0x2e) [0x55f051de7ade] 2021-11-21T04:15:51.692 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-21T04:15:51.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr: 2021-11-21T04:15:51.868 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba043.stderr:daemon-helper: command crashed with signal 6 2021-11-21T04:15:52.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:52.644+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:53.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:53.616+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:54.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:54.598+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:55.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:55.574+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:55.824 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:15:55.824+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:15:56.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:56.624+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:57.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:57.587+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:58.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:58.551+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:15:59.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:15:59.579+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:00.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:00.599+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:00.825 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:16:00.825+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:16:01.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:01.611+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:02.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:02.630+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:03.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:03.679+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:04.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:04.708+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:05.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:05.687+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:05.826 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:16:05.826+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:16:06.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:06.703+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:07.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:07.668+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:08.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:08.712+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:09.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:09.698+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:10.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:10.700+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:10.827 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:16:10.827+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:16:11.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:11.687+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:12.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:12.653+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:13.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:13.635+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:14.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:14.637+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:15.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:15.683+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:15.828 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:16:15.828+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:16:16.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:16.724+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:17.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:17.716+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:18.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:18.729+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:19.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:19.682+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:20.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:20.686+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:20.829 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:16:20.829+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:16:21.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:21.682+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:22.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:22.706+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:23.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:23.702+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:24.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:24.692+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:25.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:25.709+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:25.830 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:16:25.830+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:16:26.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:26.677+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:27.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:27.688+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:28.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:28.655+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:29.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:29.639+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:30.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:30.679+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:30.831 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:16:30.832+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:16:31.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:31.704+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:32.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:32.676+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:33.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:33.724+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:34.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:34.698+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:35.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:35.650+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:35.831 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:16:35.832+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:16:36.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:36.659+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:37.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:37.690+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:38.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:38.706+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:39.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:39.728+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:40.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:40.746+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:40.832 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:16:40.832+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:16:41.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:41.723+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:42.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:42.765+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:43.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:43.787+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:44.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:44.787+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:45.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:45.796+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:45.833 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:16:45.833+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:16:46.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:46.765+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:47.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:47.804+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:48.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:48.808+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:49.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:49.783+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:50.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:50.783+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:50.834 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:16:50.834+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:16:51.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:51.810+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:52.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:52.853+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:53.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:53.887+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:54.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:54.871+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:55.835 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:16:55.835+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:16:55.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:55.849+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:56.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:56.867+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:57.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:57.857+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:58.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:58.885+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:16:59.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:16:59.855+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:00.836 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:17:00.836+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:17:00.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:00.899+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:01.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:01.913+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:02.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:02.887+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:03.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:03.935+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:04.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:04.891+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:05.837 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:17:05.838+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:17:05.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:05.925+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:06.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:06.934+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:07.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:07.915+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:08.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:08.917+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:09.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:09.873+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:10.838 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:17:10.838+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:17:10.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:10.906+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:11.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:11.917+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:12.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:12.919+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:13.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:13.923+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:14.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:14.966+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:15.839 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:17:15.839+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:17:15.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:15.931+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:16.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:16.971+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:17.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:17.957+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:18.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:18.996+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:19.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:19.994+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:20.840 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:17:20.841+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:17:21.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:21.026+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:22.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:22.011+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:23.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:23.042+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:23.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:23.995+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:25.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:25.013+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:25.841 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:17:25.842+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:17:25.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:25.964+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:27.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:27.008+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:27.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:27.984+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:28.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:28.973+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:29.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:29.989+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:30.842 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:17:30.842+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:17:31.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:31.024+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:31.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:31.978+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:32.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:32.958+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:33.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:33.978+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:35.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:35.022+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:35.843 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:17:35.843+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:17:36.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:36.061+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:37.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:37.087+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:38.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:38.078+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:39.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:39.039+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:40.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:40.032+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:40.844 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:17:40.844+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:17:41.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:41.017+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:42.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:42.049+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:43.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:43.076+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:44.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:44.030+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:45.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:45.080+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:45.845 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:17:45.845+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:17:46.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:46.131+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:47.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:47.128+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:48.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:48.178+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:49.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:49.145+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:50.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:50.165+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:50.846 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:17:50.846+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:17:51.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:51.133+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:52.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:52.127+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:53.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:53.087+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:54.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:54.086+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:55.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:55.054+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:55.847 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:17:55.847+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:17:56.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:56.030+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:57.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:57.030+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:57.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:57.987+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:58.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:58.947+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:17:59.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:17:59.999+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:00.848 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:18:00.848+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:18:00.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:00.957+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:01.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:01.965+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:02.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:02.927+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:03.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:03.936+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:04.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:04.970+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:05.850 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:18:05.849+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:18:06.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:05.949+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:06.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:06.981+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:07.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:07.988+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:08.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:08.991+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:10.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:10.021+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:10.850 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:18:10.850+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:18:10.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:10.982+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:11.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:11.938+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:12.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:12.902+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:13.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:13.938+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:14.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:14.918+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:15.851 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:18:15.851+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:18:15.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:15.940+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:16.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:16.946+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:17.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:17.947+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:18.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:18.927+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:19.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:19.928+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:20.853 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:18:20.852+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:18:20.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:20.973+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:21.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:21.948+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:22.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:22.956+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:23.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:23.958+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:24.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:24.937+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:25.853 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:18:25.853+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:18:25.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:25.978+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:26.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:26.982+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:27.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:27.998+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:29.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:29.044+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:30.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:30.089+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:30.854 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:18:30.854+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:18:31.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:31.066+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:32.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:32.067+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:33.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:33.067+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:34.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:34.105+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:35.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:35.122+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:35.855 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:18:35.855+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:18:36.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:36.150+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:37.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:37.150+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:38.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:38.125+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:39.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:39.097+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:40.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:40.142+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:40.856 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:18:40.856+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:18:41.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:41.176+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:42.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:42.183+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:43.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:43.166+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:44.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:44.205+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:45.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:45.201+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:45.857 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:18:45.857+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:18:46.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:46.200+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:47.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:47.190+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:48.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:48.224+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:49.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:49.274+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:50.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:50.275+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:50.858 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:18:50.858+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:18:51.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:51.253+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:52.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:52.236+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:53.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:53.264+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:54.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:54.285+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:55.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:55.288+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:55.859 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:18:55.859+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:18:56.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:56.329+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:57.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:57.302+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:58.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:58.262+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:18:59.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:18:59.282+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:00.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:00.271+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:00.860 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:19:00.860+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:19:01.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:01.276+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:02.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:02.317+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:03.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:03.311+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:04.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:04.266+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:05.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:05.219+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:05.861 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:19:05.861+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:19:06.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:06.188+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:07.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:07.165+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:08.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:08.183+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:09.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:09.147+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:10.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:10.162+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:10.862 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:19:10.862+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:19:11.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:11.200+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:12.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:12.236+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:13.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:13.250+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:14.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:14.265+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:15.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:15.217+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:15.863 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:19:15.863+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:19:16.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:16.222+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:17.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:17.265+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:18.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:18.275+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:19.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:19.249+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:20.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:20.206+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:20.864 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:19:20.864+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:19:21.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:21.182+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:22.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:22.142+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:23.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:23.185+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:24.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:24.150+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:25.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:25.117+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:25.864 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:19:25.865+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:19:26.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:26.086+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:27.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:27.042+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:27.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:27.998+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:29.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:29.017+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:30.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:30.052+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:30.865 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:19:30.866+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:19:31.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:31.059+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:32.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:32.042+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:33.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:33.047+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:34.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:34.081+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:35.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:35.132+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:35.866 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:19:35.866+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:19:36.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:36.164+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:37.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:37.139+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:38.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:38.148+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:39.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:39.165+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:40.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:40.181+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:40.867 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:19:40.867+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:19:41.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:41.134+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:42.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:42.098+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:43.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:43.149+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:44.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:44.118+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:45.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:45.073+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:45.868 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:19:45.868+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:19:46.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:46.120+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:47.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:47.145+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:48.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:48.125+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:49.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:49.122+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:50.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:50.074+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:50.869 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:19:50.869+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:19:51.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:51.094+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:52.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:52.112+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:53.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:53.147+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:54.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:54.167+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:55.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:55.192+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:55.870 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:19:55.871+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:19:56.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:56.218+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:57.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:57.210+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:58.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:58.208+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:19:59.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:19:59.159+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:00.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:00.202+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:00.872 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:20:00.872+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:20:01.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:01.194+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:02.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:02.164+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:03.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:03.205+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:04.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:04.198+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:05.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:05.148+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:05.872 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:20:05.872+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:20:06.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:06.104+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:07.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:07.081+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:08.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:08.055+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:09.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:09.105+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:10.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:10.114+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:10.874 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:20:10.874+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:20:11.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:11.100+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:12.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:12.071+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:13.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:13.022+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:14.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:14.023+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:14.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:14.989+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:15.874 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:20:15.874+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:20:15.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:15.983+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:16.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:16.946+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:17.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:17.951+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:18.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:18.925+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:19.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:19.957+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:20.875 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:20:20.875+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:20:20.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:20.930+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:21.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:21.915+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:22.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:22.932+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:23.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:23.960+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:24.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:24.963+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:25.876 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:20:25.876+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:20:26.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:26.008+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:27.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:27.049+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:28.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:28.042+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:29.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:29.072+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:30.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:30.050+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:30.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:20:30.877+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:20:31.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:31.036+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:32.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:32.002+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:33.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:33.006+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:34.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:34.011+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:35.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:35.018+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:35.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:20:35.878+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:20:36.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:36.011+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:37.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:37.020+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:37.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:37.990+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:38.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:38.943+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:39.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:39.989+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:40.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:20:40.879+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:20:40.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:40.965+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:41.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:41.976+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:42.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:42.968+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:43.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:43.998+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:44.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:44.951+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:45.881 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:20:45.881+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:20:45.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:45.915+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:46.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:46.948+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:47.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:47.973+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:48.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:48.991+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:49.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:49.951+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:50.881 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:20:50.881+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:20:50.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:50.944+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:51.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:51.982+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:53.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:53.009+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:54.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:54.036+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:55.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:55.078+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:55.882 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:20:55.883+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:20:56.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:56.119+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:57.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:57.147+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:58.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:58.163+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:20:59.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:20:59.159+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:00.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:00.204+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:00.883 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:21:00.883+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:21:01.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:01.191+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:02.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:02.190+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:03.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:03.230+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:04.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:04.212+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:05.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:05.175+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:05.885 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:21:05.884+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:21:06.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:06.177+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:07.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:07.220+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:08.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:08.185+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:09.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:09.230+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:10.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:10.237+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:10.886 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:21:10.886+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:21:11.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:11.205+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:12.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:12.164+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:13.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:13.190+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:14.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:14.183+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:15.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:15.158+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:15.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:21:15.887+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:21:16.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:16.163+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:17.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:17.143+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:18.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:18.130+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:19.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:19.119+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:20.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:20.110+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:20.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:21:20.888+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:21:21.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:21.100+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:22.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:22.127+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:23.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:23.081+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:24.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:24.059+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:25.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:25.082+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:25.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:21:25.888+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:21:26.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:26.110+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:27.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:27.158+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:28.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:28.116+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:29.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:29.093+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:30.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:30.090+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:30.889 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:21:30.889+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:21:31.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:31.045+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:32.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:32.080+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:33.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:33.125+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:34.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:34.147+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:35.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:35.105+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:35.890 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:21:35.890+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:21:36.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:36.140+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:37.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:37.169+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:38.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:38.191+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:39.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:39.216+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:40.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:40.225+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:40.891 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:21:40.891+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:21:41.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:41.222+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:42.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:42.193+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:43.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:43.208+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:44.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:44.173+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:45.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:45.212+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:45.892 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:21:45.892+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:21:46.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:46.181+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:47.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:47.184+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:48.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:48.172+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:49.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:49.210+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:50.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:50.211+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:50.893 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:21:50.893+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:21:51.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:51.191+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:52.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:52.199+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:53.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:53.201+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:54.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:54.243+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:55.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:55.286+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:55.894 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:21:55.894+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:21:56.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:56.324+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:57.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:57.328+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:58.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:58.378+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:21:59.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:21:59.371+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:00.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:00.393+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:00.895 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:22:00.895+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:22:01.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:01.365+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:02.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:02.390+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:03.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:03.343+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:04.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:04.358+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:05.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:05.374+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:05.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:22:05.896+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:22:06.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:06.353+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:07.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:07.379+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:08.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:08.332+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:09.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:09.293+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:10.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:10.289+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:10.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:22:10.898+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:22:11.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:11.251+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:12.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:12.246+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:13.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:13.243+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:14.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:14.281+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:15.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:15.268+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:15.898 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:22:15.898+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:22:16.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:16.268+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:17.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:17.253+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:18.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:18.264+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:19.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:19.283+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:20.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:20.298+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:20.899 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:22:20.900+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:22:21.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:21.328+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:22.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:22.319+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:23.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:23.286+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:24.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:24.271+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:25.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:25.283+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:25.900 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:22:25.901+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:22:26.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:26.285+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:27.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:27.292+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:28.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:28.324+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:29.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:29.341+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:30.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:30.353+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:30.901 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:22:30.901+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:22:31.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:31.310+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:32.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:32.305+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:33.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:33.260+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:34.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:34.243+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:35.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:35.245+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:35.901 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:22:35.901+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:22:36.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:36.199+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:37.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:37.204+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:38.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:38.211+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:39.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:39.236+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:40.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:40.221+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:40.902 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:22:40.903+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:22:41.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:41.270+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:42.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:42.294+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:43.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:43.310+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:44.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:44.290+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:45.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:45.257+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:45.904 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:22:45.904+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:22:46.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:46.249+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:47.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:47.232+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:48.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:48.260+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:49.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:49.295+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:50.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:50.305+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:50.904 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:22:50.904+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:22:51.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:51.346+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:52.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:52.326+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:53.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:53.364+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:54.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:54.359+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:55.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:55.329+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:55.905 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:22:55.905+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:22:56.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:56.341+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:57.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:57.327+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:58.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:58.330+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:22:59.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:22:59.283+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:00.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:00.285+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:00.906 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:23:00.906+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:23:01.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:01.240+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:02.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:02.223+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:03.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:03.222+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:04.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:04.211+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:05.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:05.192+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:05.907 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:23:05.907+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:23:06.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:06.237+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:07.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:07.269+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:08.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:08.289+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:09.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:09.300+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:10.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:10.338+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:10.908 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:23:10.908+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:23:11.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:11.326+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:12.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:12.309+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:13.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:13.326+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:14.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:14.351+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:15.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:15.342+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:15.908 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:23:15.908+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:23:16.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:16.320+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:17.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:17.348+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:18.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:18.349+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:19.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:19.339+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:20.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:20.295+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:20.910 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:23:20.910+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:23:21.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:21.272+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:22.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:22.280+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:23.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:23.233+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:24.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:24.261+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:25.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:25.279+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:25.911 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:23:25.911+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:23:26.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:26.304+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:27.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:27.337+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:28.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:28.346+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:29.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:29.324+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:30.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:30.305+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:30.913 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:23:30.912+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:23:31.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:31.259+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:32.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:32.243+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:33.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:33.207+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:34.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:34.169+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:35.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:35.127+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:35.913 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:23:35.913+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:23:36.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:36.157+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:37.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:37.197+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:38.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:38.185+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:39.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:39.137+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:40.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:40.142+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:40.914 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:23:40.914+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:23:41.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:41.175+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:42.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:42.155+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:43.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:43.147+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:44.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:44.184+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:45.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:45.139+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:46.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:46.117+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:47.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:47.115+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:48.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:48.161+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:49.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:49.161+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:50.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:50.122+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:50.916 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:23:50.916+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:23:51.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:51.083+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:52.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:52.056+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:53.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:53.084+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:54.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:54.131+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:55.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:55.105+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:55.917 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:23:55.917+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:23:56.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:56.139+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:57.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:57.106+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:58.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:58.061+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:23:59.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:23:59.043+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:00.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:00.008+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:00.918 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:24:00.918+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:24:01.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:01.010+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:01.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:01.983+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:03.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:03.023+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:04.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:04.069+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:05.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:05.044+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:05.919 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:24:05.919+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:24:06.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:06.049+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:07.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:07.000+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:07.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:07.964+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:08.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:08.987+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:10.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:10.034+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:10.920 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:24:10.920+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:24:11.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:11.058+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:12.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:12.086+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:13.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:13.048+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:14.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:14.029+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:14.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:14.992+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:15.921 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:24:15.921+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:24:15.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:15.986+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:16.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:16.954+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:17.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:17.905+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:18.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:18.872+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:19.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:19.831+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:20.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:20.801+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:20.922 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:24:20.923+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:24:21.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:21.824+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:22.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:22.825+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:23.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:23.796+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:24.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:24.818+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:25.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:25.834+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:25.923 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:24:25.923+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:24:26.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:26.883+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:27.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:27.915+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:28.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:28.938+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:29.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:29.971+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:30.924 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:24:30.924+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:24:30.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:30.971+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:31.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:31.980+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:32.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:32.968+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:33.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:33.966+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:35.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:35.004+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:35.925 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:24:35.925+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:24:36.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:36.051+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:37.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:37.051+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:38.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:38.048+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:39.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:39.012+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:39.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:39.969+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:40.926 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:24:40.926+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:24:40.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:40.984+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:41.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:41.959+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:43.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:43.003+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:43.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:43.980+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:45.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:45.023+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:45.927 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:24:45.927+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:24:46.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:46.041+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:47.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:47.067+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:48.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:48.026+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:49.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:49.023+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:50.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:50.049+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:50.928 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:24:50.928+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:24:51.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:51.070+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:52.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:52.024+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:53.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:53.044+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:54.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:54.072+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:55.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:55.053+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:55.929 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:24:55.929+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:24:56.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:56.093+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:57.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:57.135+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:58.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:58.165+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:24:59.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:24:59.149+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:00.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:00.107+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:00.931 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:25:00.931+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:25:01.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:01.077+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:02.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:02.119+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:03.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:03.156+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:04.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:04.131+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:05.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:05.098+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:05.931 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:25:05.931+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:25:06.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:06.080+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:07.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:07.034+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:08.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:08.040+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:09.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:09.015+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:10.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:10.061+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:10.932 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:25:10.934+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:25:11.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:11.064+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:12.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:12.113+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:13.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:13.125+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:14.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:14.174+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:15.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:15.167+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:15.934 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:25:15.934+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:25:16.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:16.123+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:17.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:17.101+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:18.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:18.139+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:19.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:19.130+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:20.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:20.129+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:20.935 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:25:20.936+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:25:21.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:21.178+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:22.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:22.228+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:23.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:23.274+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:24.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:24.291+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:25.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:25.324+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:25.936 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:25:25.937+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:25:26.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:26.307+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:27.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:27.266+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:28.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:28.254+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:29.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:29.269+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:30.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:30.231+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:30.936 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:25:30.936+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:25:31.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:31.238+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:32.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:32.204+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:33.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:33.225+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:34.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:34.187+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:35.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:35.234+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:35.937 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:25:35.937+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:25:36.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:36.281+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:37.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:37.268+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:38.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:38.280+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:39.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:39.275+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:40.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:40.232+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:40.939 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:25:40.939+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:25:41.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:41.220+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:42.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:42.194+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:43.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:43.174+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:44.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:44.221+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:45.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:45.270+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:45.940 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:25:45.940+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:25:46.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:46.234+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:47.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:47.280+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:48.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:48.315+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:49.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:49.351+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:50.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:50.338+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:50.940 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:25:50.940+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:25:51.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:51.358+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:52.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:52.364+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:53.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:53.358+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:54.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:54.389+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:55.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:55.424+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:55.941 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:25:55.941+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:25:56.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:56.392+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:57.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:57.407+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:58.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:58.415+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:25:59.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:25:59.394+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:00.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:00.348+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:00.943 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:26:00.943+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:26:01.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:01.370+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:02.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:02.402+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:03.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:03.386+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:04.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:04.393+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:05.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:05.396+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:05.943 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:26:05.943+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:26:06.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:06.441+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:07.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:07.428+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:08.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:08.446+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:09.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:09.488+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:10.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:10.458+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:10.945 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:26:10.945+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:26:11.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:11.417+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:12.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:12.465+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:13.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:13.451+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:14.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:14.468+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:15.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:15.474+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:15.945 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:26:15.946+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:26:16.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:16.448+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:17.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:17.459+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:18.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:18.509+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:19.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:19.463+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:20.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:20.508+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:20.947 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:26:20.946+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:26:21.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:21.496+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:22.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:22.468+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:23.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:23.431+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:24.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:24.432+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:25.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:25.438+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:25.947 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:26:25.948+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:26:26.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:26.428+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:27.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:27.420+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:28.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:28.418+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:29.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:29.466+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:30.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:30.470+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:30.948 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:26:30.949+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:26:31.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:31.423+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:32.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:32.439+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:33.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:33.467+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:34.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:34.493+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:35.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:35.532+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:35.949 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:26:35.950+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:26:36.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:36.507+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:37.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:37.504+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:38.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:38.509+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:39.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:39.479+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:40.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:40.524+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:40.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:26:40.951+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:26:41.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:41.476+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:42.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:42.454+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:43.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:43.444+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:44.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:44.482+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:45.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:45.524+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:45.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:26:45.951+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:26:46.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:46.557+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:47.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:47.578+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:48.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:48.555+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:49.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:49.549+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:50.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:50.561+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:50.952 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:26:50.952+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:26:51.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:51.523+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:52.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:52.519+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:53.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:53.541+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:54.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:54.531+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:55.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:55.543+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:55.954 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:26:55.954+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:26:56.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:56.542+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:57.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:57.588+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:58.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:58.614+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:26:59.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:26:59.587+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:00.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:00.549+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:00.954 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:27:00.954+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:27:01.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:01.506+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:02.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:02.524+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:03.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:03.540+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:04.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:04.525+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:05.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:05.537+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:05.956 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:27:05.955+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:27:06.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:06.518+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:07.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:07.566+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:08.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:08.589+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:09.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:09.629+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:10.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:10.631+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:10.956 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:27:10.956+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:27:11.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:11.680+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:12.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:12.685+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:13.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:13.665+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:14.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:14.709+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:15.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:15.689+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:15.957 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:27:15.957+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:27:16.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:16.684+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:17.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:17.663+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:18.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:18.617+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:19.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:19.610+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:20.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:20.602+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:20.958 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:27:20.958+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:27:21.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:21.624+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:22.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:22.597+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:23.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:23.620+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:24.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:24.650+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:25.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:25.628+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:25.959 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:27:25.959+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:27:26.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:26.581+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:27.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:27.608+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:28.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:28.655+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:29.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:29.696+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:30.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:30.732+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:30.960 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:27:30.960+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:27:31.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:31.730+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:32.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:32.747+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:33.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:33.762+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:34.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:34.730+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:35.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:35.710+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:35.961 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:27:35.961+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:27:36.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:36.720+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:37.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:37.752+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:38.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:38.797+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:39.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:39.810+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:40.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:40.821+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:40.962 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:27:40.962+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:27:41.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:41.851+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:42.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:42.872+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:43.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:43.853+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:44.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:44.856+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:45.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:45.863+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:45.963 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:27:45.963+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:27:46.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:46.856+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:47.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:47.845+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:48.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:48.887+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:49.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:49.905+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:50.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:50.863+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:50.964 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:27:50.964+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:27:51.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:51.899+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:52.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:52.877+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:53.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:53.876+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:54.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:54.842+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:55.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:55.851+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:55.965 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:27:55.965+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:27:56.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:56.891+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:57.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:57.917+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:58.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:58.915+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:27:59.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:27:59.891+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:00.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:00.903+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:00.967 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:28:00.966+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:28:01.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:01.855+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:02.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:02.829+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:03.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:03.830+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:04.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:04.806+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:05.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:05.823+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:05.967 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:28:05.967+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:28:06.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:06.843+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:07.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:07.845+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:08.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:08.883+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:09.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:09.914+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:10.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:10.882+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:10.968 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:28:10.968+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:28:11.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:11.901+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:12.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:12.862+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:13.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:13.907+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:14.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:14.895+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:15.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:15.922+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:15.969 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:28:15.970+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:28:16.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:16.966+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:17.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:17.944+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:18.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:18.980+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:19.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:19.993+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:20.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:20.958+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:20.970 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:28:20.971+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:28:21.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:21.955+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:22.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:22.958+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:23.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:23.976+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:24.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:24.949+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:25.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:25.918+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:25.971 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:28:25.972+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:28:26.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:26.913+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:27.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:27.928+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:28.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:28.976+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:29.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:29.993+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:30.971 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:28:30.973+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:28:31.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:31.033+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:32.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:32.013+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:32.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:32.986+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:34.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:34.030+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:34.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:34.993+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:35.972 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:28:35.972+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:28:36.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:36.002+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:36.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:36.959+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:37.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:37.935+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:38.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:38.915+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:39.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:39.909+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:40.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:40.930+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:40.973 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:28:40.973+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:28:41.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:41.907+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:42.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:42.887+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:43.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:43.845+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:44.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:44.866+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:45.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:45.818+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:45.974 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:28:45.974+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:28:46.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:46.832+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:47.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:47.819+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:48.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:48.861+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:49.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:49.894+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:50.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:50.854+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:50.975 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:28:50.975+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:28:51.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:51.865+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:52.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:52.871+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:53.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:53.898+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:54.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:54.860+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:55.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:55.896+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:55.976 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:28:55.976+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:28:56.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:56.851+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:57.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:57.880+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:58.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:58.836+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:28:59.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:28:59.821+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:00.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:00.853+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:00.977 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:29:00.977+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:29:01.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:01.818+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:02.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:02.784+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:03.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:03.798+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:04.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:04.841+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:05.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:05.848+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:05.977 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:29:05.977+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:29:06.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:06.878+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:07.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:07.855+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:08.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:08.876+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:09.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:09.886+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:10.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:10.920+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:10.978 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:29:10.978+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:29:11.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:11.927+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:12.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:12.962+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:14.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:14.001+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:15.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:15.051+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:15.979 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:29:15.979+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:29:16.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:16.058+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:17.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:17.015+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:18.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:18.016+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:19.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:19.049+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:20.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:20.046+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:20.981 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:29:20.981+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:29:21.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:21.080+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:22.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:22.038+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:23.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:23.018+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:23.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:23.995+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:25.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:25.032+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:25.982 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:29:25.982+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:29:26.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:26.029+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:27.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:27.023+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:27.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:27.997+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:29.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:29.002+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:29.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:29.972+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:30.983 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:29:30.983+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:29:31.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:31.009+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:32.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:32.042+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:33.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:33.092+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:34.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:34.049+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:35.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:35.084+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:35.984 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:29:35.984+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:29:36.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:36.102+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:37.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:37.134+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:38.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:38.123+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:39.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:39.150+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:40.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:40.164+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:40.985 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:29:40.985+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:29:41.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:41.155+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:42.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:42.136+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:43.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:43.159+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:44.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:44.110+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:45.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:45.143+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:45.986 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:29:45.986+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:29:46.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:46.126+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:47.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:47.094+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:48.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:48.112+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:49.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:49.161+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:50.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:50.113+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:50.987 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:29:50.987+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:29:51.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:51.125+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:52.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:52.151+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:53.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:53.146+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:54.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:54.183+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:55.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:55.211+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:55.988 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:29:55.988+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:29:56.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:56.201+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:57.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:57.193+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:58.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:58.148+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:29:59.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:29:59.146+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:00.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:00.125+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:00.989 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:30:00.989+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:30:01.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:01.158+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:02.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:02.124+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:03.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:03.124+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:04.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:04.079+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:05.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:05.049+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:05.990 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:30:05.990+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:30:06.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:06.085+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:07.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:07.096+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:08.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:08.128+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:09.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:09.175+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:10.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:10.158+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:10.991 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:30:10.992+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:30:11.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:11.173+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:12.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:12.190+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:13.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:13.211+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:14.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:14.251+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:15.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:15.249+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:15.992 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:30:15.993+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:30:16.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:16.261+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:17.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:17.214+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:18.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:18.231+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:19.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:19.222+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:20.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:20.189+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:20.993 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:30:20.994+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:30:21.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:21.164+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:22.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:22.118+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:23.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:23.089+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:24.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:24.095+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:25.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:25.145+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:25.994 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:30:25.994+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:30:26.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:26.134+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:27.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:27.143+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:28.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:28.138+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:29.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:29.127+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:30.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:30.113+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:30.995 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:30:30.995+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:30:31.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:31.099+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:32.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:32.125+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:33.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:33.153+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:34.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:34.147+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:35.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:35.137+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:35.996 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:30:35.996+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:30:36.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:36.125+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:37.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:37.106+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:38.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:38.149+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:39.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:39.167+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:40.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:40.128+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:40.998 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:30:40.998+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:30:41.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:41.162+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:42.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:42.137+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:43.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:43.157+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:44.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:44.189+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:45.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:45.200+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:45.999 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:30:45.998+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:30:46.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:46.230+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:47.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:47.256+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:48.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:48.243+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:49.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:49.261+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:50.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:50.245+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:50.999 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:30:50.999+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:30:51.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:51.201+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:52.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:52.176+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:53.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:53.128+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:54.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:54.087+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:55.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:55.090+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:56.001 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:30:56.000+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:30:56.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:56.084+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:57.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:57.089+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:58.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:58.042+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:30:59.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:30:59.074+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:00.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:00.080+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:01.001 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:31:01.001+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:31:01.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:01.107+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:02.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:02.109+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:03.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:03.090+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:04.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:04.070+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:05.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:05.063+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:06.002 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:31:06.002+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:31:06.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:06.030+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:07.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:07.080+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:08.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:08.099+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:09.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:09.145+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:10.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:10.106+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:11.003 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:31:11.003+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:31:11.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:11.148+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:12.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:12.147+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:13.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:13.097+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:14.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:14.094+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:15.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:15.068+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:16.004 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:31:16.004+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:31:16.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:16.078+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:17.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:17.034+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:18.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:18.069+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:19.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:19.105+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:20.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:20.112+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:21.005 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:31:21.005+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:31:21.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:21.071+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:22.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:22.053+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:23.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:23.041+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:24.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:24.079+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:25.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:25.042+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:26.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:26.000+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:26.006 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:31:26.006+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:31:27.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:27.006+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:28.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:28.054+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:29.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:29.051+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:30.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:30.027+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:30.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:30.991+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:31.007 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:31:31.007+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:31:32.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:32.016+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:33.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:33.023+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:34.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:34.023+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:35.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:35.065+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:36.008 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:31:36.009+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:31:36.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:36.057+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:37.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:37.078+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:38.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:38.101+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:39.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:39.067+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:40.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:40.049+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:40.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:41.000+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:41.008 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:31:41.010+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:31:41.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:41.974+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:42.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:42.973+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:43.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:43.976+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:44.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:44.975+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:45.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:45.956+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:46.009 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:31:46.009+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:31:46.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:46.954+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:47.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:47.941+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:48.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:48.967+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:49.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:49.990+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:50.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:50.994+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:51.010 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:31:51.010+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:31:51.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:51.994+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:53.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:53.032+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:54.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:54.063+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:55.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:55.036+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:56.011 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:31:56.012+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:31:56.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:56.059+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:57.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:57.038+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:58.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:58.016+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:58.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:58.993+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:31:59.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:31:59.967+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:00.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:00.976+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:01.012 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:32:01.013+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:32:01.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:01.982+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:02.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:02.974+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:03.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:03.941+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:04.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:04.962+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:06.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:06.005+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:06.013 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:32:06.014+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:32:07.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:07.046+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:08.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:08.057+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:09.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:09.047+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:10.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:10.055+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:11.014 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:32:11.014+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:32:11.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:11.097+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:12.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:12.094+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:13.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:13.072+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:14.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:14.107+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:15.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:15.120+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:16.015 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:32:16.016+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:32:16.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:16.099+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:17.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:17.076+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:18.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:18.124+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:19.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:19.140+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:20.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:20.174+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:21.016 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:32:21.016+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:32:21.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:21.184+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:22.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:22.223+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:23.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:23.239+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:24.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:24.200+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:25.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:25.213+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:26.017 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:32:26.017+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:32:26.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:26.238+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:27.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:27.258+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:28.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:28.258+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:29.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:29.213+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:30.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:30.208+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:31.018 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:32:31.018+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:32:31.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:31.173+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:32.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:32.158+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:33.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:33.114+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:34.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:34.157+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:35.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:35.160+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:36.019 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:32:36.019+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:32:36.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:36.182+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:37.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:37.213+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:38.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:38.167+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:39.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:39.129+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:40.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:40.088+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:41.021 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:32:41.020+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:32:41.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:41.123+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:42.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:42.165+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:43.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:43.173+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:44.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:44.138+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:45.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:45.112+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:46.021 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:32:46.021+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:32:46.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:46.129+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:47.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:47.142+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:48.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:48.156+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:49.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:49.128+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:50.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:50.099+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:51.024 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:32:51.022+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:32:51.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:51.098+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:52.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:52.065+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:53.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:53.040+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:54.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:54.075+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:55.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:55.037+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:56.023 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:32:56.023+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:32:56.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:56.041+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:57.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:57.009+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:58.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:58.031+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:59.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:59.012+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:32:59.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:32:59.967+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:00.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:00.961+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:01.024 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:33:01.024+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:33:01.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:01.918+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:02.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:02.931+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:03.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:03.947+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:04.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:04.965+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:05.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:05.991+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:06.025 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:33:06.025+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:33:07.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:07.013+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:07.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:07.974+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:09.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:09.011+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:10.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:10.028+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:10.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:10.983+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:11.026 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:33:11.026+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:33:11.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:11.954+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:12.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:12.982+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:13.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:13.953+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:14.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:14.986+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:16.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:16.005+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:16.027 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:33:16.027+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:33:17.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:17.054+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:18.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:18.019+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:18.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:18.984+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:20.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:20.019+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:20.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:20.977+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:21.027 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:33:21.027+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:33:21.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:21.953+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:22.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:22.981+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:23.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:23.967+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:24.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:24.942+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:25.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:25.961+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:26.028 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:33:26.028+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:33:27.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:27.008+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:28.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:28.016+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:28.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:28.969+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:29.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:29.990+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:31.029 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:33:31.029+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:33:31.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:31.033+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:32.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:32.004+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:33.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:33.031+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:34.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:34.012+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:34.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:34.995+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:36.029 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:33:36.030+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:33:36.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:36.043+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:37.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:37.043+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:38.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:38.035+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:39.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:39.078+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:40.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:40.104+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:41.030 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:33:41.031+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:33:41.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:41.067+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:42.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:42.096+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:43.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:43.143+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:44.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:44.123+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:45.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:45.132+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:46.031 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:33:46.032+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:33:46.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:46.086+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:47.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:47.079+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:48.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:48.077+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:49.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:49.059+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:50.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:50.022+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:50.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:50.996+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:51.032 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:33:51.033+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:33:51.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:51.983+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:52.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:52.966+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:53.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:53.989+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:54.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:54.952+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:55.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:55.947+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:56.033 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:33:56.033+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:33:56.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:56.930+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:57.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:57.972+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:58.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:58.945+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:33:59.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:33:59.982+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:00.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:00.945+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:01.034 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:34:01.034+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:34:01.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:01.926+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:02.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:02.880+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:03.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:03.838+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:04.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:04.849+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:05.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:05.819+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:06.035 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:34:06.035+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:34:06.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:06.790+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:07.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:07.795+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:08.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:08.793+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:09.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:09.752+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:10.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:10.719+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:11.036 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:34:11.036+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:34:11.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:11.750+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:12.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:12.770+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:13.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:13.767+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:14.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:14.731+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:15.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:15.757+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:16.038 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:34:16.038+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:34:16.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:16.731+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:17.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:17.761+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:18.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:18.764+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:19.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:19.741+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:20.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:20.784+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:21.039 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:34:21.039+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:34:21.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:21.749+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:22.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:22.732+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:23.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:23.715+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:24.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:24.709+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:25.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:25.731+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:26.041 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:34:26.041+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:34:26.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:26.711+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:27.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:27.732+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:28.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:28.768+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:29.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:29.760+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:30.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:30.719+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:31.042 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:34:31.042+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:34:31.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:31.684+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:32.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:32.657+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:33.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:33.699+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:34.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:34.704+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:35.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:35.701+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:36.043 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:34:36.044+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:34:36.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:36.675+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:37.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:37.657+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:38.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:38.618+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:39.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:39.598+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:40.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:40.584+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:41.044 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:34:41.045+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:34:41.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:41.553+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:42.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:42.512+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:43.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:43.539+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:44.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:44.496+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:45.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:45.510+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:46.045 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:34:46.046+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:34:46.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:46.557+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:47.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:47.527+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:48.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:48.570+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:49.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:49.607+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:50.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:50.560+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:51.045 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:34:51.047+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:34:51.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:51.518+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:52.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:52.487+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:53.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:53.496+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:54.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:54.464+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:55.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:55.461+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:56.046 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:34:56.046+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:34:56.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:56.482+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:57.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:57.503+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:58.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:58.478+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:34:59.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:34:59.523+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:00.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:00.519+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:01.047 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:35:01.047+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:35:01.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:01.545+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:02.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:02.594+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:03.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:03.607+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:04.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:04.597+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:05.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:05.592+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:06.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:35:06.048+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:35:06.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:06.601+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:07.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:07.644+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:08.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:08.609+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:09.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:09.596+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:10.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:10.615+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:11.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:35:11.049+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:35:11.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:11.601+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:12.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:12.594+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:13.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:13.603+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:14.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:14.623+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:15.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:15.581+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:16.050 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:35:16.050+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:35:16.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:16.601+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:17.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:17.638+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:18.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:18.602+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:19.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:19.554+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:20.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:20.519+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:21.051 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:35:21.051+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:35:21.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:21.518+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:22.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:22.536+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:23.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:23.545+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:24.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:24.568+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:25.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:25.588+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:26.052 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:35:26.052+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:35:26.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:26.552+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:27.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:27.595+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:28.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:28.587+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:29.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:29.580+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:30.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:30.556+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:31.053 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:35:31.053+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:35:31.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:31.511+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:32.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:32.494+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:33.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:33.518+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:34.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:34.556+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:35.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:35.512+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:36.054 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:35:36.054+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:35:36.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:36.475+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:37.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:37.508+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:38.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:38.475+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:39.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:39.483+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:40.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:40.470+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:41.055 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:35:41.055+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:35:41.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:41.477+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:42.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:42.434+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:43.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:43.394+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:44.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:44.422+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:45.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:45.458+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:46.057 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:35:46.056+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:35:46.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:46.427+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:47.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:47.422+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:48.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:48.406+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:49.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:49.371+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:50.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:50.405+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:51.057 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:35:51.057+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:35:51.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:51.436+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:52.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:52.404+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:53.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:53.399+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:54.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:54.380+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:55.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:55.416+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:56.058 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:35:56.058+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:35:56.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:56.402+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:57.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:57.446+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:58.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:58.490+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:35:59.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:35:59.522+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:00.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:00.485+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:01.059 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:36:01.060+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:36:01.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:01.517+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:02.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:02.518+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:03.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:03.514+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:04.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:04.505+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:05.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:05.484+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:06.060 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:36:06.060+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:36:06.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:06.514+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:07.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:07.485+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:08.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:08.445+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:09.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:09.427+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:10.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:10.398+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:11.061 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:36:11.061+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:36:11.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:11.414+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:12.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:12.377+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:13.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:13.356+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:14.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:14.353+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:15.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:15.347+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:16.062 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:36:16.062+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:36:16.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:16.393+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:17.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:17.399+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:18.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:18.361+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:19.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:19.315+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:20.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:20.306+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:21.063 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:36:21.063+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:36:21.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:21.263+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:22.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:22.268+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:23.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:23.219+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:24.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:24.246+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:25.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:25.272+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:26.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:26.319+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:27.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:27.316+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:28.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:28.310+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:29.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:29.295+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:30.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:30.299+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:31.065 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:36:31.066+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:36:31.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:31.318+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:32.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:32.326+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:33.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:33.317+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:34.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:34.306+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:35.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:35.299+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:36.066 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:36:36.066+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:36:36.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:36.288+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:37.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:37.247+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:38.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:38.277+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:39.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:39.312+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:40.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:40.323+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:41.067 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:36:41.067+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:36:41.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:41.361+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:42.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:42.334+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:43.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:43.366+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:44.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:44.339+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:45.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:45.323+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:46.068 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:36:46.068+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:36:46.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:46.310+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:47.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:47.262+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:48.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:48.284+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:49.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:49.240+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:50.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:50.256+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:51.069 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:36:51.069+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:36:51.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:51.236+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:52.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:52.264+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:53.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:53.259+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:54.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:54.241+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:55.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:55.281+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:56.070 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:36:56.070+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:36:56.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:56.316+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:57.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:57.310+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:58.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:58.323+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:36:59.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:36:59.339+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:00.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:00.329+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:01.071 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:37:01.071+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:37:01.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:01.326+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:02.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:02.297+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:03.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:03.308+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:04.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:04.318+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:05.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:05.355+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:06.072 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:37:06.072+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:37:06.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:06.330+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:07.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:07.292+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:08.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:08.285+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:09.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:09.269+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:10.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:10.259+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:11.073 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:37:11.073+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:37:11.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:11.223+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:12.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:12.269+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:13.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:13.307+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:14.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:14.288+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:15.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:15.338+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:16.074 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:37:16.074+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:37:16.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:16.320+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:17.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:17.334+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:18.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:18.300+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:19.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:19.336+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:20.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:20.368+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:21.075 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:37:21.075+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:37:21.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:21.340+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:22.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:22.377+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:23.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:23.372+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:24.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:24.365+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:25.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:25.348+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:26.075 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:37:26.076+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:37:26.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:26.380+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:27.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:27.334+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:28.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:28.294+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:29.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:29.343+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:30.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:30.323+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:31.076 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:37:31.077+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:37:31.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:31.298+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:32.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:32.320+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:33.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:33.314+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:34.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:34.337+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:35.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:35.381+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:36.078 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:37:36.078+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:37:36.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:36.414+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:37.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:37.400+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:38.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:38.398+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:39.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:39.426+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:40.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:40.458+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:41.078 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:37:41.079+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:37:41.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:41.478+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:42.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:42.437+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:43.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:43.427+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:44.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:44.394+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:45.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:45.423+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:46.080 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:37:46.080+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:37:46.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:46.424+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:47.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:47.411+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:48.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:48.429+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:49.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:49.453+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:50.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:50.471+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:51.081 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:37:51.082+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:37:51.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:51.432+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:52.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:52.472+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:53.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:53.478+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:54.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:54.474+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:55.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:55.494+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:56.082 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:37:56.084+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:37:56.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:56.504+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:57.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:57.515+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:58.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:58.551+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:37:59.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:37:59.532+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:00.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:00.580+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:01.083 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:38:01.084+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:38:01.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:01.630+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:02.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:02.621+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:03.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:03.604+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:04.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:04.623+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:05.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:05.661+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:06.084 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:38:06.086+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:38:06.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:06.673+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:07.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:07.709+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:08.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:08.723+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:09.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:09.718+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:10.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:10.696+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:11.085 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:38:11.086+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:38:11.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:11.659+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:12.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:12.647+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:13.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:13.674+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:14.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:14.689+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:15.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:15.655+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:16.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:38:16.086+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:38:16.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:16.634+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:17.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:17.661+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:18.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:18.666+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:19.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:19.673+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:20.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:20.723+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:21.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:38:21.088+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:38:21.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:21.721+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:22.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:22.738+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:23.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:23.759+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:24.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:24.753+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:25.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:25.765+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:26.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:38:26.089+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:38:26.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:26.787+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:27.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:27.776+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:28.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:28.766+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:29.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:29.757+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:30.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:30.727+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:38:31.089+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:38:31.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:31.718+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:32.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:32.705+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:33.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:33.753+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:34.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:34.735+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:35.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:35.704+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:36.090 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:38:36.090+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:38:36.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:36.729+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:37.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:37.707+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:38.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:38.704+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:39.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:39.733+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:40.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:40.779+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:41.091 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:38:41.091+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:38:41.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:41.789+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:42.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:42.792+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:43.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:43.751+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:44.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:44.766+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:45.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:45.773+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:46.092 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:38:46.092+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:38:46.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:46.726+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:47.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:47.684+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:48.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:48.708+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:49.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:49.675+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:50.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:50.682+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:51.093 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:38:51.093+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:38:51.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:51.683+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:52.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:52.693+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:53.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:53.648+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:54.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:54.662+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:55.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:55.621+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:56.094 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:38:56.094+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:38:56.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:56.632+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:57.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:57.675+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:58.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:58.690+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:38:59.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:38:59.689+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:00.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:00.702+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:01.095 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:39:01.095+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:39:01.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:01.691+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:02.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:02.658+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:03.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:03.707+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:04.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:04.677+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:05.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:05.703+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:06.096 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:39:06.096+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:39:06.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:06.703+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:07.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:07.721+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:08.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:08.761+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:09.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:09.733+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:10.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:10.760+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:11.097 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:39:11.097+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:39:11.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:11.751+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:12.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:12.716+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:13.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:13.760+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:14.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:14.723+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:15.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:15.687+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:16.098 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:39:16.098+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:39:16.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:16.650+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:17.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:17.671+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:18.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:18.679+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:19.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:19.645+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:20.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:20.653+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:21.099 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:39:21.099+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:39:21.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:21.659+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:22.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:22.686+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:23.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:23.710+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:24.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:24.754+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:25.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:25.793+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:26.100 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:39:26.100+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:39:26.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:26.823+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:27.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:27.835+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:28.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:28.874+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:29.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:29.870+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:30.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:30.858+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:31.101 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:39:31.101+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:39:31.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:31.879+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:32.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:32.890+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:33.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:33.886+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:34.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:34.869+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:35.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:35.899+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:36.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:39:36.102+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:39:36.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:36.866+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:37.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:37.852+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:38.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:38.892+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:39.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:39.853+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:40.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:40.880+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:41.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:39:41.104+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:39:41.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:41.869+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:42.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:42.868+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:43.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:43.839+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:44.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:44.803+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:45.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:45.847+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:46.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:39:46.104+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:39:46.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:46.809+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:47.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:47.822+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:48.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:48.825+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:49.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:49.851+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:50.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:50.805+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:51.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:39:51.105+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:39:51.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:51.835+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:52.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:52.858+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:53.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:53.886+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:54.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:54.855+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:55.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:55.873+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:56.106 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:39:56.106+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:39:56.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:56.865+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:57.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:57.909+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:58.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:58.912+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:39:59.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:39:59.951+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:00.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:00.976+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:01.107 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:40:01.107+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:40:01.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:01.984+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:02.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:02.935+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:03.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:03.974+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:04.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:04.937+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:05.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:05.950+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:06.108 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:40:06.108+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:40:06.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:06.934+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:07.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:07.910+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:08.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:08.882+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:09.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:09.857+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:10.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:10.886+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:11.109 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:40:11.109+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:40:11.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:11.885+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:12.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:12.838+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:13.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:13.804+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:14.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:14.761+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:15.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:15.722+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:16.110 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:40:16.110+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:40:16.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:16.677+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:17.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:17.712+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:18.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:18.703+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:19.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:19.672+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:20.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:20.672+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:21.111 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:40:21.111+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:40:21.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:21.674+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:22.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:22.677+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:23.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:23.636+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:24.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:24.610+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:25.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:25.587+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:26.112 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:40:26.112+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:40:26.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:26.599+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:27.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:27.631+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:28.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:28.666+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:29.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:29.701+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:30.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:30.716+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:31.113 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:40:31.113+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:40:31.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:31.698+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:32.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:32.672+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:33.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:33.684+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:34.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:34.640+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:35.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:35.629+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:36.114 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:40:36.114+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:40:36.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:36.678+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:37.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:37.629+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:38.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:38.665+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:39.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:39.661+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:40.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:40.698+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:41.115 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:40:41.115+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:40:41.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:41.651+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:42.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:42.649+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:43.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:43.600+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:44.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:44.629+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:45.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:45.595+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:46.116 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:40:46.116+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:40:46.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:46.609+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:47.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:47.586+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:48.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:48.561+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:49.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:49.556+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:50.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:50.542+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:51.117 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:40:51.117+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:40:51.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:51.513+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:52.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:52.559+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:53.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:53.551+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:54.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:54.551+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:55.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:55.565+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:56.118 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:40:56.118+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:40:56.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:56.565+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:57.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:57.563+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:58.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:58.518+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:40:59.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:40:59.511+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:00.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:00.479+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:01.119 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:41:01.119+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:41:01.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:01.450+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:02.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:02.464+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:03.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:03.494+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:04.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:04.500+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:05.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:05.527+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:06.120 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:41:06.120+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:41:06.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:06.497+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:07.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:07.449+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:08.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:08.423+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:09.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:09.441+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:10.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:10.480+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:11.121 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:41:11.121+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:41:11.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:11.492+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:12.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:12.498+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:13.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:13.529+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:14.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:14.516+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:15.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:15.539+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:16.121 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:41:16.122+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:41:16.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:16.541+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:17.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:17.561+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:18.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:18.514+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:19.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:19.473+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:20.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:20.473+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:21.122 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:41:21.124+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:41:21.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:21.427+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:22.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:22.475+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:23.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:23.485+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:24.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:24.515+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:25.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:25.523+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:26.123 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:41:26.124+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:41:26.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:26.493+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:27.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:27.499+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:28.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:28.458+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:29.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:29.444+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:30.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:30.495+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:31.124 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:41:31.124+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:41:31.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:31.492+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:32.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:32.462+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:33.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:33.452+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:34.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:34.422+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:35.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:35.419+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:36.125 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:41:36.126+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:41:36.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:36.370+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:37.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:37.392+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:38.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:38.379+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:39.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:39.388+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:40.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:40.348+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:41.126 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:41:41.127+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:41:41.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:41.366+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:42.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:42.362+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:43.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:43.412+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:44.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:44.366+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:45.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:45.318+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:46.127 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:41:46.128+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:41:46.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:46.296+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:47.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:47.320+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:48.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:48.350+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:49.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:49.378+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:50.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:50.380+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:51.128 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:41:51.128+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:41:51.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:51.403+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:52.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:52.359+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:53.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:53.384+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:54.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:54.428+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:55.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:55.426+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:56.129 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:41:56.130+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:41:56.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:56.423+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:57.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:57.413+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:58.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:58.428+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:41:59.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:41:59.424+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:00.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:00.422+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:01.130 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:42:01.130+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:42:01.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:01.464+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:02.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:02.489+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:03.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:03.522+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:04.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:04.502+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:05.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:05.540+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:06.130 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:42:06.131+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:42:06.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:06.567+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:07.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:07.612+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:08.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:08.618+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:09.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:09.662+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:10.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:10.620+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:11.131 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:42:11.131+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:42:11.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:11.584+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:12.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:12.625+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:13.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:13.607+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:14.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:14.656+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:15.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:15.650+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:16.131 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:42:16.132+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:42:16.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:16.684+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:17.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:17.720+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:18.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:18.712+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:19.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:19.723+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:20.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:20.704+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:21.132 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:42:21.133+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:42:21.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:21.674+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:22.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:22.692+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:23.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:23.653+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:24.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:24.641+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:25.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:25.629+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:26.133 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:42:26.134+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:42:26.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:26.641+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:27.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:27.661+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:28.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:28.669+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:29.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:29.681+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:30.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:30.700+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:31.134 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:42:31.135+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:42:31.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:31.750+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:32.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:32.712+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:33.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:33.683+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:34.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:34.648+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:35.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:35.620+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:36.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:42:36.136+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:42:36.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:36.609+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:37.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:37.574+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:38.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:38.577+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:39.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:39.533+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:40.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:40.517+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:41.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:42:41.138+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:42:41.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:41.469+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:42.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:42.423+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:43.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:43.394+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:44.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:44.361+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:45.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:45.363+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:46.139 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:42:46.139+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:42:46.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:46.347+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:47.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:47.313+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:48.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:48.358+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:49.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:49.314+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:50.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:50.316+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:51.140 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:42:51.140+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:42:51.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:51.341+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:52.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:52.311+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:53.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:53.346+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:54.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:54.360+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:55.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:55.315+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:56.141 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:42:56.141+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:42:56.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:56.294+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:57.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:57.292+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:58.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:58.342+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:42:59.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:42:59.365+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:00.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:00.412+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:01.142 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:43:01.143+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:43:01.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:01.411+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:02.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:02.449+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:03.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:03.463+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:04.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:04.470+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:05.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:05.446+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:06.143 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:43:06.144+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:43:06.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:06.465+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:07.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:07.428+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:08.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:08.389+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:09.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:09.403+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:10.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:10.414+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:11.144 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:43:11.144+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:43:11.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:11.375+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:12.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:12.380+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:13.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:13.386+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:14.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:14.386+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:15.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:15.355+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:16.145 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:43:16.146+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:43:16.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:16.335+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:17.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:17.320+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:18.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:18.334+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:19.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:19.345+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:20.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:20.360+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:21.146 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:43:21.146+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:43:21.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:21.384+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:22.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:22.391+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:23.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:23.357+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:24.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:24.398+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:25.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:25.358+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:26.147 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:43:26.147+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:43:26.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:26.362+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:27.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:27.387+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:28.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:28.426+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:29.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:29.444+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:30.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:30.414+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:31.148 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:43:31.148+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:43:31.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:31.380+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:32.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:32.359+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:33.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:33.373+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:34.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:34.331+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:35.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:35.303+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:36.149 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:43:36.149+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:43:36.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:36.291+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:37.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:37.271+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:38.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:38.248+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:39.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:39.235+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:40.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:40.263+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:41.150 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:43:41.150+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:43:41.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:41.281+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:42.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:42.320+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:43.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:43.348+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:44.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:44.376+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:45.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:45.422+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:46.151 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:43:46.151+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:43:46.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:46.471+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:47.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:47.490+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:48.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:48.501+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:49.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:49.456+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:50.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:50.455+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:51.152 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:43:51.153+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:43:51.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:51.471+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:52.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:52.483+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:53.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:53.533+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:54.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:54.514+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:55.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:55.533+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:56.153 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:43:56.153+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:43:56.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:56.557+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:57.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:57.560+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:58.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:58.598+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:43:59.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:43:59.602+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:00.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:00.626+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:01.154 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:44:01.154+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:44:01.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:01.657+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:02.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:02.663+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:03.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:03.667+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:04.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:04.675+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:05.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:05.646+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:06.155 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:44:06.155+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:44:06.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:06.654+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:07.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:07.635+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:08.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:08.603+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:09.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:09.574+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:10.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:10.592+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:11.156 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:44:11.156+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:44:11.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:11.572+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:12.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:12.530+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:13.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:13.505+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:14.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:14.464+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:15.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:15.481+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:16.157 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:44:16.158+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:44:16.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:16.503+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:17.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:17.475+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:18.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:18.436+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:19.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:19.417+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:20.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:20.461+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:21.158 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:44:21.158+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:44:21.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:21.456+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:22.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:22.478+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:23.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:23.510+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:24.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:24.560+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:25.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:25.523+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:26.159 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:44:26.159+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:44:26.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:26.546+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:27.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:27.576+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:28.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:28.550+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:29.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:29.529+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:30.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:30.556+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:31.160 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:44:31.161+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:44:31.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:31.532+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:32.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:32.520+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:33.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:33.532+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:34.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:34.492+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:35.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:35.470+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:36.160 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:44:36.162+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:44:36.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:36.456+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:37.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:37.426+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:38.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:38.426+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:39.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:39.413+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:40.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:40.375+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:41.161 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:44:41.161+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:44:41.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:41.415+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:42.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:42.459+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:43.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:43.451+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:44.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:44.455+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:45.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:45.463+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:46.162 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:44:46.162+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:44:46.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:46.448+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:47.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:47.479+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:48.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:48.482+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:49.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:49.459+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:50.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:50.494+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:51.163 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:44:51.164+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:44:51.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:51.492+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:52.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:52.444+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:53.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:53.473+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:54.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:54.442+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:55.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:55.450+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:56.164 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:44:56.164+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:44:56.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:56.477+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:57.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:57.463+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:58.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:58.436+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:44:59.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:44:59.455+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:00.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:00.499+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:01.165 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:45:01.165+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:45:01.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:01.457+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:02.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:02.416+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:03.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:03.414+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:04.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:04.365+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:05.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:05.327+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:06.166 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:45:06.167+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:45:06.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:06.316+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:07.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:07.268+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:08.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:08.316+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:09.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:09.333+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:10.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:10.318+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:11.167 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:45:11.168+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:45:11.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:11.355+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:12.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:12.325+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:13.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:13.283+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:14.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:14.257+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:15.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:15.235+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:16.168 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:45:16.169+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:45:16.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:16.187+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:17.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:17.195+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:18.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:18.229+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:19.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:19.246+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:20.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:20.202+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:21.169 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:45:21.170+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:45:21.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:21.186+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:22.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:22.236+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:23.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:23.243+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:24.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:24.207+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:25.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:25.223+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:26.170 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:45:26.170+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:45:26.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:26.258+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:27.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:27.273+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:28.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:28.299+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:29.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:29.314+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:30.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:30.319+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:31.171 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:45:31.171+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:45:31.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:31.302+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:32.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:32.344+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:33.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:33.345+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:34.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:34.377+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:35.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:35.389+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:36.172 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:45:36.172+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:45:36.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:36.394+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:37.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:37.386+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:38.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:38.348+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:39.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:39.308+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:40.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:40.340+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:41.173 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:45:41.173+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:45:41.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:41.306+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:42.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:42.263+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:43.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:43.271+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:44.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:44.238+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:45.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:45.199+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:46.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:46.173+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:46.174 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:45:46.174+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:45:47.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:47.206+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:48.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:48.172+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:49.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:49.176+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:50.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:50.186+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:51.176 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:45:51.176+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:45:51.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:51.204+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:52.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:52.191+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:53.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:53.147+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:54.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:54.121+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:55.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:55.156+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:56.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:56.152+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:56.176 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:45:56.177+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:45:57.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:57.131+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:58.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:58.143+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:45:59.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:45:59.142+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:00.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:00.095+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:01.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:01.093+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:01.177 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:46:01.177+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:46:02.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:02.136+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:03.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:03.168+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:04.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:04.144+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:05.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:05.188+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:06.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:06.149+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:06.178 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:46:06.178+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:46:07.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:07.189+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:08.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:08.219+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:09.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:09.188+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:10.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:10.160+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:11.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:11.115+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:11.179 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:46:11.179+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:46:12.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:12.083+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:13.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:13.050+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:14.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:14.099+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:15.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:15.136+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:16.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:16.111+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:16.180 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:46:16.180+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:46:17.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:17.087+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:18.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:18.054+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:19.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:19.083+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:20.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:20.046+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:21.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:21.072+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:21.181 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:46:21.181+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:46:22.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:22.058+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:23.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:23.107+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:24.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:24.077+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:25.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:25.124+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:26.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:26.141+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:26.182 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:46:26.182+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:46:27.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:27.169+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:28.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:28.203+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:29.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:29.247+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:30.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:30.226+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:31.183 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:46:31.184+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:46:31.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:31.208+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:32.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:32.190+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:33.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:33.189+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:34.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:34.239+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:35.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:35.267+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:36.184 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:46:36.184+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:46:36.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:36.276+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:37.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:37.307+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:38.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:38.339+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:39.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:39.314+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:40.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:40.345+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:41.185 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:46:41.185+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:46:41.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:41.296+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:42.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:42.323+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:43.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:43.283+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:44.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:44.236+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:45.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:45.266+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:46.186 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:46:46.186+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:46:46.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:46.232+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:47.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:47.214+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:48.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:48.220+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:49.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:49.223+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:50.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:50.178+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:51.187 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:46:51.187+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:46:51.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:51.198+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:52.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:52.201+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:53.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:53.231+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:54.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:54.253+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:55.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:55.217+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:56.188 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:46:56.188+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:46:56.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:56.261+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:57.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:57.300+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:58.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:58.314+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:46:59.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:46:59.266+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:00.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:00.285+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:01.188 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:47:01.189+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:47:01.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:01.240+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:02.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:02.261+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:03.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:03.307+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:04.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:04.308+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:05.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:05.282+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:06.189 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:47:06.190+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:47:06.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:06.266+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:07.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:07.316+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:08.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:08.277+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:09.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:09.253+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:10.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:10.247+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:11.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:47:11.190+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:47:11.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:11.209+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:12.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:12.229+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:13.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:13.229+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:14.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:14.181+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:15.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:15.217+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:16.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:47:16.191+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:47:16.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:16.262+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:17.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:17.261+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:18.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:18.216+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:19.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:19.219+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:20.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:20.208+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:21.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:21.167+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:21.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:47:21.193+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:47:22.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:22.123+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:23.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:23.168+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:24.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:24.189+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:25.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:25.182+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:26.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:26.160+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:26.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:47:26.194+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:47:27.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:27.171+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:28.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:28.165+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:29.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:29.201+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:30.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:30.236+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:31.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:47:31.195+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:47:31.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:31.203+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:32.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:32.167+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:33.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:33.200+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:34.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:34.154+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:35.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:35.159+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:36.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:36.175+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:36.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:47:36.196+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:47:37.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:37.134+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:38.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:38.182+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:39.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:39.158+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:40.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:40.116+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:41.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:41.081+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:41.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:47:41.198+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:47:42.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:42.089+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:43.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:43.120+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:44.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:44.083+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:45.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:45.129+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:46.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:46.160+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:46.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:47:46.199+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:47:47.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:47.208+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:48.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:48.190+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:49.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:49.209+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:50.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:50.197+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:51.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:47:51.198+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:47:51.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:51.204+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:52.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:52.235+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:53.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:53.254+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:54.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:54.259+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:55.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:55.253+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:56.199 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:47:56.199+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:47:56.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:56.302+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:57.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:57.255+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:58.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:58.251+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:47:59.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:47:59.268+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:00.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:00.311+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:01.199 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:48:01.200+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:48:01.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:01.283+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:02.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:02.328+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:03.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:03.335+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:04.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:04.360+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:05.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:05.329+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:06.201 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:48:06.201+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:48:06.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:06.324+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:07.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:07.290+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:08.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:08.277+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:09.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:09.275+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:10.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:10.244+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:11.202 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:48:11.202+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:48:11.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:11.271+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:12.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:12.282+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:13.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:13.309+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:14.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:14.349+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:15.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:15.361+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:16.203 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:48:16.203+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:48:16.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:16.344+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:17.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:17.332+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:18.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:18.355+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:19.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:19.345+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:20.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:20.366+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:21.203 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:48:21.204+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:48:21.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:21.350+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:22.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:22.351+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:23.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:23.341+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:24.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:24.363+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:25.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:25.344+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:26.204 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:48:26.205+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:48:26.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:26.304+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:27.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:27.319+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:28.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:28.345+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:29.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:29.305+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:30.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:30.287+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:31.206 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:48:31.206+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:48:31.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:31.336+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:32.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:32.316+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:33.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:33.316+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:34.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:34.304+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:35.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:35.352+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:36.206 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:48:36.207+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:48:36.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:36.348+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:37.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:37.344+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:38.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:38.371+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:39.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:39.408+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:40.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:40.453+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:41.208 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:48:41.208+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:48:41.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:41.469+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:42.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:42.517+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:43.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:43.555+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:44.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:44.544+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:45.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:45.511+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:46.209 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:48:46.209+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:48:46.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:46.515+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:47.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:47.523+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:48.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:48.486+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:49.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:49.495+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:50.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:50.527+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:51.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:48:51.210+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:48:51.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:51.561+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:52.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:52.565+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:53.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:53.534+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:54.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:54.538+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:55.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:55.546+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:56.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:48:56.212+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:48:56.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:56.559+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:57.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:57.530+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:58.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:58.544+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:48:59.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:48:59.561+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:00.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:00.535+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:01.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:49:01.212+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:49:01.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:01.530+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:02.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:02.554+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:03.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:03.537+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:04.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:04.585+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:05.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:05.613+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:06.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:49:06.213+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:49:06.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:06.637+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:07.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:07.630+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:08.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:08.616+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:09.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:09.630+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:10.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:10.651+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:11.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:49:11.214+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:49:11.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:11.691+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:12.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:12.647+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:13.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:13.695+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:14.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:14.721+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:15.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:15.747+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:16.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:49:16.215+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:49:16.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:16.757+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:17.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:17.797+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:18.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:18.769+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:19.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:19.724+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:20.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:20.771+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:21.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:49:21.217+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:49:21.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:21.751+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:22.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:22.761+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:23.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:23.799+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:24.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:24.848+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:25.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:25.875+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:26.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:49:26.217+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:49:26.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:26.896+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:27.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:27.899+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:28.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:28.944+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:29.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:29.910+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:30.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:30.878+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:31.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:49:31.218+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:49:31.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:31.894+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:32.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:32.899+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:33.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:33.926+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:34.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:34.888+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:35.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:35.846+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:36.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:49:36.219+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:49:36.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:36.890+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:37.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:37.911+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:38.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:38.956+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:39.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:39.935+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:40.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:40.960+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:41.220 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:49:41.220+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:49:41.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:41.981+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:42.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:42.935+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:43.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:43.967+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:44.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:44.920+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:45.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:45.894+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:46.221 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:49:46.221+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:49:46.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:46.903+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:47.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:47.925+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:48.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:48.958+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:49.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:49.988+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:51.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:51.035+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:51.222 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:49:51.222+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:49:52.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:52.042+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:53.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:53.025+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:54.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:54.042+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:55.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:55.048+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:56.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:56.040+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:56.222 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:49:56.223+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:49:57.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:57.052+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:58.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:58.045+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:49:59.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:49:59.032+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:00.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:00.056+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:01.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:01.091+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:01.223 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:50:01.224+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:50:02.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:02.106+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:03.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:03.089+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:04.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:04.043+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:05.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:05.086+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:06.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:06.090+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:06.225 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:50:06.225+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:50:07.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:07.106+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:08.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:08.153+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:09.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:09.187+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:10.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:10.180+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:11.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:11.182+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:11.226 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:50:11.226+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:50:12.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:12.147+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:13.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:13.129+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:14.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:14.127+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:15.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:15.123+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:16.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:16.125+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:16.227 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:50:16.227+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:50:17.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:17.089+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:18.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:18.111+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:19.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:19.144+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:20.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:20.156+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:21.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:21.150+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:21.228 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:50:21.228+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:50:22.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:22.129+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:23.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:23.131+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:24.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:24.169+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:25.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:25.165+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:26.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:26.205+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:26.228 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:50:26.229+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:50:27.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:27.211+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:28.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:28.213+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:29.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:29.201+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:30.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:30.215+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:31.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:31.213+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:31.229 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:50:31.230+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:50:32.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:32.188+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:33.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:33.217+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:34.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:34.220+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:35.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:35.197+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:36.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:36.169+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:36.231 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:50:36.231+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:50:37.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:37.147+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:38.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:38.184+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:39.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:39.155+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:40.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:40.186+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:41.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:41.174+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:41.232 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:50:41.232+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:50:42.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:42.156+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:43.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:43.126+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:44.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:44.105+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:45.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:45.092+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:46.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:46.056+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:46.232 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:50:46.234+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:50:47.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:47.049+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:48.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:48.024+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:49.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:49.052+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:50.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:50.023+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:51.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:51.014+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:51.233 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:50:51.235+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:50:52.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:52.054+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:53.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:53.016+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:53.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:53.971+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:55.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:55.009+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:56.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:56.022+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:56.234 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:50:56.235+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:50:56.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:56.976+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:57.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:57.948+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:50:58.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:50:58.990+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:00.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:00.028+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:01.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:01.061+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:01.235 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:51:01.235+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:51:02.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:02.040+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:03.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:03.044+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:04.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:04.040+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:05.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:05.023+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:06.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:06.071+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:06.236 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:51:06.236+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:51:07.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:07.026+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:08.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:08.054+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:09.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:09.093+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:10.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:10.056+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:11.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:11.102+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:11.237 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:51:11.237+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:51:12.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:12.063+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:13.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:13.054+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:14.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:14.036+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:14.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:15.000+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:16.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:16.008+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:16.238 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:51:16.239+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:51:16.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:16.982+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:17.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:17.982+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:18.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:18.980+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:19.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:19.983+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:21.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:21.021+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:21.239 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:51:21.240+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:51:21.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:21.983+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:23.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:23.008+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:23.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:23.960+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:24.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:24.946+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:25.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:25.949+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:26.240 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:51:26.240+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:51:26.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:26.918+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:27.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:27.874+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:28.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:28.833+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:29.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:29.788+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:30.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:30.793+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:31.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:51:31.241+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:51:31.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:31.775+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:32.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:32.773+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:33.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:33.783+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:34.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:34.736+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:35.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:35.731+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:36.242 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:51:36.243+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:51:36.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:36.740+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:37.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:37.780+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:38.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:38.746+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:39.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:39.703+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:40.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:40.673+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:41.243 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:51:41.243+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:51:41.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:41.706+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:42.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:42.734+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:43.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:43.724+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:44.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:44.722+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:45.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:45.755+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:46.244 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:51:46.244+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:51:46.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:46.734+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:47.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:47.767+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:48.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:48.735+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:49.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:49.687+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:50.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:50.655+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:51.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:51.612+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:52.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:52.632+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:53.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:53.583+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:54.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:54.547+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:55.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:55.562+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:56.246 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:51:56.247+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:51:56.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:56.540+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:57.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:57.523+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:58.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:58.566+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:51:59.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:51:59.532+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:00.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:00.538+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:01.247 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:52:01.247+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:52:01.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:01.530+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:02.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:02.529+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:03.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:03.530+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:04.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:04.543+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:05.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:05.506+0000 7f6ba6a34700 -1 osd.2 128 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:06.248 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:52:06.248+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:52:06.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:06.517+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:07.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:07.476+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:08.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:08.451+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:09.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:09.402+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:10.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:10.384+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:11.249 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:52:11.249+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:52:11.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:11.364+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:12.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:12.340+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:13.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:13.330+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:14.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:14.354+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:15.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:15.368+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:16.250 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:52:16.250+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:52:16.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:16.348+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:17.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:17.371+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:18.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:18.352+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:19.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:19.340+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:20.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:20.345+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:21.251 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:52:21.251+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:52:21.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:21.317+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:22.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:22.291+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:23.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:23.273+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:24.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:24.275+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:25.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:25.268+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:26.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:26.244+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:26.252 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:52:26.252+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:52:27.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:27.237+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:28.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:28.224+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:29.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:29.174+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:30.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:30.193+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:31.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:31.183+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:31.253 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:52:31.254+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:52:32.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:32.166+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:33.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:33.126+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:34.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:34.096+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:35.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:35.093+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:36.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:36.107+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:36.254 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:52:36.254+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:52:37.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:37.108+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:38.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:38.143+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:39.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:39.128+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:40.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:40.109+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:41.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:41.078+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:41.255 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:52:41.255+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:52:42.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:42.121+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:43.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:43.094+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:44.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:44.071+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:45.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:45.088+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:46.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:46.065+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:46.256 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:52:46.256+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:52:47.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:47.110+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:48.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:48.087+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:49.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:49.134+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:50.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:50.160+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:51.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:51.173+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:51.257 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:52:51.258+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:52:52.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:52.129+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:53.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:53.134+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:54.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:54.117+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:55.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:55.116+0000 7f6ba6a34700 -1 osd.2 129 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:56.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:56.125+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:56.258 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:52:56.258+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:52:57.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:57.175+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:58.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:58.209+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:52:59.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:52:59.256+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:00.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:00.260+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:01.260 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:53:01.260+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:53:01.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:01.298+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:02.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:02.318+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:03.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:03.275+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:04.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:04.283+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:05.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:05.307+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:06.260 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:53:06.261+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:53:06.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:06.337+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:07.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:07.308+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:08.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:08.331+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:09.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:09.294+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:10.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:10.276+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:11.261 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:53:11.261+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:53:11.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:11.279+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:12.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:12.279+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:13.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:13.300+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:14.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:14.261+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:15.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:15.232+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:16.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:16.200+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:16.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:53:16.262+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:53:17.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:17.203+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:18.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:18.211+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:19.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:19.216+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:20.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:20.177+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:21.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:21.169+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:21.263 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:53:21.263+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:53:22.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:22.159+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:23.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:23.125+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:24.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:24.097+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:25.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:25.113+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:26.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:26.078+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:26.264 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:53:26.264+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:53:27.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:27.070+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:28.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:28.111+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:29.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:29.121+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:30.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:30.109+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:31.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:31.100+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:31.264 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:53:31.265+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:53:32.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:32.060+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:33.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:33.098+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:34.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:34.138+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:35.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:35.188+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:36.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:36.140+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:36.266 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:53:36.266+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:53:37.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:37.188+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:38.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:38.236+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:39.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:39.205+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:40.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:40.196+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:41.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:41.168+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:41.267 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:53:41.267+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:53:42.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:42.122+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:43.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:43.133+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:44.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:44.098+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:45.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:45.058+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:46.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:46.029+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:46.268 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:53:46.269+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:53:47.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:47.008+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:47.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:47.962+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:48.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:48.927+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:49.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:49.880+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:50.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:50.909+0000 7f6ba6a34700 -1 osd.2 130 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:51.269 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:53:51.269+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:53:51.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:51.920+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:52.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:52.918+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:53.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:53.932+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:54.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:54.898+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:55.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:55.924+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:56.269 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:53:56.271+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:53:56.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:56.891+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:57.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:57.906+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:58.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:58.860+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:53:59.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:53:59.820+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:00.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:00.780+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:01.270 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:54:01.272+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:54:01.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:01.744+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:02.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:02.734+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:03.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:03.710+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:04.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:04.746+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:05.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:05.721+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:06.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:54:06.271+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:54:06.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:06.765+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:07.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:07.728+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:08.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:08.704+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:09.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:09.685+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:10.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:10.668+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:11.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:54:11.272+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:54:11.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:11.712+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:12.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:12.714+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:13.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:13.698+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:14.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:14.667+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:15.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:15.674+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:16.272 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:54:16.273+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:54:16.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:16.675+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:17.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:17.671+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:18.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:18.713+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:19.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:19.750+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:20.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:20.763+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:21.274 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:54:21.274+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:54:21.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:21.788+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:22.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:22.823+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:23.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:23.844+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:24.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:24.867+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:25.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:25.856+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:26.275 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:54:26.275+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:54:26.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:26.892+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:27.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:27.877+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:28.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:28.926+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:29.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:29.895+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:30.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:30.945+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:31.276 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:54:31.276+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:54:31.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:31.983+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:33.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:33.012+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:34.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:34.003+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:35.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:35.052+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:36.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:36.085+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:36.277 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:54:36.277+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:54:37.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:37.048+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:38.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:38.022+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:39.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:39.043+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:40.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:40.037+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:41.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:41.018+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:41.278 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:54:41.278+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:54:42.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:42.053+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:43.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:43.068+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:44.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:44.044+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:45.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:45.003+0000 7f6ba6a34700 -1 osd.2 131 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:46.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:46.030+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:46.279 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:54:46.279+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:54:46.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:46.996+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:48.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:48.036+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:49.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:49.060+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:50.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:50.102+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:51.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:51.070+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:51.280 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:54:51.280+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:54:52.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:52.114+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:53.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:53.136+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:54.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:54.118+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:55.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:55.141+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:56.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:56.137+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:56.281 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:54:56.281+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:54:57.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:57.137+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:58.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:58.123+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:54:59.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:54:59.112+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:00.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:00.078+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:01.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:01.090+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:01.282 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:55:01.282+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:55:02.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:02.094+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:03.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:03.049+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:04.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:04.004+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:05.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:05.021+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:06.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:06.052+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:06.283 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:55:06.283+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:55:07.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:07.031+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:08.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:08.052+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:09.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:09.060+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:10.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:10.079+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:11.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:11.124+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:11.284 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:55:11.284+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:55:12.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:12.079+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:13.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:13.046+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:14.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:14.089+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:15.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:15.046+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:16.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:16.058+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:16.285 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:55:16.286+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:55:17.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:17.028+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:18.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:18.064+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:19.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:19.037+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:19.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:19.999+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:21.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:21.041+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:21.286 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:55:21.287+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:55:22.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:22.017+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:22.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:22.980+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:23.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:23.974+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:24.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:24.994+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:26.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:26.015+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:26.287 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:55:26.287+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:55:27.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:27.056+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:28.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:28.073+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:29.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:29.027+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:30.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:30.057+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:31.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:31.065+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:31.288 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:55:31.288+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:55:32.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:32.078+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:33.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:33.111+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:34.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:34.106+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:35.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:35.069+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:36.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:36.050+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:36.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:55:36.289+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:55:37.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:37.044+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:37.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:37.995+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:38.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:38.979+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:39.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:39.935+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:40.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:40.941+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:41.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:55:41.290+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:55:41.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:41.960+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:42.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:42.955+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:43.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:43.921+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:44.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:44.948+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:45.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:45.983+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:46.291 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:55:46.291+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:55:46.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:46.997+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:48.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:48.040+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:49.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:49.009+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:49.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:49.980+0000 7f6ba6a34700 -1 osd.2 132 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:50.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:50.934+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:51.292 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:55:51.292+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:55:51.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:51.973+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:52.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:52.996+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:53.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:53.953+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:54.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:54.967+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:55.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:55.930+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:56.293 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:55:56.293+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:55:56.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:56.965+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:57.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:57.990+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:55:59.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:55:59.036+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:00.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:00.055+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:01.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:01.067+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:01.293 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:56:01.294+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:56:02.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:02.057+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:03.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:03.039+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:03.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:03.998+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:04.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:04.951+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:05.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:05.901+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:06.294 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:56:06.295+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:56:06.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:06.913+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:07.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:07.937+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:08.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:08.950+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:09.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:09.992+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:11.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:11.029+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:11.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:56:11.296+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:56:12.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:12.048+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:13.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:13.002+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:13.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:13.969+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:15.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:15.013+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:16.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:16.016+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:17.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:17.013+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:18.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:18.036+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:18.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:18.997+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:19.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:19.970+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:20.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:20.969+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:21.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:56:21.298+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:56:21.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:21.970+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:22.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:22.931+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:23.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:23.937+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:24.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:24.903+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:25.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:25.922+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:26.301 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:56:26.299+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:56:26.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:26.971+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:27.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:27.932+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:28.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:28.926+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:29.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:29.893+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:30.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:30.859+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:31.299 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:56:31.300+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:56:31.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:31.867+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:32.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:32.883+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:33.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:33.919+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:34.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:34.955+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:35.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:35.975+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:36.301 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:56:36.301+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:56:37.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:37.012+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:38.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:38.033+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:39.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:39.018+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:40.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:40.052+0000 7f6ba6a34700 -1 osd.2 133 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:41.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:41.020+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:41.302 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:56:41.302+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:56:42.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:42.047+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:43.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:43.077+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:44.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:44.073+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:45.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:45.043+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:46.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:46.051+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:46.303 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:56:46.303+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:56:47.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:47.064+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:48.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:48.076+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:49.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:49.094+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:50.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:50.141+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:51.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:51.129+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:51.304 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:56:51.304+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:56:52.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:52.173+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:53.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:53.130+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:54.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:54.152+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:55.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:55.177+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:56.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:56.188+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:56.304 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:56:56.305+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:56:57.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:57.199+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:58.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:58.229+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:56:59.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:56:59.245+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:00.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:00.239+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:01.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:01.270+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:01.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:57:01.307+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:57:02.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:02.319+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:03.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:03.334+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:04.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:04.384+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:05.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:05.337+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:06.306 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:57:06.308+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:57:06.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:06.358+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:07.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:07.313+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:08.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:08.274+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:09.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:09.235+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:10.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:10.205+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:11.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:11.179+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:11.307 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:57:11.308+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:57:12.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:12.223+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:13.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:13.241+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:14.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:14.197+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:15.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:15.242+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:16.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:16.204+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:16.308 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:57:16.309+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:57:17.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:17.217+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:18.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:18.199+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:19.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:19.222+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:20.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:20.264+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:21.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:21.307+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:21.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:57:21.310+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:57:22.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:22.291+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:23.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:23.270+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:24.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:24.231+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:25.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:25.186+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:26.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:26.186+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:26.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:57:26.310+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:57:27.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:27.234+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:28.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:28.226+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:29.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:29.180+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:30.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:30.155+0000 7f6ba6a34700 -1 osd.2 134 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:31.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:31.168+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:31.311 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:57:31.312+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:57:32.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:32.151+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:33.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:33.133+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:34.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:34.154+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:35.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:35.141+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:36.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:36.140+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:36.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:57:36.313+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:57:37.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:37.152+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:38.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:38.150+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:39.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:39.150+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:40.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:40.135+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:41.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:41.170+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:41.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:57:41.313+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:57:42.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:42.177+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:43.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:43.202+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:44.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:44.208+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:45.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:45.176+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:46.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:46.217+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:46.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:57:46.315+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:57:47.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:47.175+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:48.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:48.132+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:49.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:49.111+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:50.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:50.091+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:51.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:51.138+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:51.315 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:57:51.316+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:57:52.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:52.180+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:53.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:53.205+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:54.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:54.161+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:55.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:55.166+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:56.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:56.149+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:56.316 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:57:56.316+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:57:57.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:57.110+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:58.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:58.155+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:57:59.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:57:59.164+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:00.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:00.205+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:01.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:01.247+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:01.317 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:58:01.317+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:58:02.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:02.267+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:03.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:03.285+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:04.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:04.266+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:05.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:05.301+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:06.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:06.311+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:06.318 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:58:06.318+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:58:07.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:07.272+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:08.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:08.271+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:09.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:09.272+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:10.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:10.254+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:11.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:11.286+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:11.319 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:58:11.319+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:58:12.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:12.267+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:13.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:13.231+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:14.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:14.220+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:15.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:15.243+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:16.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:16.228+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:16.320 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:58:16.320+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:58:17.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:17.256+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:18.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:18.250+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:19.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:19.298+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:20.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:20.297+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:21.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:21.286+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:21.320 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:58:21.321+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:58:22.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:22.247+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:23.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:23.266+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:24.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:24.233+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:25.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:25.270+0000 7f6ba6a34700 -1 osd.2 135 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:26.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:26.221+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:26.322 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:58:26.322+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:58:27.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:27.254+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:28.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:28.246+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:29.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:29.295+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:30.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:30.315+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:31.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:31.310+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:31.323 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:58:31.323+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:58:32.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:32.311+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:33.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:33.303+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:34.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:34.331+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:35.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:35.371+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:36.324 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:58:36.324+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:58:36.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:36.403+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:37.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:37.360+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:38.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:38.397+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:39.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:39.391+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:40.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:40.344+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:41.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:41.308+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:41.325 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:58:41.325+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:58:42.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:42.276+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:43.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:43.280+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:44.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:44.326+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:45.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:45.366+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:46.325 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:58:46.326+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:58:46.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:46.394+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:47.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:47.370+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:48.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:48.419+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:49.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:49.406+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:50.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:50.406+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:51.327 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:58:51.327+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:58:51.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:51.365+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:52.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:52.392+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:53.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:53.389+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:54.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:54.430+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:55.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:55.394+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:56.328 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:58:56.328+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:58:56.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:56.402+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:57.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:57.397+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:58.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:58.399+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:58:59.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:58:59.358+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:00.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:00.375+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:01.329 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:59:01.330+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:59:01.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:01.378+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:02.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:02.345+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:03.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:03.373+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:04.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:04.334+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:05.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:05.286+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:06.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:06.253+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:06.330 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:59:06.331+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:59:07.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:07.248+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:08.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:08.264+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:09.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:09.271+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:10.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:10.279+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:11.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:11.304+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:11.331 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:59:11.331+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:59:12.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:12.339+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:13.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:13.338+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:14.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:14.342+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:15.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:15.349+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:16.332 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:59:16.332+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:59:16.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:16.366+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:17.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:17.397+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:18.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:18.383+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:19.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:19.337+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:20.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:20.382+0000 7f6ba6a34700 -1 osd.2 136 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:21.333 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:59:21.333+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:59:21.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:21.398+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:22.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:22.448+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:23.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:23.474+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:24.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:24.493+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:25.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:25.524+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:26.333 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:59:26.334+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:59:26.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:26.572+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:27.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:27.594+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:28.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:28.563+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:29.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:29.555+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:30.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:30.600+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:31.334 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:59:31.335+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:59:31.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:31.582+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:32.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:32.612+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:33.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:33.641+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:34.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:34.629+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:35.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:35.587+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:36.335 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:59:36.336+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:59:36.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:36.595+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:37.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:37.635+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:38.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:38.677+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:39.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:39.661+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:40.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:40.694+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:41.337 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:59:41.337+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:59:41.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:41.675+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:42.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:42.663+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:43.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:43.676+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:44.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:44.726+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:45.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:45.763+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:46.338 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:59:46.338+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:59:46.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:46.720+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:47.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:47.674+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:48.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:48.647+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:49.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:49.655+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:50.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:50.694+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:51.339 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:59:51.339+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:59:51.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:51.726+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:52.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:52.741+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:53.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:53.726+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:54.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:54.721+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:55.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:55.675+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:56.341 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T04:59:56.340+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T04:59:56.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:56.678+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:57.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:57.696+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:58.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:58.649+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T04:59:59.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T04:59:59.602+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:00.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:00.586+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:01.341 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:00:01.341+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:00:01.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:01.617+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:02.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:02.583+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:03.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:03.623+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:04.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:04.644+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:05.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:05.684+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:06.342 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:00:06.342+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:00:06.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:06.691+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:07.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:07.642+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:08.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:08.687+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:09.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:09.679+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:10.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:10.716+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:11.342 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:00:11.344+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:00:11.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:11.725+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:12.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:12.769+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:13.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:13.753+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:14.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:14.738+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:15.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:15.768+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:16.343 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:00:16.345+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:00:16.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:16.794+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:17.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:17.804+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:18.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:18.761+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:19.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:19.740+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:20.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:20.731+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:21.344 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:00:21.344+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:00:21.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:21.724+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:22.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:22.675+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:23.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:23.634+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:24.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:24.655+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:25.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:25.671+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:26.345 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:00:26.345+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:00:26.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:26.694+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:27.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:27.706+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:28.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:28.695+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:29.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:29.724+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:30.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:30.698+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:31.346 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:00:31.346+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:00:31.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:31.737+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:32.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:32.711+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:33.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:33.721+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:34.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:34.675+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:35.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:35.635+0000 7f6ba6a34700 -1 osd.2 137 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:36.347 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:00:36.347+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:00:36.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:36.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:37.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:37.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:38.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:38.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:39.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:39.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:40.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:40.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:41.348 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:00:41.348+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:00:41.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:41.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:42.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:42.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:43.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:43.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:44.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:44.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:45.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:45.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:46.354 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:00:46.349+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:00:46.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:46.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:47.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:47.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:48.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:48.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:49.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:49.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:50.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:50.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:51.350 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:00:51.350+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:00:51.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:51.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:52.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:52.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:53.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:53.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:54.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:54.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:55.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:55.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:56.351 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:00:56.351+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:00:56.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:56.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:57.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:57.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:58.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:58.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:00:59.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:00:59.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:00.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:00.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:01.351 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:01:01.352+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:01:01.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:01.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:02.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:02.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:03.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:03.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:04.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:04.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:05.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:05.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:06.353 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:01:06.353+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:01:06.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:06.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:07.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:07.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:08.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:08.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:09.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:09.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:10.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:10.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:11.354 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:01:11.354+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:01:11.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:11.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:12.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:12.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:13.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:13.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:14.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:14.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:15.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:15.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:16.355 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:01:16.355+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:01:16.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:16.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:17.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:17.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:18.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:18.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:19.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:19.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:20.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:20.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:21.356 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:01:21.356+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:01:21.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:21.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:22.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:22.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:23.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:23.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:24.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:24.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:25.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:25.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:26.357 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:01:26.358+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:01:26.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:26.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:27.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:27.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:28.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:28.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:29.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:29.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:30.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:30.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:31.358 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:01:31.358+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:01:31.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:31.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:32.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:32.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:33.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:33.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:34.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:34.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:35.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:35.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:36.359 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:01:36.359+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:01:36.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:36.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:37.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:37.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:38.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:38.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:39.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:39.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:40.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:40.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:41.360 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:01:41.361+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:01:41.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:41.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:42.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:42.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:43.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:43.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:44.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:44.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:45.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:45.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:46.361 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:01:46.361+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:01:46.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:46.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:47.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:47.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:48.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:48.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:49.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:49.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:50.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:50.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:51.362 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:01:51.362+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:01:51.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:51.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:52.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:52.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:53.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:53.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:54.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:54.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:55.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:55.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:56.363 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:01:56.363+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:01:56.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:56.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:57.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:57.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:58.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:58.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:01:59.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:01:59.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:00.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:00.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:01.363 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:02:01.364+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:02:01.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:01.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:02.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:02.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:03.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:03.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:04.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:04.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:05.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:05.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:06.365 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:02:06.365+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:02:06.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:06.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:07.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:07.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:08.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:08.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:09.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:09.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:10.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:10.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:11.366 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:02:11.366+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:02:11.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:11.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:12.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:12.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:13.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:13.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:14.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:14.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:15.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:15.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:16.367 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:02:16.367+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:02:16.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:16.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:17.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:17.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:18.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:18.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:19.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:19.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:20.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:20.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:21.368 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:02:21.368+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:02:21.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:21.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:22.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:22.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:23.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:23.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:24.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:24.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:25.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:25.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:26.369 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:02:26.369+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:02:26.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:26.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:27.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:27.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:28.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:28.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:29.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:29.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:30.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:30.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:31.370 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:02:31.371+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:02:31.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:31.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:32.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:32.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:33.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:33.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:34.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:34.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:35.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:35.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:36.371 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:02:36.371+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:02:36.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:36.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:37.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:37.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:38.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:38.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:39.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:39.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:40.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:40.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:41.371 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:02:41.372+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:02:41.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:41.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:42.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:42.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:43.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:43.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:44.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:44.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:45.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:45.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:46.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:02:46.373+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:02:46.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:46.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:47.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:47.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:48.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:48.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:49.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:49.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:50.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:50.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:51.374 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:02:51.374+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:02:51.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:51.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:52.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:52.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:53.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:53.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:54.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:54.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:55.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:55.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:56.374 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:02:56.375+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:02:56.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:56.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:57.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:57.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:58.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:58.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:02:59.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:02:59.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:00.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:00.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:01.375 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:03:01.376+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:03:01.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:01.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:02.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:02.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:03.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:03.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:04.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:04.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:05.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:05.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:06.377 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:03:06.377+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:03:06.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:06.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:07.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:07.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:08.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:08.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:09.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:09.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:10.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:10.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:11.378 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:03:11.378+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:03:11.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:11.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:12.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:12.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:13.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:13.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:14.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:14.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:15.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:15.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:16.379 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:03:16.379+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:03:16.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:16.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:17.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:17.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:18.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:18.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:19.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:19.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:20.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:20.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:21.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:03:21.381+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:03:21.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:21.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:22.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:22.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:23.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:23.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:24.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:24.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:25.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:25.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:26.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:03:26.382+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:03:26.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:26.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:27.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:27.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:28.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:28.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:29.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:29.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:30.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:30.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:31.381 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:03:31.382+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:03:31.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:31.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:32.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:32.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:33.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:33.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:34.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:34.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:35.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:35.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:36.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:03:36.382+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:03:36.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:36.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:37.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:37.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:38.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:38.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:39.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:39.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:40.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:40.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:41.383 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:03:41.383+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:03:41.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:41.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:42.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:42.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:43.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:43.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:44.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:44.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:45.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:45.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:46.384 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:03:46.384+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:03:46.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:46.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:47.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:47.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:48.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:48.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:49.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:49.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:50.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:50.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:51.385 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:03:51.385+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:03:51.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:51.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:52.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:52.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:53.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:53.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:54.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:54.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:55.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:55.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:56.393 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:03:56.387+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:03:56.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:56.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:57.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:57.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:58.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:58.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:03:59.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:03:59.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:00.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:00.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:01.387 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:04:01.387+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:04:01.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:01.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:02.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:02.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:03.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:03.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:04.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:04.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:05.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:05.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:06.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:04:06.388+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:04:06.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:06.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:07.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:07.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:08.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:08.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:09.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:09.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:10.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:10.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:11.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:04:11.389+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:04:11.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:11.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:12.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:12.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:13.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:13.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:14.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:14.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:15.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:15.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:16.390 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:04:16.391+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:04:16.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:16.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:17.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:17.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:18.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:18.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:19.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:19.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:20.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:20.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:21.391 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:04:21.391+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:04:21.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:21.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:22.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:22.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:23.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:23.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:24.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:24.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:25.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:25.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:26.392 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:04:26.392+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:04:26.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:26.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:27.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:27.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:28.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:28.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:29.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:29.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:30.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:30.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:31.393 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:04:31.394+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:04:31.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:31.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:32.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:32.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:33.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:33.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:34.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:34.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:35.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:35.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:36.394 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:04:36.395+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:04:36.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:36.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:37.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:37.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:38.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:38.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:39.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:39.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:40.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:40.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:41.394 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:04:41.395+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:04:41.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:41.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:42.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:42.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:43.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:43.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:44.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:44.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:45.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:45.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:46.395 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:04:46.396+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:04:46.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:46.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:47.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:47.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:48.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:48.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:49.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:49.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:50.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:50.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:51.396 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:04:51.397+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:04:51.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:51.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:52.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:52.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:54.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:54.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:54.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:54.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:55.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:55.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:56.397 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:04:56.398+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:04:57.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:57.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:57.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:57.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:58.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:58.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:04:59.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:04:59.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:00.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:00.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:01.399 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:05:01.399+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:05:01.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:01.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:02.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:02.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:03.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:03.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:04.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:04.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:05.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:05.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:06.400 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:05:06.400+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:05:06.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:06.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:07.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:07.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:08.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:08.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:09.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:09.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:10.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:10.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:11.401 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:05:11.401+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:05:11.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:11.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:12.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:12.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:13.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:13.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:14.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:14.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:15.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:15.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:16.402 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:05:16.402+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:05:16.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:16.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:17.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:17.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:18.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:18.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:19.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:19.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:20.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:20.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:21.403 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:05:21.404+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:05:21.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:21.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:22.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:22.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:23.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:23.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:24.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:24.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:25.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:25.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:26.404 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:05:26.404+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:05:26.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:26.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:27.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:27.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:28.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:28.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:29.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:29.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:30.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:30.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:31.405 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:05:31.405+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:05:31.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:31.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:32.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:32.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:33.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:33.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:34.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:34.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:35.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:35.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:36.406 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:05:36.406+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:05:36.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:36.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:37.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:37.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:38.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:38.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:39.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:39.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:40.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:40.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:41.407 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:05:41.407+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:05:41.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:41.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:42.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:42.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:43.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:43.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:44.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:44.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:45.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:45.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:46.408 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:05:46.408+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:05:46.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:46.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:47.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:47.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:48.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:48.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:49.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:49.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:50.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:50.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:51.409 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:05:51.409+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:05:51.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:51.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:52.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:52.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:53.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:53.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:54.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:54.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:55.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:55.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:56.411 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:05:56.410+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:05:56.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:56.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:57.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:57.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:58.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:58.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:05:59.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:05:59.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:00.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:00.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:01.411 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:06:01.411+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:06:01.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:01.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:02.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:02.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:03.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:03.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:04.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:04.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:05.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:05.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:06.412 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:06:06.412+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:06:06.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:06.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:07.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:07.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:08.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:08.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:09.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:09.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:10.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:10.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:11.413 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:06:11.414+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:06:11.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:11.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:12.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:12.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:13.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:13.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:14.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:14.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:15.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:15.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:16.414 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:06:16.414+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:06:16.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:16.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:17.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:17.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:18.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:18.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:19.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:19.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:20.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:20.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:21.415 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:06:21.416+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:06:21.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:21.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:22.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:22.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:23.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:23.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:24.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:24.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:25.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:25.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:26.415 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:06:26.417+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:06:26.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:26.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:27.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:27.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:28.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:28.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:29.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:29.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:30.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:30.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:31.416 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:06:31.417+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:06:31.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:31.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:32.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:32.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:33.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:33.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:34.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:34.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:35.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:35.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:36.417 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:06:36.418+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:06:36.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:36.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:37.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:37.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:38.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:38.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:39.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:39.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:40.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:40.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:41.418 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:06:41.418+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:06:41.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:41.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:42.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:42.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:43.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:43.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:44.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:44.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:45.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:45.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:46.418 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:06:46.419+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:06:46.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:46.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:47.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:47.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:48.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:48.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:49.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:49.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:50.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:50.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:51.420 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:06:51.420+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:06:51.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:51.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:52.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:52.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:53.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:53.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:54.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:54.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:55.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:55.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:56.421 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:06:56.421+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:06:56.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:56.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:57.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:57.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:58.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:58.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:06:59.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:06:59.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:00.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:00.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:01.422 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:07:01.423+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:07:01.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:01.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:02.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:02.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:03.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:03.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:04.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:04.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:05.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:05.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:06.423 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:07:06.424+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:07:06.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:06.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:07.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:07.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:08.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:08.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:09.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:09.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:10.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:10.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:11.424 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:07:11.424+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:07:11.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:11.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:12.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:12.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:13.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:13.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:14.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:14.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:15.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:15.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:16.425 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:07:16.425+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:07:16.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:16.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:17.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:17.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:19.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:19.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:19.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:19.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:20.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:20.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:21.426 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:07:21.426+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:07:21.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:21.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:23.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:23.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:24.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:24.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:25.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:25.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:26.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:26.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:26.427 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:07:26.427+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:07:27.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:27.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:28.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:28.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:29.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:29.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:30.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:30.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:31.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:31.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:31.428 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:07:31.429+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:07:32.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:32.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:33.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:33.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:34.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:34.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:35.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:35.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:36.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:36.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:36.429 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:07:36.429+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:07:37.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:37.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:38.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:38.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:39.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:39.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:40.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:40.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:41.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:41.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:41.430 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:07:41.430+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:07:42.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:42.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:43.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:43.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:44.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:44.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:45.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:45.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:46.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:46.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:46.431 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:07:46.431+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:07:47.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:47.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:48.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:48.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:49.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:49.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:50.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:50.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:51.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:51.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:51.431 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:07:51.432+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:07:52.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:52.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:53.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:53.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:54.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:54.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:55.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:55.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:56.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:56.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:56.432 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:07:56.433+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:07:57.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:57.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:58.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:58.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:59.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:59.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:07:59.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:07:59.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:00.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:00.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:01.433 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:08:01.434+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:08:01.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:01.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:02.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:02.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:03.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:03.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:04.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:04.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:05.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:05.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:06.434 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:08:06.435+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:08:06.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:06.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:07.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:07.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:08.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:08.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:09.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:09.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:10.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:10.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:11.435 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:08:11.436+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:08:11.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:11.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:12.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:12.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:13.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:13.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:14.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:14.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:15.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:15.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:16.436 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:08:16.437+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:08:16.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:16.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:17.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:17.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:18.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:18.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:19.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:19.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:20.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:20.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:21.437 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:08:21.438+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:08:21.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:21.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:22.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:22.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:23.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:23.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:24.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:24.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:25.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:25.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:26.438 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:08:26.439+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:08:26.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:26.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:27.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:27.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:28.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:28.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:29.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:29.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:30.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:30.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:31.439 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:08:31.440+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:08:31.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:31.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:32.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:32.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:33.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:33.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:34.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:34.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:35.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:35.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:36.441 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:08:36.441+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:08:36.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:36.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:37.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:37.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:38.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:38.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:39.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:39.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:40.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:40.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:41.442 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:08:41.443+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:08:41.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:41.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:42.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:42.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:43.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:43.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:44.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:44.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:45.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:45.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:46.443 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:08:46.443+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:08:46.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:46.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:47.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:47.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:48.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:48.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:49.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:49.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:50.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:50.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:51.444 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:08:51.444+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:08:51.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:51.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:52.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:52.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:53.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:53.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:54.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:54.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:55.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:55.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:56.444 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:08:56.445+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:08:56.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:56.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:57.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:57.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:58.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:58.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:08:59.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:08:59.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:00.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:00.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:01.445 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:09:01.446+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:09:01.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:01.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:02.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:02.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:03.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:03.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:04.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:04.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:05.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:05.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:06.448 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:09:06.446+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:09:06.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:06.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:07.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:07.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:08.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:08.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:09.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:09.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:10.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:10.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:11.447 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:09:11.447+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:09:11.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:11.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:12.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:12.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:13.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:13.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:14.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:14.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:15.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:15.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:16.447 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:09:16.449+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:09:16.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:16.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:17.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:17.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:18.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:18.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:19.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:19.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:20.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:20.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:21.448 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:09:21.450+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:09:21.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:21.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:22.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:22.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:23.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:23.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:24.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:24.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:25.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:25.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:26.449 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:09:26.450+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:09:26.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:26.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:27.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:27.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:28.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:28.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:29.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:29.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:30.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:30.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:31.450 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:09:31.450+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:09:31.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:31.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:32.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:32.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:33.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:33.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:34.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:34.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:35.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:35.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:36.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:09:36.452+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:09:36.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:36.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:37.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:37.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:38.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:38.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:39.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:39.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:40.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:40.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:41.453 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:09:41.453+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:09:41.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:41.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:42.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:42.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:43.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:43.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:44.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:44.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:45.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:45.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:46.454 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:09:46.455+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:09:46.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:46.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:48.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:48.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:49.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:49.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:50.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:50.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:51.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:51.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:51.455 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:09:51.455+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:09:52.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:52.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:53.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:53.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:54.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:54.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:55.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:55.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:56.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:56.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:56.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:09:56.457+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:09:57.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:57.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:58.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:58.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:09:59.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:09:59.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:00.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:00.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:01.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:01.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:01.457 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:10:01.458+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:10:02.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:02.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:03.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:03.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:04.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:04.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:05.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:05.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:06.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:06.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:06.458 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:10:06.458+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:10:07.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:07.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:08.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:08.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:09.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:09.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:10.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:10.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:11.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:11.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:11.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:10:11.459+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:10:12.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:12.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:13.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:13.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:14.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:14.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:15.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:15.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:16.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:16.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:16.460 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:10:16.460+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:10:17.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:17.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:18.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:18.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:19.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:19.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:20.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:20.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:21.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:21.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:21.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:10:21.461+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:10:22.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:22.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:23.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:23.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:24.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:24.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:25.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:25.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:26.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:26.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:26.462 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:10:26.463+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:10:27.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:27.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:28.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:28.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:29.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:29.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:30.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:30.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:31.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:31.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:31.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:10:31.463+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:10:32.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:32.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:33.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:33.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:34.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:34.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:35.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:35.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:36.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:36.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:36.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:10:36.464+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:10:37.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:37.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:38.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:38.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:39.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:39.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:40.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:40.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:41.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:41.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:41.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:10:41.465+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:10:42.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:42.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:43.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:43.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:44.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:44.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:45.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:45.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:46.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:46.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:46.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:10:46.467+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:10:47.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:47.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:48.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:48.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:49.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:49.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:50.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:50.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:51.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:51.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:51.467 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:10:51.467+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:10:52.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:52.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:53.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:53.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:54.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:54.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:55.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:55.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:56.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:56.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:56.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:10:56.469+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:10:57.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:57.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:58.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:58.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:10:59.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:10:59.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:00.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:00.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:01.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:01.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:01.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:11:01.470+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:11:02.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:02.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:03.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:03.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:04.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:04.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:05.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:05.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:06.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:06.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:06.470 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:11:06.471+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:11:07.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:07.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:08.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:08.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:08.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:08.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:09.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:09.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:10.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:10.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:11.471 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:11:11.472+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:11:11.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:11.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:12.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:12.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:13.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:13.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:15.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:15.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:15.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:15.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:16.472 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:11:16.472+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:11:17.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:17.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:18.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:18.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:19.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:19.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:20.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:20.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:21.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:21.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:21.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:11:21.473+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:11:22.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:22.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:23.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:23.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:24.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:24.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:25.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:25.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:26.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:26.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:26.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:11:26.474+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:11:27.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:27.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:28.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:28.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:29.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:29.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:30.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:30.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:31.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:31.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:31.474 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:11:31.475+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:11:32.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:32.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:33.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:33.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:34.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:34.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:35.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:35.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:36.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:36.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:36.475 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:11:36.476+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:11:37.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:37.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:38.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:38.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:39.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:39.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:40.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:40.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:41.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:41.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:41.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:11:41.477+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:11:42.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:42.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:43.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:43.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:44.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:44.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:45.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:45.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:46.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:46.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:46.478 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:11:46.478+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:11:47.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:47.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:48.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:48.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:49.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:49.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:50.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:50.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:51.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:51.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:51.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:11:51.479+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:11:52.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:52.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:53.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:53.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:54.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:54.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:55.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:55.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:56.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:56.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:56.480 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:11:56.480+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:11:57.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:57.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:58.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:58.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:11:59.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:11:59.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:00.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:00.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:01.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:01.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:01.481 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:12:01.481+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:12:01.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:01.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:03.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:03.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:04.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:04.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:05.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:05.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:06.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:06.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:06.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:12:06.482+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:12:07.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:07.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:08.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:08.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:09.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:09.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:10.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:10.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:11.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:11.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:11.483 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:12:11.483+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:12:12.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:12.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:13.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:13.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:14.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:14.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:15.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:15.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:16.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:16.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:16.483 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:12:16.485+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:12:17.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:17.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:18.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:18.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:19.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:19.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:20.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:20.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:21.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:21.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:21.484 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:12:21.486+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:12:21.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:21.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:22.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:22.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:23.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:23.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:24.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:24.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:25.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:25.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:26.485 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:12:26.486+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:12:26.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:26.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:27.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:27.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:28.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:28.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:29.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:29.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:30.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:30.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:31.486 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:12:31.487+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:12:31.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:31.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:32.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:32.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:33.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:33.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:34.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:34.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:35.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:35.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:36.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:12:36.487+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:12:36.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:36.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:37.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:37.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:38.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:38.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:39.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:39.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:40.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:40.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:41.488 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:12:41.489+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:12:41.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:41.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:42.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:42.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:43.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:43.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:44.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:44.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:45.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:45.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:46.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:12:46.489+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:12:46.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:46.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:47.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:47.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:48.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:48.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:49.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:49.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:50.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:50.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:51.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:12:51.490+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:12:51.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:51.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:52.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:52.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:53.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:53.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:54.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:54.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:55.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:55.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:56.491 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:12:56.491+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:12:56.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:56.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:57.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:57.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:58.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:58.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:12:59.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:12:59.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:00.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:00.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:01.491 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:13:01.492+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:13:01.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:01.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:02.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:02.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:03.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:03.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:04.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:04.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:05.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:05.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:06.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:13:06.493+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:13:06.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:06.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:07.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:07.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:08.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:08.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:09.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:09.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:10.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:10.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:11.493 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:13:11.494+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:13:11.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:11.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:12.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:12.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:13.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:13.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:15.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:15.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:16.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:16.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:16.494 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:13:16.495+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:13:17.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:17.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:18.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:18.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:18.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:18.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:19.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:19.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:21.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:21.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:21.496 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:13:21.496+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:13:22.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:22.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:23.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:23.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:24.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:24.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:25.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:25.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:26.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:26.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:26.497 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:13:26.497+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:13:27.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:27.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:28.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:28.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:29.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:29.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:30.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:30.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:31.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:31.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:31.497 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:13:31.498+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:13:32.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:32.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:33.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:33.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:34.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:34.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:35.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:35.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:36.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:36.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:36.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:13:36.499+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:13:37.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:37.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:38.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:38.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:39.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:39.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:40.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:40.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:41.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:41.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:41.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:13:41.501+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:13:42.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:42.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:43.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:43.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:44.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:44.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:45.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:45.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:46.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:46.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:46.501 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:13:46.501+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:13:47.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:47.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:48.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:48.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:49.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:49.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:50.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:50.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:51.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:51.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:51.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:13:51.502+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:13:52.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:52.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:53.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:53.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:54.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:54.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:55.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:55.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:56.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:56.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:56.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:13:56.503+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:13:57.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:57.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:58.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:58.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:13:59.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:13:59.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:00.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:00.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:01.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:01.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:01.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:14:01.504+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:14:02.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:02.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:03.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:03.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:04.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:04.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:05.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:05.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:06.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:06.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:06.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:14:06.505+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:14:07.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:07.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:08.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:08.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:09.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:09.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:10.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:10.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:11.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:11.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:11.505 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:14:11.506+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:14:12.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:12.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:13.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:13.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:14.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:14.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:15.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:15.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:16.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:16.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:16.506 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:14:16.507+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:14:17.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:17.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:18.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:18.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:19.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:19.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:20.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:20.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:21.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:21.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:21.507 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:14:21.507+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:14:22.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:22.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:23.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:23.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:24.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:24.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:25.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:25.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:26.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:26.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:26.507 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:14:26.508+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:14:27.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:27.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:28.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:28.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:29.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:29.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:30.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:30.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:31.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:31.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:31.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:14:31.509+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:14:32.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:32.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:33.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:33.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:34.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:34.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:35.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:35.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:36.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:14:36.510+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:14:36.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:36.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:37.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:37.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:38.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:38.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:39.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:39.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:40.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:40.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:41.510 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:14:41.511+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:14:41.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:41.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:42.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:42.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:43.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:43.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:44.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:44.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:45.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:45.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:46.512 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:14:46.512+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:14:46.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:46.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:47.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:47.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:48.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:48.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:49.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:49.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:50.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:50.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:51.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:51.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:51.513 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:14:51.514+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:14:52.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:52.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:53.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:53.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:54.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:54.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:55.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:55.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:56.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:56.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:56.515 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:14:56.515+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:14:57.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:57.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:58.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:58.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:14:59.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:14:59.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:00.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:00.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:01.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:01.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:01.516 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:15:01.516+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:15:02.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:02.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:03.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:03.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:04.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:04.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:05.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:05.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:06.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:06.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:06.517 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:15:06.517+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:15:07.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:07.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:08.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:08.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:09.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:09.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:10.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:10.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:11.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:11.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:11.518 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:15:11.518+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:15:12.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:12.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:13.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:13.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:14.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:14.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:15.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:15.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:16.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:16.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:16.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:15:16.520+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:15:17.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:17.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:18.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:18.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:19.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:19.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:20.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:20.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:20.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:20.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:21.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:15:21.521+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:15:22.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:22.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:23.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:23.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:24.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:24.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:24.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:24.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:25.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:25.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:26.520 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:15:26.521+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:15:26.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:26.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:27.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:27.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:29.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:29.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:30.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:30.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:31.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:31.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:31.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:15:31.522+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:15:31.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:31.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:32.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:32.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:33.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:34.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:34.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:34.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:35.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:35.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:36.522 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:15:36.522+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:15:37.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:37.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:38.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:38.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:39.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:39.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:40.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:40.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:41.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:41.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:41.522 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:15:41.523+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:15:42.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:42.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:43.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:43.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:44.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:44.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:45.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:45.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:46.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:46.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:46.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:15:46.524+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:15:47.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:47.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:48.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:48.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:49.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:49.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:49.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:49.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:51.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:51.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:51.524 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:15:51.525+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:15:51.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:51.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:53.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:53.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:53.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:53.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:54.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:54.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:55.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:55.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:56.526 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:15:56.526+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:15:56.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:56.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:57.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:57.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:58.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:58.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:15:59.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:15:59.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:00.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:00.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:01.527 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:16:01.527+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:16:01.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:01.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:02.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:02.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:03.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:03.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:04.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:04.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:05.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:05.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:06.528 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:16:06.528+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:16:06.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:06.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:08.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:08.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:08.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:08.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:09.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:09.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:10.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:10.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:11.528 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:16:11.529+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:16:11.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:11.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:12.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:12.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:13.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:13.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:14.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:14.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:15.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:15.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:16.529 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:16:16.530+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:16:16.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:16.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:17.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:17.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:18.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:18.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:19.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:19.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:20.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:20.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:21.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:21.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:22.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:22.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:23.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:23.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:24.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:24.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:25.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:25.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:26.536 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:16:26.533+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:16:26.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:26.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:27.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:27.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:28.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:28.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:29.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:29.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:30.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:30.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:31.533 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:16:31.533+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:16:31.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:31.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:32.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:32.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:34.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:34.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:34.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:34.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:35.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:35.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:36.534 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:16:36.534+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:16:37.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:37.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:37.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:37.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:39.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:39.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:40.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:40.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:41.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:41.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:41.535 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:16:41.535+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:16:42.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:42.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:42.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:42.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:43.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:43.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:44.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:44.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:45.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:45.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:46.536 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:16:46.536+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:16:46.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:46.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:47.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:47.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:48.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:48.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:49.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:49.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:50.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:50.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:51.537 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:16:51.537+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:16:51.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:51.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:52.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:52.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:53.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:53.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:54.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:54.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:55.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:55.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:56.538 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:16:56.538+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:16:56.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:56.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:57.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:57.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:58.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:58.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:16:59.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:16:59.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:00.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:00.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:01.539 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:17:01.539+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:17:01.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:01.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:02.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:02.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:03.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:03.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:04.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:04.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:05.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:05.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:06.539 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:17:06.540+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:17:06.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:06.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:07.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:07.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:08.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:08.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:09.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:09.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:10.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:10.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:11.540 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:17:11.541+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:17:11.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:11.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:12.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:12.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:13.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:13.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:14.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:14.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:15.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:15.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:16.542 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:17:16.542+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:17:16.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:16.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:17.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:17.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:18.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:18.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:19.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:19.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:20.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:20.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:21.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:17:21.543+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:17:21.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:21.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:22.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:22.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:23.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:23.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:24.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:24.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:25.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:25.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:26.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:17:26.544+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:17:26.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:26.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:27.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:27.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:28.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:28.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:29.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:29.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:30.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:30.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:31.545 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:17:31.545+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:17:31.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:31.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:32.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:32.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:33.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:33.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:34.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:34.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:35.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:35.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:36.545 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:17:36.546+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:17:36.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:36.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:37.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:37.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:38.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:38.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:39.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:39.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:40.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:40.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:41.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:17:41.547+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:17:41.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:41.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:42.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:42.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:43.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:43.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:44.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:44.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:45.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:45.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:46.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:17:46.548+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:17:46.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:46.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:47.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:47.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:48.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:48.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:49.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:49.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:50.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:50.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:51.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:17:51.549+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:17:51.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:51.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:52.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:52.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:53.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:53.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:54.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:54.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:55.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:55.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:56.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:17:56.550+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:17:56.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:56.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:57.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:57.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:58.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:58.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:17:59.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:17:59.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:00.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:00.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:01.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:18:01.551+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:18:01.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:01.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:02.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:02.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:03.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:03.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:04.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:04.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:05.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:05.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:06.552 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:18:06.552+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:18:06.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:06.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:07.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:07.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:08.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:08.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:09.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:09.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:10.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:10.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:11.553 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:18:11.553+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:18:11.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:11.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:12.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:12.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:13.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:13.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:14.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:14.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:15.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:15.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:16.553 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:18:16.555+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:18:16.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:16.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:17.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:17.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:18.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:18.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:19.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:19.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:20.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:20.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:21.554 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:18:21.556+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:18:21.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:21.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:22.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:22.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:23.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:23.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:24.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:24.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:25.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:25.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:26.555 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:18:26.556+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:18:26.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:26.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:27.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:27.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:28.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:28.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:29.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:29.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:30.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:30.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:31.556 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:18:31.556+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:18:31.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:31.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:32.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:32.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:33.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:33.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:34.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:34.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:35.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:35.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:36.559 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:18:36.557+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:18:36.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:36.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:37.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:37.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:38.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:38.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:39.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:39.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:40.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:40.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:41.558 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:18:41.558+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:18:41.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:41.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:42.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:42.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:43.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:43.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:44.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:44.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:45.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:45.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:46.562 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:18:46.560+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:18:46.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:46.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:47.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:47.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:48.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:48.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:49.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:49.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:50.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:50.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:51.560 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:18:51.560+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:18:51.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:51.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:52.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:52.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:53.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:53.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:54.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:54.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:55.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:55.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:56.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:18:56.562+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:18:56.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:56.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:57.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:57.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:58.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:58.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:18:59.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:18:59.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:00.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:00.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:01.562 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:19:01.563+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:19:01.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:01.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:02.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:02.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:03.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:03.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:04.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:04.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:05.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:05.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:06.563 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:19:06.563+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:19:06.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:06.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:07.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:07.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:08.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:08.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:09.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:09.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:10.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:10.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:11.564 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:19:11.565+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:19:11.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:11.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:12.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:12.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:13.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:13.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:14.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:14.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:15.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:15.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:16.565 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:19:16.566+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:19:16.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:16.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:17.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:17.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:18.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:18.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:19.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:19.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:20.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:20.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:21.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:19:21.566+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:19:21.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:21.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:22.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:22.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:23.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:23.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:24.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:24.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:25.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:25.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:26.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:19:26.567+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:19:26.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:26.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:27.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:27.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:28.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:28.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:29.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:29.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:30.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:30.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:31.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:19:31.569+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:19:31.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:31.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:32.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:32.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:33.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:33.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:34.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:34.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:35.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:35.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:36.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:19:36.570+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:19:36.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:36.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:37.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:37.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:38.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:38.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:39.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:39.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:40.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:40.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:41.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:41.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:41.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:19:41.571+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:19:42.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:42.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:43.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:43.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:44.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:44.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:45.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:45.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:46.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:46.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:46.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:19:46.571+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:19:47.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:47.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:48.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:48.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:49.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:49.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:50.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:50.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:51.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:51.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:51.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:19:51.572+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:19:52.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:52.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:53.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:53.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:54.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:54.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:55.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:55.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:56.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:56.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:56.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:19:56.573+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:19:57.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:57.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:58.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:58.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:19:59.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:19:59.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:00.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:00.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:01.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:01.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:02.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:02.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:03.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:03.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:04.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:04.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:05.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:05.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:06.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:06.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:06.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:20:06.576+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:20:07.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:07.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:08.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:08.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:09.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:09.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:10.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:10.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:11.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:11.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:11.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:20:11.576+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:20:12.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:12.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:13.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:13.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:14.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:14.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:15.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:15.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:16.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:16.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:16.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:20:16.577+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:20:17.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:17.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:18.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:18.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:19.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:19.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:20.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:20.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:21.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:20:21.578+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:20:21.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:21.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:22.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:22.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:23.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:23.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:24.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:24.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:25.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:25.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:26.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:20:26.579+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:20:26.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:26.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:27.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:27.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:28.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:28.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:29.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:29.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:30.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:30.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:31.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:20:31.580+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:20:31.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:31.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:32.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:32.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:33.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:33.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:34.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:34.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:35.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:35.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:36.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:20:36.581+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:20:36.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:36.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:37.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:37.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:38.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:38.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:39.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:39.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:40.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:40.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:41.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:20:41.582+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:20:41.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:41.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:42.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:42.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:43.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:43.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:44.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:44.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:45.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:45.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:46.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:20:46.583+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:20:46.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:46.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:47.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:47.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:48.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:48.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:49.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:49.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:50.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:50.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:51.584 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:20:51.584+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:20:51.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:51.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:52.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:52.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:53.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:53.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:54.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:54.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:55.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:55.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:56.584 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:20:56.585+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:20:56.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:56.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:57.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:57.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:58.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:58.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:20:59.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:20:59.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:00.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:00.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:01.585 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:21:01.586+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:21:01.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:01.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:02.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:02.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:03.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:03.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:04.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:04.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:05.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:05.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:06.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:21:06.586+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:21:06.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:06.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:07.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:07.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:08.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:08.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:09.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:09.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:10.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:10.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:11.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:21:11.587+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:21:11.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:11.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:12.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:12.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:13.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:13.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:15.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:15.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:16.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:16.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:16.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:21:16.589+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:21:16.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:16.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:18.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:18.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:19.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:19.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:20.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:20.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:21.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:21.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:21.589 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:21:21.591+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:21:22.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:22.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:23.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:23.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:24.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:24.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:25.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:25.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:26.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:26.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:26.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:21:26.591+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:21:27.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:27.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:28.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:28.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:29.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:29.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:30.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:30.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:31.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:31.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:31.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:21:31.591+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:21:32.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:32.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:33.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:33.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:34.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:34.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:35.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:35.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:36.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:36.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:36.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:21:36.592+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:21:37.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:37.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:38.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:38.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:39.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:39.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:40.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:40.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:41.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:41.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:41.593 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:21:41.593+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:21:42.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:42.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:43.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:43.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:44.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:44.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:45.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:45.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:46.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:46.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:46.594 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:21:46.595+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:21:47.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:47.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:48.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:48.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:49.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:49.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:50.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:50.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:51.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:51.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:51.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:21:51.596+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:21:52.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:52.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:53.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:53.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:54.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:54.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:55.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:55.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:56.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:56.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:56.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:21:56.596+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:21:57.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:57.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:58.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:58.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:21:59.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:21:59.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:00.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:00.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:01.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:01.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:01.597 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:22:01.597+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:22:02.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:02.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:03.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:03.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:04.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:04.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:05.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:05.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:06.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:06.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:06.598 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:22:06.598+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:22:07.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:07.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:08.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:08.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:09.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:09.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:10.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:10.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:11.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:11.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:11.599 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:22:11.599+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:22:12.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:12.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:13.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:13.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:14.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:14.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:15.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:15.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:16.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:16.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:16.599 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:22:16.600+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:22:17.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:17.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:18.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:18.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:19.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:19.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:20.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:20.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:21.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:21.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:21.600 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:22:21.601+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:22:22.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:22.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:23.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:23.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:24.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:24.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:25.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:25.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:26.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:26.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:26.601 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:22:26.602+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:22:27.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:27.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:28.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:28.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:29.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:29.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:29.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:29.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:31.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:31.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:31.602 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:22:31.603+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:22:31.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:31.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:32.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:32.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:34.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:34.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:34.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:34.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:35.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:35.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:36.603 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:22:36.604+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:22:36.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:36.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:37.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:37.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:38.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:38.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:39.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:39.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:40.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:40.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:41.604 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:22:41.605+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:22:41.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:41.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:42.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:42.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:43.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:43.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:44.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:44.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:45.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:45.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:46.605 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:22:46.606+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:22:46.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:46.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:47.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:47.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:48.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:48.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:49.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:49.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:50.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:50.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:51.606 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:22:51.607+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:22:51.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:51.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:52.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:52.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:53.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:53.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:54.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:54.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:55.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:55.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:56.608 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:22:56.609+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:22:56.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:56.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:57.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:57.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:58.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:58.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:22:59.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:22:59.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:00.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:00.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:01.609 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:23:01.610+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:23:01.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:01.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:02.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:02.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:03.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:03.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:04.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:04.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:05.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:05.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:06.610 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:23:06.611+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:23:06.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:06.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:07.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:07.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:08.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:08.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:09.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:09.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:10.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:10.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:11.611 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:23:11.611+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:23:11.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:11.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:12.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:12.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:13.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:13.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:14.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:14.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:15.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:15.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:16.613 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:23:16.612+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:23:16.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:16.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:17.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:17.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:18.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:18.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:19.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:19.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:20.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:20.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:21.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:23:21.613+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:23:21.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:21.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:22.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:22.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:23.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:23.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:24.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:24.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:25.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:25.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:26.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:23:26.614+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:23:26.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:26.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:27.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:27.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:28.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:28.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:29.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:29.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:30.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:30.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:31.615 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:23:31.615+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:23:31.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:31.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:32.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:32.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:33.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:33.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:34.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:34.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:35.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:35.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:36.616 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:23:36.616+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:23:36.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:36.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:37.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:37.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:38.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:38.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:39.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:39.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:40.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:40.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:41.617 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:23:41.617+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:23:41.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:41.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:42.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:42.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:43.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:43.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:44.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:44.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:45.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:45.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:46.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:46.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:46.617 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:23:46.618+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:23:47.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:47.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:48.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:48.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:49.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:49.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:50.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:50.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:51.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:51.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:51.619 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:23:51.619+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:23:52.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:52.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:53.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:53.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:54.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:54.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:55.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:55.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:56.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:56.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:56.620 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:23:56.620+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:23:57.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:57.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:58.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:58.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:23:59.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:23:59.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:00.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:00.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:01.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:01.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:01.620 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:24:01.621+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:24:02.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:02.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:03.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:03.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:04.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:04.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:05.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:05.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:06.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:06.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:06.621 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:24:06.622+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:24:07.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:07.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:08.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:08.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:09.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:09.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:10.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:10.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:11.623 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:24:11.623+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:24:11.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:11.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:12.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:12.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:13.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:13.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:14.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:14.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:15.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:15.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:16.624 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:24:16.624+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:24:16.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:16.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:17.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:17.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:18.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:18.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:19.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:19.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:20.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:20.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:21.625 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:24:21.626+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:24:21.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:21.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:22.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:22.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:23.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:23.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:24.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:24.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:25.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:25.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:26.625 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:24:26.627+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:24:26.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:26.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:27.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:27.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:28.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:28.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:29.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:29.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:30.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:30.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:31.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:31.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:31.626 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:24:31.628+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:24:32.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:32.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:33.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:33.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:34.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:34.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:35.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:35.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:36.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:36.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:36.627 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:24:36.627+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:24:37.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:37.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:38.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:38.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:39.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:39.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:40.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:40.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:41.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:41.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:41.628 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:24:41.629+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:24:42.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:42.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:43.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:43.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:44.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:44.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:45.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:45.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:46.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:46.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:46.629 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:24:46.629+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:24:47.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:47.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:48.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:48.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:49.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:49.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:50.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:50.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:51.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:51.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:51.630 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:24:51.631+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:24:52.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:52.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:53.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:53.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:54.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:54.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:55.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:55.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:56.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:56.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:56.631 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:24:56.631+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:24:57.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:57.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:58.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:58.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:24:59.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:24:59.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:00.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:00.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:01.631 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:25:01.632+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:25:01.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:01.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:02.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:02.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:03.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:03.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:04.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:04.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:05.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:05.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:06.633 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:25:06.633+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:25:06.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:06.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:07.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:07.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:08.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:08.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:09.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:09.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:10.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:10.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:11.634 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:25:11.634+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:25:11.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:11.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:12.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:12.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:13.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:13.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:14.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:14.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:15.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:15.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:16.635 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:25:16.635+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:25:16.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:16.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:17.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:17.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:18.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:18.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:19.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:19.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:20.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:20.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:21.636 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:25:21.637+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:25:21.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:21.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:22.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:22.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:23.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:23.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:24.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:24.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:25.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:25.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:26.637 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:25:26.637+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:25:26.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:26.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:27.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:27.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:28.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:28.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:29.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:29.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:30.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:30.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:31.638 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:25:31.639+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:25:31.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:31.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:32.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:32.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:33.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:33.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:34.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:34.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:35.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:35.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:36.639 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:25:36.639+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:25:36.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:36.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:38.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:38.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:39.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:39.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:40.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:40.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:41.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:41.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:41.640 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:25:41.640+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:25:42.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:42.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:43.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:43.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:44.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:44.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:45.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:45.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:46.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:46.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:46.641 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:25:46.641+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:25:47.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:47.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:48.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:48.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:48.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:48.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:50.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:50.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:51.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:51.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:51.642 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:25:51.643+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:25:51.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:51.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:52.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:52.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:54.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:54.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:54.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:54.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:56.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:56.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:56.643 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:25:56.643+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:25:57.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:57.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:58.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:58.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:25:59.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:25:59.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:00.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:00.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:01.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:01.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:01.643 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:26:01.644+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:26:02.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:02.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:03.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:03.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:04.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:04.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:05.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:05.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:06.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:06.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:06.645 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:26:06.645+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:26:07.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:07.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:08.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:08.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:09.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:09.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:10.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:10.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:11.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:11.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:11.646 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:26:11.646+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:26:12.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:12.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:13.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:13.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:14.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:14.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:15.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:15.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:16.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:16.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:16.647 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:26:16.647+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:26:17.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:17.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:18.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:18.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:19.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:19.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:20.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:20.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:21.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:21.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:21.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:26:21.648+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:26:22.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:22.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:23.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:23.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:24.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:24.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:25.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:25.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:26.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:26.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:26.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:26:26.649+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:26:27.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:27.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:28.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:28.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:29.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:29.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:30.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:30.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:31.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:31.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:31.649 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:26:31.650+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:26:32.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:32.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:33.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:33.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:34.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:34.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:35.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:35.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:36.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:36.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:36.650 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:26:36.651+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:26:37.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:37.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:38.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:38.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:39.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:39.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:40.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:40.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:41.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:41.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:41.652 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:26:41.652+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:26:42.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:42.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:43.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:43.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:44.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:44.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:45.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:45.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:46.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:46.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:46.653 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:26:46.654+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:26:47.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:47.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:48.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:48.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:49.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:49.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:50.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:50.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:51.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:51.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:51.654 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:26:51.655+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:26:52.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:52.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:53.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:53.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:54.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:54.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:55.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:55.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:56.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:56.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:56.655 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:26:56.655+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:26:57.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:57.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:58.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:58.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:26:59.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:26:59.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:00.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:00.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:01.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:01.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:01.656 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:27:01.657+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:27:02.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:02.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:03.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:03.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:04.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:04.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:05.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:05.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:06.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:06.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:06.657 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:27:06.657+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:27:07.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:07.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:08.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:08.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:09.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:09.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:10.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:10.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:11.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:11.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:11.658 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:27:11.658+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:27:12.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:12.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:13.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:13.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:14.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:14.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:15.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:15.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:16.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:16.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:16.658 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:27:16.659+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:27:17.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:17.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:18.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:18.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:19.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:19.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:20.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:20.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:21.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:21.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:21.659 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:27:21.660+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:27:22.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:22.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:23.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:23.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:24.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:24.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:25.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:25.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:26.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:26.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:26.660 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:27:26.662+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:27:27.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:27.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:28.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:28.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:29.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:29.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:30.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:30.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:31.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:31.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:31.660 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:27:31.662+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:27:32.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:32.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:33.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:33.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:34.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:34.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:35.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:35.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:35.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:35.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:36.662 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:27:36.663+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:27:37.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:37.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:38.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:38.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:39.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:39.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:40.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:40.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:40.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:40.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:41.663 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:27:41.664+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:27:41.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:41.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:42.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:42.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:44.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:44.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:45.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:45.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:46.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:46.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:46.664 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:27:46.664+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:27:47.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:47.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:48.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:48.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:49.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:49.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:50.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:50.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:51.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:51.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:51.665 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:27:51.666+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:27:52.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:52.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:53.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:53.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:54.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:54.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:55.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:55.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:56.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:56.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:56.666 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:27:56.666+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:27:57.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:57.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:57.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:57.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:58.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:58.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:27:59.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:27:59.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:00.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:00.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:01.667 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:28:01.668+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:28:01.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:01.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:02.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:02.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:03.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:03.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:04.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:04.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:05.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:05.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:06.668 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:28:06.668+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:28:06.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:06.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:07.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:07.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:08.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:08.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:09.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:09.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:10.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:11.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:11.669 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:28:11.669+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:28:12.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:12.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:13.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:13.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:14.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:14.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:15.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:15.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:16.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:16.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:16.670 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:28:16.671+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:28:17.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:17.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:18.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:18.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:19.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:19.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:20.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:20.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:21.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:21.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:21.671 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:28:21.672+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:28:22.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:22.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:23.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:23.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:24.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:24.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:25.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:25.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:26.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:26.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:26.672 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:28:26.673+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:28:27.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:27.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:28.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:28.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:29.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:29.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:30.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:30.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:31.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:31.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:31.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:28:31.673+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:28:32.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:32.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:33.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:33.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:34.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:34.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:35.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:35.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:36.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:36.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:36.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:28:36.674+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:28:37.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:37.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:38.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:38.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:39.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:39.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:40.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:40.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:41.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:41.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:41.674 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:28:41.675+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:28:42.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:42.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:43.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:43.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:44.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:44.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:45.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:45.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:46.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:46.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:46.675 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:28:46.676+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:28:47.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:47.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:48.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:48.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:49.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:49.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:50.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:50.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:51.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:51.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:51.676 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:28:51.677+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:28:52.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:52.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:53.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:53.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:54.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:54.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:55.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:55.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:55.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:55.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:56.677 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:28:56.678+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:28:57.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:57.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:57.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:57.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:58.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:58.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:28:59.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:28:59.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:00.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:00.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:01.678 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:29:01.679+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:29:01.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:01.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:02.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:02.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:03.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:03.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:04.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:04.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:05.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:05.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:06.679 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:29:06.680+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:29:06.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:06.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:07.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:07.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:08.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:08.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:09.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:09.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:10.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:10.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:11.680 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:29:11.681+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:29:11.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:11.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:12.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:12.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:14.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:14.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:15.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:15.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:16.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:16.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:16.681 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:29:16.682+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:29:17.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:17.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:18.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:18.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:19.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:19.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:20.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:20.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:21.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:21.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:21.682 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:29:21.683+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:29:22.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:22.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:23.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:23.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:24.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:24.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:25.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:25.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:26.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:26.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:26.683 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:29:26.684+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:29:27.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:27.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:28.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:28.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:29.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:29.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:30.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:30.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:31.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:31.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:31.684 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:29:31.685+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:29:32.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:32.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:33.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:33.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:34.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:34.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:35.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:35.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:36.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:36.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:36.685 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:29:36.686+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:29:37.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:37.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:38.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:38.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:39.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:39.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:40.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:40.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:41.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:41.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:41.687 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:29:41.687+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:29:42.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:42.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:43.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:43.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:44.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:44.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:45.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:45.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:46.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:46.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:46.687 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:29:46.688+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:29:47.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:47.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:48.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:48.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:49.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:49.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:50.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:50.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:51.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:51.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:51.688 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:29:51.689+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:29:52.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:52.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:53.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:53.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:54.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:54.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:55.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:55.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:56.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:56.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:56.690 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:29:56.690+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:29:57.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:57.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:58.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:58.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:29:59.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:29:59.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:00.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:00.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:01.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:01.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:01.691 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:30:01.691+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:30:02.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:02.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:03.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:03.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:04.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:04.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:05.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:05.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:06.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:06.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:06.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:30:06.692+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:30:07.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:07.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:08.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:08.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:09.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:09.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:10.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:10.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:11.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:11.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:11.693 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:30:11.693+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:30:12.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:12.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:13.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:13.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:14.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:14.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:15.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:15.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:16.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:16.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:16.694 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:30:16.694+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:30:17.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:17.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:18.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:18.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:19.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:19.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:20.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:20.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:21.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:21.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:21.694 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:30:21.695+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:30:22.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:22.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:23.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:23.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:24.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:24.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:25.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:25.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:26.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:26.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:26.696 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:30:26.696+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:30:27.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:27.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:28.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:28.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:29.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:29.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:30.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:30.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:31.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:31.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:31.696 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:30:31.698+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:30:32.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:32.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:33.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:33.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:34.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:34.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:35.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:35.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:36.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:36.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:36.697 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:30:36.699+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:30:37.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:37.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:38.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:38.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:39.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:39.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:40.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:40.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:41.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:41.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:41.698 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:30:41.699+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:30:42.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:42.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:43.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:43.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:44.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:44.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:45.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:45.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:46.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:46.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:46.699 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:30:46.699+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:30:47.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:47.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:48.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:48.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:49.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:49.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:50.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:50.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:51.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:51.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:51.699 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:30:51.700+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:30:52.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:52.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:53.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:53.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:54.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:54.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:55.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:55.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:56.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:56.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:56.701 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:30:56.701+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:30:57.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:57.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:58.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:58.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:30:59.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:30:59.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:00.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:00.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:01.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:01.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:01.702 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:31:01.702+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:31:02.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:02.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:03.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:03.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:04.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:04.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:05.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:05.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:06.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:06.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:06.703 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:31:06.703+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:31:07.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:07.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:08.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:08.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:09.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:09.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:10.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:10.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:11.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:11.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:11.704 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:31:11.704+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:31:12.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:12.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:13.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:13.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:14.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:14.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:15.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:15.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:16.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:16.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:16.705 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:31:16.706+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:31:17.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:17.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:18.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:18.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:19.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:19.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:20.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:20.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:21.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:21.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:21.706 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:31:21.706+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:31:22.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:22.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:23.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:23.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:24.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:24.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:25.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:25.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:26.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:26.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:26.707 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:31:26.707+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:31:27.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:27.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:28.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:28.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:29.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:29.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:30.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:30.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:31.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:31.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:31.708 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:31:31.708+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:31:32.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:32.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:33.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:33.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:34.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:34.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:35.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:35.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:36.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:36.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:36.709 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:31:36.709+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:31:37.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:37.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:38.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:38.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:39.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:39.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:40.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:40.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:41.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:41.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:41.710 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:31:41.710+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:31:42.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:42.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:43.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:43.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:44.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:44.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:45.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:45.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:46.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:46.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:46.711 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:31:46.711+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:31:47.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:47.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:48.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:48.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:49.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:49.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:50.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:50.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:51.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:51.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:51.712 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:31:51.712+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:31:52.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:52.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:53.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:53.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:54.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:54.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:55.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:55.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:56.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:56.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:56.713 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:31:56.713+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:31:57.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:57.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:58.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:58.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:31:59.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:31:59.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:00.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:00.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:01.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:01.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:01.714 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:32:01.715+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:32:02.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:02.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:03.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:03.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:04.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:04.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:05.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:05.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:06.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:06.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:06.716 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:32:06.717+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:32:07.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:07.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:08.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:08.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:09.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:09.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:10.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:10.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:11.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:11.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:11.717 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:32:11.717+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:32:12.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:12.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:13.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:13.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:14.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:14.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:15.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:15.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:16.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:16.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:16.718 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:32:16.719+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:32:17.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:17.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:18.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:18.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:19.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:19.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:20.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:20.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:21.719 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:32:21.720+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:32:21.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:21.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:22.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:22.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:23.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:23.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:24.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:24.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:25.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:25.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:26.720 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:32:26.720+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:32:26.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:26.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:27.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:27.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:28.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:28.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:29.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:29.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:30.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:30.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:31.720 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:32:31.721+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:32:31.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:31.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:32.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:32.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:33.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:33.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:34.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:34.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:35.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:35.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:36.721 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:32:36.722+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:32:36.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:36.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:37.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:37.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:38.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:38.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:39.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:39.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:40.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:40.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:41.722 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:32:41.722+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:32:41.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:41.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:42.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:42.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:43.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:43.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:44.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:44.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:45.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:45.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:46.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:46.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:46.722 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:32:46.723+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:32:47.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:47.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:48.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:48.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:49.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:49.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:50.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:50.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:51.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:51.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:51.723 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:32:51.724+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:32:52.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:52.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:53.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:53.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:54.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:54.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:55.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:55.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:56.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:56.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:56.724 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:32:56.725+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:32:57.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:57.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:58.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:58.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:32:59.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:32:59.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:00.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:00.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:01.725 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:33:01.726+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:33:01.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:01.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:02.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:02.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:03.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:03.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:04.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:04.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:05.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:05.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:06.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:06.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:06.726 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:33:06.727+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:33:07.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:07.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:08.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:08.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:09.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:09.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:10.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:10.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:11.728 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:33:11.728+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:33:11.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:11.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:12.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:12.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:13.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:13.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:14.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:14.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:15.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:15.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:16.729 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:33:16.729+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:33:16.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:16.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:17.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:17.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:18.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:18.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:19.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:19.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:20.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:20.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:21.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:21.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:21.729 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:33:21.730+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:33:22.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:22.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:23.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:23.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:24.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:24.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:25.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:25.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:26.730 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:33:26.731+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:33:26.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:26.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:27.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:27.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:28.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:28.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:29.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:29.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:30.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:30.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:31.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:31.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:31.732 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:33:31.732+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:33:32.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:32.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:33.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:33.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:34.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:34.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:35.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:35.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:36.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:36.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:36.732 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:33:36.734+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:33:37.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:37.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:38.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:38.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:39.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:39.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:40.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:40.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:41.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:41.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:41.733 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:33:41.735+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:33:42.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:42.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:43.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:43.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:44.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:44.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:45.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:45.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:46.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:46.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:46.734 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:33:46.735+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:33:47.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:47.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:48.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:48.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:49.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:49.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:50.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:50.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:51.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:51.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:51.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:33:51.735+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:33:52.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:52.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:53.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:53.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:54.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:54.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:55.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:55.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:56.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:56.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:56.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:33:56.736+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:33:57.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:57.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:58.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:58.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:33:59.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:33:59.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:00.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:00.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:01.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:01.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:01.737 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:34:01.738+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:34:02.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:02.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:03.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:03.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:04.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:04.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:05.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:05.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:06.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:06.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:06.738 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:34:06.738+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:34:07.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:07.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:08.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:08.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:09.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:09.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:10.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:10.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:11.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:11.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:11.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:34:11.740+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:34:12.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:12.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:13.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:13.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:14.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:14.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:15.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:15.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:16.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:16.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:16.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:34:16.741+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:34:17.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:17.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:18.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:18.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:19.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:19.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:20.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:20.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:21.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:21.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:21.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:34:21.742+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:34:22.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:22.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:23.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:23.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:24.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:24.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:25.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:25.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:26.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:26.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:26.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:34:26.742+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:34:27.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:27.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:28.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:28.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:29.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:29.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:30.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:30.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:31.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:31.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:31.743 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:34:31.744+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:34:32.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:32.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:33.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:33.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:34.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:34.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:35.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:35.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:36.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:36.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:36.744 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:34:36.744+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:34:37.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:37.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:38.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:38.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:39.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:39.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:40.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:40.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:41.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:41.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:41.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:34:41.746+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:34:42.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:42.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:43.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:43.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:44.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:44.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:45.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:45.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:46.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:46.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:46.746 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:34:46.746+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:34:47.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:47.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:48.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:48.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:49.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:49.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:50.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:50.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:51.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:51.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:51.747 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:34:51.748+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:34:52.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:52.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:53.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:53.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:54.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:54.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:55.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:55.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:56.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:56.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:56.748 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:34:56.748+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:34:57.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:57.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:58.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:58.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:34:59.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:34:59.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:00.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:00.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:01.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:01.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:01.749 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:35:01.749+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:35:02.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:02.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:03.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:03.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:04.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:04.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:05.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:05.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:06.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:06.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:06.750 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:35:06.750+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:35:07.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:07.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:08.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:08.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:09.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:09.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:10.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:10.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:11.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:11.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:11.751 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:35:11.751+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:35:12.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:12.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:13.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:13.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:14.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:14.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:15.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:15.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:16.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:16.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:16.751 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:35:16.752+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:35:17.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:17.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:18.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:18.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:19.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:19.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:20.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:20.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:21.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:21.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:21.753 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:35:21.753+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:35:22.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:22.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:23.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:23.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:24.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:24.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:25.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:25.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:26.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:26.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:26.754 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:35:26.754+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:35:27.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:27.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:28.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:28.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:29.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:29.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:30.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:30.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:31.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:31.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:31.755 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:35:31.755+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:35:32.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:32.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:33.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:33.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:34.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:34.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:35.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:35.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:36.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:36.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:36.755 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:35:36.756+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:35:37.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:37.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:38.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:38.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:39.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:39.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:40.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:40.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:41.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:41.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:41.756 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:35:41.757+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:35:42.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:42.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:43.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:43.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:44.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:44.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:45.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:45.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:46.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:46.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:46.757 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:35:46.758+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:35:47.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:47.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:48.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:48.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:49.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:49.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:50.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:50.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:51.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:51.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:51.757 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:35:51.758+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:35:52.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:52.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:53.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:53.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:54.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:54.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:55.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:55.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:56.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:56.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:56.758 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:35:56.759+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:35:57.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:57.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:58.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:58.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:35:59.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:35:59.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:00.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:00.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:01.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:01.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:01.759 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:36:01.760+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:36:02.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:02.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:03.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:03.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:04.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:04.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:05.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:05.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:06.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:06.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:06.760 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:36:06.762+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:36:07.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:07.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:08.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:08.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:09.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:09.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:10.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:10.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:11.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:11.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:11.761 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:36:11.762+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:36:12.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:12.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:13.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:13.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:14.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:14.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:15.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:15.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:16.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:16.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:16.764 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:36:16.765+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:36:17.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:17.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:18.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:18.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:19.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:19.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:20.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:20.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:21.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:21.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:21.765 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:36:21.765+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:36:22.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:22.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:23.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:23.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:24.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:24.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:25.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:25.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:26.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:26.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:26.765 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:36:26.766+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:36:27.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:27.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:28.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:28.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:29.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:29.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:30.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:30.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:31.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:31.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:31.767 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:36:31.768+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:36:32.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:32.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:33.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:33.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:34.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:34.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:35.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:35.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:36.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:36.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:36.767 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:36:36.769+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:36:37.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:37.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:38.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:38.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:39.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:39.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:40.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:40.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:41.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:41.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:41.768 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:36:41.769+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:36:42.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:42.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:43.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:43.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:44.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:44.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:45.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:45.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:46.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:46.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:46.770 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:36:46.771+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:36:47.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:47.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:48.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:48.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:49.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:49.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:50.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:50.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:51.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:51.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:51.771 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:36:51.771+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:36:52.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:52.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:53.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:53.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:54.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:54.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:55.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:55.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:56.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:56.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:56.772 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:36:56.772+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:36:57.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:57.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:58.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:58.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:36:59.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:36:59.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:00.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:00.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:01.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:01.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:01.773 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:37:01.773+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:37:02.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:02.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:03.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:03.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:04.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:04.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:05.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:05.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:06.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:06.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:06.774 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:37:06.774+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:37:07.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:07.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:08.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:08.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:09.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:09.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:10.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:10.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:11.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:11.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:11.775 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:37:11.775+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:37:12.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:12.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:13.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:13.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:14.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:14.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:15.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:15.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:16.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:16.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:16.775 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:37:16.776+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:37:17.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:17.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:18.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:18.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:19.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:19.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:20.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:20.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:21.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:21.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:21.777 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:37:21.777+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:37:22.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:22.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:23.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:23.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:24.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:24.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:25.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:25.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:26.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:26.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:26.778 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:37:26.779+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:37:27.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:27.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:28.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:28.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:29.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:29.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:30.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:30.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:31.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:31.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:31.779 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:37:31.779+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:37:32.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:32.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:33.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:33.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:34.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:34.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:35.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:35.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:36.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:36.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:36.780 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:37:36.780+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:37:37.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:37.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:38.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:38.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:39.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:39.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:40.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:40.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:41.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:41.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:41.781 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:37:41.781+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:37:42.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:42.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:43.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:43.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:44.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:44.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:45.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:45.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:46.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:46.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:46.782 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:37:46.782+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:37:47.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:47.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:48.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:48.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:49.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:49.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:50.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:50.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:51.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:51.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:51.783 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:37:51.783+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:37:52.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:52.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:53.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:53.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:54.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:54.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:55.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:55.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:56.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:56.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:56.783 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:37:56.784+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:37:57.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:57.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:58.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:58.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:37:59.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:37:59.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:00.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:00.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:01.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:01.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:01.785 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:38:01.785+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:38:02.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:02.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:03.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:03.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:04.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:04.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:05.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:05.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:06.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:06.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:06.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:38:06.786+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:38:07.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:07.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:08.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:08.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:09.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:09.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:10.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:10.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:11.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:11.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:11.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:38:11.787+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:38:12.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:12.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:13.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:13.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:14.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:14.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:15.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:15.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:16.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:16.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:16.787 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:38:16.788+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:38:17.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:17.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:18.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:18.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:19.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:19.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:20.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:20.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:21.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:21.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:21.788 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:38:21.789+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:38:22.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:22.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:23.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:23.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:24.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:24.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:25.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:25.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:26.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:26.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:26.789 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:38:26.790+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:38:27.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:27.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:28.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:28.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:29.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:29.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:30.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:30.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:31.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:31.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:31.790 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:38:31.791+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:38:32.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:32.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:33.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:33.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:34.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:34.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:35.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:35.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:36.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:36.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:36.795 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:38:36.792+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:38:37.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:37.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:38.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:38.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:39.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:39.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:40.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:40.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:41.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:41.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:41.792 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:38:41.793+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:38:42.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:42.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:43.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:43.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:44.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:44.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:45.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:45.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:46.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:46.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:46.794 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:38:46.794+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:38:47.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:47.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:48.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:48.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:49.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:49.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:50.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:50.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:51.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:51.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:51.795 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:38:51.795+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:38:52.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:52.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:53.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:53.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:54.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:54.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:55.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:55.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:56.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:56.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:56.796 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:38:56.797+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:38:57.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:57.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:58.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:58.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:38:59.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:38:59.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:00.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:00.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:01.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:01.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:01.797 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:39:01.797+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:39:02.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:02.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:03.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:03.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:04.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:04.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:05.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:05.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:06.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:06.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:06.798 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:39:06.798+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:39:07.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:07.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:08.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:08.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:09.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:09.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:10.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:10.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:11.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:11.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:11.799 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:39:11.799+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:39:12.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:12.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:13.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:13.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:14.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:14.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:15.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:15.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:16.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:16.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:16.800 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:39:16.800+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:39:17.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:17.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:18.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:18.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:19.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:19.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:20.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:20.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:21.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:21.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:21.800 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:39:21.801+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:39:22.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:22.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:23.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:23.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:24.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:24.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:25.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:25.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:26.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:26.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:26.802 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:39:26.802+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:39:27.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:27.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:28.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:28.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:29.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:29.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:30.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:30.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:31.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:31.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:31.803 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:39:31.803+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:39:32.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:32.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:33.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:33.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:34.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:34.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:35.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:35.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:36.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:36.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:36.804 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:39:36.804+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:39:37.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:37.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:38.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:38.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:39.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:39.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:40.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:40.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:41.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:41.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:41.805 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:39:41.806+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:39:42.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:42.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:43.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:43.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:44.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:44.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:45.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:45.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:46.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:46.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:46.805 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:39:46.807+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:39:47.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:47.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:48.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:48.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:49.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:49.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:50.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:50.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:51.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:51.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:51.806 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:39:51.806+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:39:52.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:52.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:53.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:53.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:54.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:54.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:55.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:55.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:56.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:56.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:56.807 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:39:56.808+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:39:57.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:57.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:58.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:58.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:39:59.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:39:59.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:00.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:00.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:01.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:01.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:01.808 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:40:01.808+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:40:02.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:02.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:03.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:03.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:04.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:04.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:05.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:05.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:06.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:06.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:06.809 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:40:06.810+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:40:07.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:07.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:08.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:08.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:09.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:09.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:10.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:10.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:11.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:11.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:11.810 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:40:11.810+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:40:12.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:12.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:13.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:13.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:14.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:14.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:15.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:15.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:16.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:16.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:16.816 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:40:16.812+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:40:17.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:17.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:18.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:18.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:19.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:19.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:20.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:20.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:21.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:21.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:21.812 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:40:21.812+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:40:22.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:22.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:23.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:23.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:24.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:24.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:25.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:25.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:26.813 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:40:26.814+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:40:26.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:26.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:27.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:27.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:28.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:28.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:29.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:29.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:30.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:30.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:31.814 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:40:31.814+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:40:31.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:31.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:32.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:32.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:33.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:33.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:34.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:34.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:35.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:35.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:36.815 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:40:36.816+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:40:36.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:36.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:37.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:37.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:38.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:38.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:39.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:39.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:40.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:40.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:41.816 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:40:41.817+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:40:41.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:41.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:42.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:42.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:43.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:43.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:44.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:44.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:45.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:45.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:46.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:46.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:46.817 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:40:46.818+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:40:47.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:47.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:48.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:48.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:49.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:49.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:50.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:50.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:51.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:51.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:51.818 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:40:51.819+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:40:52.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:52.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:53.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:53.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:54.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:54.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:55.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:55.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:56.819 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:40:56.820+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:40:56.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:56.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:57.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:57.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:58.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:58.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:40:59.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:40:59.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:00.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:00.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:01.820 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:41:01.821+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:41:01.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:01.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:02.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:02.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:03.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:03.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:04.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:04.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:05.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:05.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:06.821 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:41:06.822+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:41:06.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:06.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:07.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:07.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:08.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:08.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:09.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:09.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:10.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:10.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:11.822 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:41:11.823+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:41:11.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:11.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:12.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:12.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:13.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:13.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:14.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:14.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:15.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:15.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:16.823 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:41:16.823+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:41:17.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:17.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:18.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:18.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:19.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:19.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:20.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:20.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:21.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:21.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:21.824 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:41:21.825+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:41:22.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:22.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:23.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:23.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:24.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:24.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:25.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:25.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:26.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:26.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:26.825 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:41:26.825+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:41:27.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:27.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:28.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:28.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:29.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:29.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:30.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:30.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:31.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:31.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:31.826 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:41:31.827+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:41:32.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:32.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:33.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:33.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:34.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:34.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:35.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:35.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:36.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:36.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:36.827 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:41:36.828+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:41:37.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:37.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:38.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:38.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:39.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:39.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:40.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:40.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:41.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:41.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:41.828 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:41:41.829+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:41:42.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:42.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:43.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:43.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:44.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:44.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:45.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:45.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:46.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:46.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:46.829 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:41:46.829+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:41:47.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:47.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:48.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:48.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:49.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:49.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:50.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:50.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:51.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:51.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:51.829 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:41:51.830+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:41:52.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:52.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:53.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:53.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:54.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:54.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:55.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:55.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:56.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:56.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:56.831 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:41:56.832+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:41:57.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:57.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:58.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:58.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:41:59.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:41:59.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:00.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:00.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:01.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:01.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:01.832 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:42:01.832+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:42:02.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:02.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:03.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:03.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:04.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:04.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:05.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:05.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:06.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:06.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:06.833 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:42:06.834+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:42:07.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:07.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:08.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:08.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:09.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:09.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:10.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:10.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:11.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:11.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:11.834 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:42:11.835+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:42:12.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:12.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:13.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:13.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:14.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:14.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:15.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:15.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:16.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:16.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:16.835 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:42:16.836+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:42:17.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:17.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:18.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:18.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:19.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:19.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:20.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:20.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:21.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:21.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:21.836 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:42:21.837+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:42:22.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:22.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:23.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:23.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:24.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:24.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:25.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:25.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:26.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:26.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:26.837 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:42:26.838+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:42:27.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:27.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:28.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:28.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:29.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:29.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:30.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:30.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:31.838 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:42:31.839+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:42:31.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:31.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:32.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:32.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:33.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:33.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:34.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:34.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:35.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:35.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:36.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:36.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:36.839 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:42:36.840+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:42:37.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:37.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:38.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:38.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:39.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:39.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:40.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:40.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:41.840 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:42:41.841+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:42:41.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:41.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:42.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:42.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:43.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:43.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:44.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:44.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:45.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:45.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:46.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:46.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:46.841 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:42:46.843+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:42:47.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:47.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:48.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:48.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:49.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:49.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:50.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:50.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:51.842 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:42:51.843+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:42:51.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:51.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:52.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:52.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:53.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:53.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:54.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:54.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:55.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:55.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:56.843 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:42:56.844+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:42:56.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:56.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:57.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:57.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:58.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:58.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:42:59.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:42:59.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:00.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:00.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:01.844 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:43:01.844+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:43:01.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:01.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:02.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:02.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:03.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:03.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:04.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:04.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:05.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:05.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:06.845 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:43:06.846+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:43:06.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:06.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:07.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:07.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:08.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:08.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:09.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:09.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:10.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:10.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:11.846 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:43:11.846+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:43:11.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:11.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:12.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:12.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:13.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:13.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:14.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:14.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:16.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:16.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:16.846 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:43:16.847+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:43:16.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:16.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:17.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:17.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:18.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:18.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:19.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:19.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:20.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:20.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:21.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:21.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:21.848 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:43:21.848+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:43:22.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:22.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:23.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:23.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:24.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:24.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:25.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:25.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:26.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:26.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:26.848 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:43:26.849+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:43:27.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:27.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:28.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:28.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:29.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:29.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:30.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:30.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:31.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:31.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:31.850 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:43:31.851+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:43:32.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:32.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:33.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:33.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:34.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:34.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:35.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:35.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:36.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:36.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:36.851 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:43:36.851+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:43:37.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:37.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:38.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:38.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:39.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:39.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:40.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:40.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:41.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:41.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:41.852 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:43:41.852+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:43:42.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:42.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:43.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:43.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:44.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:44.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:45.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:45.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:46.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:46.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:46.853 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:43:46.854+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:43:47.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:47.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:48.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:48.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:49.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:49.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:50.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:50.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:51.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:51.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:51.854 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:43:51.854+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:43:52.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:52.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:53.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:53.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:54.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:54.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:55.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:55.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:56.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:56.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:56.855 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:43:56.856+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:43:57.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:57.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:58.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:58.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:43:59.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:43:59.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:00.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:00.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:01.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:01.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:01.856 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:44:01.856+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:44:02.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:02.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:03.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:03.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:04.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:04.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:05.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:05.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:06.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:06.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:06.857 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:44:06.857+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:44:07.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:07.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:08.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:08.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:09.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:09.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:10.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:10.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:11.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:11.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:11.857 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:44:11.858+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:44:12.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:12.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:13.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:13.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:14.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:14.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:15.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:15.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:16.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:16.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:16.858 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:44:16.859+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:44:17.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:17.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:18.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:18.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:19.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:19.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:20.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:20.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:21.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:21.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:21.859 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:44:21.859+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:44:22.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:22.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:23.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:23.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:24.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:24.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:25.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:25.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:26.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:26.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:26.859 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:44:26.860+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:44:27.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:27.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:28.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:28.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:29.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:29.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:30.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:30.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:31.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:31.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:31.860 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:44:31.861+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:44:32.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:32.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:33.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:33.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:34.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:34.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:35.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:35.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:36.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:36.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:36.861 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:44:36.861+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:44:37.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:37.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:38.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:38.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:39.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:39.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:40.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:40.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:41.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:41.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:41.862 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:44:41.863+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:44:42.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:42.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:43.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:43.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:44.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:44.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:45.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:45.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:46.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:46.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:46.863 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:44:46.864+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:44:47.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:47.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:48.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:48.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:49.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:49.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:50.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:50.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:51.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:51.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:51.865 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:44:51.865+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:44:52.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:52.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:53.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:53.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:54.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:54.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:55.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:55.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:56.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:56.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:56.866 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:44:56.867+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:44:57.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:57.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:58.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:58.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:44:59.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:44:59.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:00.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:00.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:01.868 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:45:01.868+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:45:01.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:01.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:02.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:02.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:03.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:03.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:04.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:04.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:05.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:05.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:06.868 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:45:06.869+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:45:06.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:06.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:07.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:07.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:08.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:08.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:09.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:09.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:10.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:10.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:11.869 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:45:11.870+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:45:11.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:11.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:12.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:12.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:13.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:13.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:14.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:14.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:15.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:15.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:16.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:16.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:16.871 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:45:16.871+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:45:17.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:17.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:18.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:18.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:19.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:19.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:20.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:20.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:21.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:21.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:21.872 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:45:21.872+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:45:22.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:22.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:23.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:23.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:24.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:24.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:25.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:25.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:26.873 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:45:26.873+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:45:26.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:26.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:27.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:27.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:28.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:28.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:29.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:29.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:30.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:30.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:31.874 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:45:31.874+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:45:31.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:31.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:32.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:32.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:33.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:33.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:35.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:35.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:35.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:35.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:36.875 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:45:36.875+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:45:36.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:36.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:37.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:37.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:38.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:38.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:39.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:39.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:40.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:40.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:41.875 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:45:41.877+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:45:41.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:41.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:42.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:42.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:43.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:43.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:44.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:44.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:45.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:45.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:46.876 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:45:46.878+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:45:46.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:46.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:47.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:47.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:48.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:48.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:50.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:50.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:50.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:50.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:51.877 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:45:51.879+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:45:52.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:52.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:53.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:53.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:54.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:54.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:55.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:55.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:55.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:55.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:56.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:45:56.878+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:45:57.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:57.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:58.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:58.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:45:59.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:45:59.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:00.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:00.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:01.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:01.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:01.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:46:01.880+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:46:02.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:02.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:03.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:03.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:04.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:04.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:05.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:05.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:06.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:06.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:06.880 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:46:06.881+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:46:07.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:07.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:08.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:08.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:09.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:09.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:10.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:10.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:11.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:11.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:11.881 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:46:11.882+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:46:12.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:12.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:13.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:13.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:14.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:14.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:15.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:15.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:16.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:16.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:16.882 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:46:16.882+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:46:17.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:17.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:18.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:18.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:19.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:19.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:20.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:20.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:21.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:21.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:21.883 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:46:21.883+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:46:22.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:22.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:23.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:23.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:24.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:24.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:25.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:25.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:26.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:26.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:26.884 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:46:26.884+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:46:27.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:27.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:27.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:27.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:28.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:28.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:29.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:29.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:31.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:31.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:31.885 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:46:31.885+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:46:32.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:32.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:33.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:33.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:33.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:33.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:34.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:34.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:35.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:35.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:36.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:46:36.886+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:46:36.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:36.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:37.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:37.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:38.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:38.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:39.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:39.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:40.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:40.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:41.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:46:41.887+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:46:41.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:41.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:42.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:42.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:43.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:43.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:44.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:44.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:45.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:45.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:46.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:46.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:46.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:46:46.888+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:46:47.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:47.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:48.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:48.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:49.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:49.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:50.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:50.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:51.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:51.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:51.889 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:46:51.889+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:46:52.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:52.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:53.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:53.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:54.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:54.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:55.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:55.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:56.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:56.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:56.890 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:46:56.890+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:46:57.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:57.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:58.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:58.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:46:59.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:46:59.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:00.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:00.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:01.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:01.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:01.892 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:47:01.891+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:47:02.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:02.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:03.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:03.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:04.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:04.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:05.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:05.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:06.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:06.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:06.892 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:47:06.892+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:47:07.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:07.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:08.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:08.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:09.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:09.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:10.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:10.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:11.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:11.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:11.892 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:47:11.893+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:47:12.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:12.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:13.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:13.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:14.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:14.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:15.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:15.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:16.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:16.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:16.893 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:47:16.894+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:47:17.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:17.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:18.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:18.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:19.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:19.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:20.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:20.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:21.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:21.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:21.894 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:47:21.895+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:47:22.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:22.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:23.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:23.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:24.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:24.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:25.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:25.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:26.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:26.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:26.895 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:47:26.895+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:47:27.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:27.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:28.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:28.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:29.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:29.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:30.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:30.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:31.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:31.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:31.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:47:31.897+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:47:32.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:32.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:33.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:33.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:34.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:34.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:35.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:35.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:36.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:36.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:36.898 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:47:36.898+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:47:37.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:37.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:38.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:38.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:39.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:39.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:40.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:40.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:41.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:41.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:41.899 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:47:41.899+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:47:42.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:42.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:43.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:43.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:44.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:44.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:45.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:45.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:46.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:46.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:46.900 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:47:46.900+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:47:47.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:47.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:48.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:48.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:49.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:49.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:50.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:50.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:51.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:51.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:51.901 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:47:51.902+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:47:52.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:52.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:53.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:53.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:54.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:54.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:55.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:55.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:56.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:56.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:56.902 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:47:56.902+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:47:57.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:57.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:58.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:58.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:47:59.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:47:59.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:00.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:00.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:01.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:01.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:01.902 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:48:01.903+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:48:02.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:02.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:03.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:03.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:04.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:04.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:05.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:05.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:06.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:06.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:06.904 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:48:06.904+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:48:07.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:07.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:08.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:08.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:09.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:09.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:10.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:10.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:11.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:11.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:11.904 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:48:11.905+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:48:12.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:12.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:13.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:13.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:14.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:14.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:15.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:15.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:16.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:16.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:16.905 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:48:16.906+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:48:17.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:17.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:18.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:18.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:19.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:19.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:20.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:20.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:21.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:21.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:21.906 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:48:21.907+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:48:22.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:22.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:23.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:23.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:24.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:24.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:25.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:25.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:26.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:26.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:26.907 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:48:26.908+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:48:27.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:27.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:28.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:28.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:29.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:29.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:30.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:30.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:31.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:31.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:31.908 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:48:31.909+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:48:32.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:32.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:33.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:33.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:34.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:34.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:35.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:35.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:36.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:36.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:36.910 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:48:36.911+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:48:37.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:37.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:38.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:38.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:39.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:39.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:40.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:40.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:41.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:41.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:41.911 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:48:41.912+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:48:42.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:42.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:43.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:43.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:44.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:44.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:45.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:45.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:46.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:46.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:46.911 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:48:46.912+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:48:47.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:47.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:48.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:48.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:49.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:49.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:50.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:50.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:51.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:51.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:51.912 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:48:51.914+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:48:52.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:52.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:53.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:53.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:54.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:54.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:55.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:55.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:56.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:56.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:56.913 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:48:56.914+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:48:57.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:57.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:58.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:58.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:48:59.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:48:59.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:00.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:00.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:01.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:01.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:01.914 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:49:01.914+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:49:02.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:02.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:03.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:03.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:04.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:04.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:05.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:05.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:06.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:06.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:06.915 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:49:06.915+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:49:07.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:07.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:08.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:08.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:09.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:09.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:10.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:10.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:11.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:11.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:11.915 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:49:11.916+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:49:12.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:12.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:13.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:13.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:14.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:14.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:15.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:15.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:16.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:16.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:16.916 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:49:16.917+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:49:17.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:17.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:18.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:18.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:19.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:19.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:20.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:20.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:21.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:21.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:21.918 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:49:21.918+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:49:22.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:22.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:23.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:23.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:24.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:24.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:25.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:25.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:26.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:26.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:26.919 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:49:26.919+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:49:27.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:27.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:28.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:28.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:29.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:29.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:30.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:30.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:31.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:31.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:31.920 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:49:31.921+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:49:32.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:32.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:33.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:33.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:34.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:34.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:35.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:35.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:36.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:36.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:36.921 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:49:36.922+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:49:37.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:37.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:38.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:38.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:39.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:39.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:40.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:40.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:41.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:41.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:41.922 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:49:41.922+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:49:42.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:42.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:43.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:43.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:44.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:44.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:45.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:45.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:46.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:46.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:46.922 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:49:46.923+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:49:47.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:47.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:48.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:48.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:49.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:49.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:50.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:50.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:51.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:51.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:51.923 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:49:51.924+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:49:52.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:52.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:53.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:53.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:54.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:54.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:55.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:55.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:56.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:56.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:56.924 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:49:56.925+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:49:57.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:57.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:58.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:58.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:49:59.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:49:59.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:00.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:00.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:01.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:01.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:01.925 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:50:01.926+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:50:02.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:02.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:03.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:03.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:04.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:04.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:05.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:05.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:06.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:06.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:06.926 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:50:06.927+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:50:07.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:07.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:08.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:08.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:09.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:09.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:10.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:10.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:11.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:11.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:11.927 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:50:11.928+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:50:12.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:12.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:13.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:13.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:14.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:14.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:15.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:15.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:16.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:16.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:16.928 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:50:16.929+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:50:17.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:17.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:18.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:18.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:19.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:19.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:20.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:20.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:21.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:21.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:21.929 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:50:21.930+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:50:22.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:22.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:23.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:23.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:24.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:24.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:25.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:25.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:26.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:26.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:26.930 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:50:26.931+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:50:27.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:27.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:28.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:28.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:29.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:29.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:30.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:30.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:31.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:31.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:31.932 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:50:31.932+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:50:32.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:32.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:33.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:33.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:34.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:34.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:35.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:35.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:36.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:36.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:36.932 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:50:36.933+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:50:37.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:37.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:38.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:38.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:39.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:39.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:40.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:40.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:41.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:41.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:41.933 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:50:41.934+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:50:42.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:42.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:43.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:43.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:44.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:44.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:45.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:45.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:46.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:46.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:46.935 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:50:46.935+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:50:47.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:47.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:48.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:48.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:49.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:49.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:50.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:50.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:51.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:51.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:51.936 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:50:51.936+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:50:52.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:52.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:53.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:53.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:54.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:54.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:55.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:55.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:56.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:56.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:56.937 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:50:56.937+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:50:57.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:57.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:58.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:58.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:50:59.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:50:59.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:00.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:00.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:01.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:01.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:01.937 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:51:01.938+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:51:02.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:02.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:03.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:03.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:04.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:04.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:05.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:05.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:06.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:06.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:06.938 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:51:06.939+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:51:07.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:07.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:08.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:08.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:09.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:09.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:10.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:10.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:11.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:11.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:11.940 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:51:11.940+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:51:12.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:12.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:13.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:13.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:14.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:14.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:15.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:15.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:16.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:16.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:16.941 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:51:16.942+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:51:17.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:17.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:18.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:18.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:19.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:19.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:20.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:20.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:21.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:21.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:21.942 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:51:21.942+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:51:22.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:22.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:23.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:23.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:24.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:24.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:25.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:25.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:26.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:26.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:26.943 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:51:26.943+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:51:27.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:27.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:28.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:28.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:29.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:29.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:30.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:30.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:31.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:31.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:31.944 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:51:31.944+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:51:32.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:32.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:33.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:33.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:34.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:34.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:35.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:35.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:36.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:36.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:36.945 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:51:36.945+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:51:37.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:37.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:38.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:38.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:39.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:39.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:40.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:40.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:41.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:41.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:41.945 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:51:41.946+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:51:42.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:42.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:43.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:43.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:44.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:44.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:45.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:45.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:46.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:46.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:46.946 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:51:46.947+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:51:47.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:47.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:48.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:48.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:49.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:49.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:50.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:50.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:51.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:51.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:51.947 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:51:51.947+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:51:52.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:52.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:53.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:53.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:54.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:54.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:55.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:55.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:56.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:56.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:56.947 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:51:56.948+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:51:57.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:57.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:58.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:58.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:51:59.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:51:59.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:00.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:00.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:01.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:01.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:01.948 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:52:01.950+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:52:02.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:02.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:03.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:03.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:04.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:04.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:05.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:05.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:06.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:06.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:06.950 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:52:06.951+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:52:07.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:07.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:08.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:08.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:09.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:09.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:10.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:10.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:11.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:11.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:11.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:52:11.951+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:52:12.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:12.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:13.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:13.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:14.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:14.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:15.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:15.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:16.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:16.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:16.952 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:52:16.953+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:52:17.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:17.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:18.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:18.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:19.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:19.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:20.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:20.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:21.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:21.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:21.953 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:52:21.954+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:52:22.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:22.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:23.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:23.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:24.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:24.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:25.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:25.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:26.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:26.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:26.954 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:52:26.954+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:52:27.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:27.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:28.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:28.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:29.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:29.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:30.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:30.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:31.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:31.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:31.955 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:52:31.956+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:52:32.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:32.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:33.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:33.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:34.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:34.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:35.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:35.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:36.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:36.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:36.956 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:52:36.956+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:52:37.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:37.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:38.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:38.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:39.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:39.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:40.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:40.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:41.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:41.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:41.956 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:52:41.957+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:52:42.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:42.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:43.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:43.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:44.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:44.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:45.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:45.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:46.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:46.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:46.958 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:52:46.958+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:52:47.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:47.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:48.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:48.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:49.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:49.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:50.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:50.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:51.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:51.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:51.959 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:52:51.959+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:52:52.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:52.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:53.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:53.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:54.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:54.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:55.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:55.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:56.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:56.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:56.960 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:52:56.960+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:52:57.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:57.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:58.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:58.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:52:59.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:52:59.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:00.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:00.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:01.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:01.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:02.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:02.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:03.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:03.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:04.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:04.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:05.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:05.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:06.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:06.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:06.962 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:53:06.963+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:53:07.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:07.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:08.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:08.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:09.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:09.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:10.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:10.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:11.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:11.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:12.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:12.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:13.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:13.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:14.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:14.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:15.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:15.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:16.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:16.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:16.964 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:53:16.965+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:53:17.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:17.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:18.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:18.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:19.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:19.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:20.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:20.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:21.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:21.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:21.965 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:53:21.966+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:53:22.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:22.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:23.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:23.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:24.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:24.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:25.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:25.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:26.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:26.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:26.966 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:53:26.967+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:53:27.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:27.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:28.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:28.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:29.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:29.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:30.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:30.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:31.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:31.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:31.967 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:53:31.967+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:53:32.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:32.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:33.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:33.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:34.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:34.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:35.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:35.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:36.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:36.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:36.968 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:53:36.968+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:53:37.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:37.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:38.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:38.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:39.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:39.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:40.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:40.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:41.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:41.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:41.969 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:53:41.969+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:53:42.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:42.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:43.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:43.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:44.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:44.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:45.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:45.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:46.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:46.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:46.970 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:53:46.970+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:53:47.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:47.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:48.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:48.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:49.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:49.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:50.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:50.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:51.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:51.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:51.971 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:53:51.972+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:53:52.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:52.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:53.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:53.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:54.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:54.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:55.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:55.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:56.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:56.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:56.972 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:53:56.972+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:53:57.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:57.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:58.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:58.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:53:59.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:53:59.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:00.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:00.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:01.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:01.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:01.973 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:54:01.973+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:54:02.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:02.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:03.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:03.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:04.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:04.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:05.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:05.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:06.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:06.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:06.974 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:54:06.974+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:54:07.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:07.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:08.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:08.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:09.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:09.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:10.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:10.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:11.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:11.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:11.975 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:54:11.975+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:54:12.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:12.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:13.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:13.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:14.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:14.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:15.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:15.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:16.987 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:54:16.977+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:54:17.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:17.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:18.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:18.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:19.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:19.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:20.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:20.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:21.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:21.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:21.977 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:54:21.977+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:54:22.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:22.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:23.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:23.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:24.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:24.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:25.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:25.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:26.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:26.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:26.977 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:54:26.978+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:54:27.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:27.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:27.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:27.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:28.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:28.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:29.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:29.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:30.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:30.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:31.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:31.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:31.979 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:54:31.979+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:54:32.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:32.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:33.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:33.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:34.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:34.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:35.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:35.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:36.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:36.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:36.980 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:54:36.981+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:54:37.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:37.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:38.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:38.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:39.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:39.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:40.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:40.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:41.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:41.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:41.981 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:54:41.982+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:54:42.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:42.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:43.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:43.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:44.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:44.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:45.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:45.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:46.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:46.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:46.982 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:54:46.982+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:54:47.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:47.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:48.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:48.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:49.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:49.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:50.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:50.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:51.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:51.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:51.982 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:54:51.983+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:54:52.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:52.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:53.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:53.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:54.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:54.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:55.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:55.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:56.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:56.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:56.984 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:54:56.984+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:54:57.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:57.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:58.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:58.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:54:59.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:54:59.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:00.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:00.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:01.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:01.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:01.985 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:55:01.986+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:55:02.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:02.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:03.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:03.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:04.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:04.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:05.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:05.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:06.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:06.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:06.986 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:55:06.988+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:55:07.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:07.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:08.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:08.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:09.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:09.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:10.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:10.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:11.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:11.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:11.986 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:55:11.988+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:55:12.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:12.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:13.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:13.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:14.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:14.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:15.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:15.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:16.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:16.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:16.987 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:55:16.988+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:55:17.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:17.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:18.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:18.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:19.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:19.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:20.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:20.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:21.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:21.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:21.988 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:55:21.989+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:55:22.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:22.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:23.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:23.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:24.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:24.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:25.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:25.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:26.989 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:55:26.990+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:55:27.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:27.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:28.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:28.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:28.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:28.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:29.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:29.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:30.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:30.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:31.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:31.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:31.990 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:55:31.991+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:55:33.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:33.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:34.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:34.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:35.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:35.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:36.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:36.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:36.991 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:55:36.991+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:55:37.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:37.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:38.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:38.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:39.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:39.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:40.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:40.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:41.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:41.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:41.991 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:55:41.992+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:55:42.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:42.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:43.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:43.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:44.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:44.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:45.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:45.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:46.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:46.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:46.993 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:55:46.993+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:55:47.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:47.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:48.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:48.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:49.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:49.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:50.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:50.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:50.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:50.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:51.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:51.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:51.994 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:55:51.995+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:55:52.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:52.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:53.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:53.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:54.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:54.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:55.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:55.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:56.995 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:55:56.996+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:55:57.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:57.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:58.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:58.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:55:59.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:55:59.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:00.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:00.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:00.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:00.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:01.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:01.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:01.996 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:56:01.997+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:56:03.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:03.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:04.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:04.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:05.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:05.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:06.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:06.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:06.997 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:56:06.998+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:56:07.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:07.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:08.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:08.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:09.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:09.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:10.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:10.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:11.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:11.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:11.998 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:56:11.999+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:56:12.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:12.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:12.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:12.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:14.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:14.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:14.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:14.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:16.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:16.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:16.999 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:56:17.000+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:56:17.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:17.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:17.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:17.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:19.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:19.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:20.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:20.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:20.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:20.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:22.000 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:56:22.001+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:56:22.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:22.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:23.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:23.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:24.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:24.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:25.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:25.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:26.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:26.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:27.001 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:56:27.001+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:56:27.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:27.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:28.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:28.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:29.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:29.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:30.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:30.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:31.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:31.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:32.002 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:56:32.002+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:56:32.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:32.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:33.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:33.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:34.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:34.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:35.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:35.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:36.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:36.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:37.003 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:56:37.004+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:56:37.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:37.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:38.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:38.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:39.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:39.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:40.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:40.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:41.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:41.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:42.004 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:56:42.005+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:56:42.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:42.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:43.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:43.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:44.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:44.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:45.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:45.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:46.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:46.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:47.004 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:56:47.005+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:56:47.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:47.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:48.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:48.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:49.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:49.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:50.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:50.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:51.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:51.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:52.006 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:56:52.006+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:56:52.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:52.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:53.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:53.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:54.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:54.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:55.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:55.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:56.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:56.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:57.007 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:56:57.007+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:56:57.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:57.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:58.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:58.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:56:59.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:56:59.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:00.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:00.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:01.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:01.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:02.007 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:57:02.008+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:57:02.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:02.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:03.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:03.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:04.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:04.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:05.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:05.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:06.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:06.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:07.008 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:57:07.009+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:57:07.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:07.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:08.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:08.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:09.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:09.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:10.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:10.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:11.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:11.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:12.009 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:57:12.010+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:57:12.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:12.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:13.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:13.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:14.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:14.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:15.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:15.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:16.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:16.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:17.010 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:57:17.011+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:57:17.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:17.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:18.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:18.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:19.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:19.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:20.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:20.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:21.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:21.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:22.011 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:57:22.012+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:57:22.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:22.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:23.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:23.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:24.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:24.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:25.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:25.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:26.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:26.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:27.013 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:57:27.013+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:57:27.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:27.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:28.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:28.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:29.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:29.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:30.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:30.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:31.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:31.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:32.013 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:57:32.014+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:57:32.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:32.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:33.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:33.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:34.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:34.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:35.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:35.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:36.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:36.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:37.014 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:57:37.015+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:57:37.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:37.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:38.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:38.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:39.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:39.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:40.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:40.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:41.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:41.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:42.015 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:57:42.015+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:57:42.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:42.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:43.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:43.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:44.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:44.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:45.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:45.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:46.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:46.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:47.015 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:57:47.016+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:57:47.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:47.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:48.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:48.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:49.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:49.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:50.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:50.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:51.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:51.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:52.016 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:57:52.017+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:57:52.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:52.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:53.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:53.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:54.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:54.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:55.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:55.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:56.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:56.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:57.017 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:57:57.018+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:57:57.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:57.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:58.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:58.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:57:59.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:57:59.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:00.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:00.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:01.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:01.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:02.018 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:58:02.018+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:58:02.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:02.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:03.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:03.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:04.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:04.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:05.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:05.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:06.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:06.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:07.018 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:58:07.019+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:58:07.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:07.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:08.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:08.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:09.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:09.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:10.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:10.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:11.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:11.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:12.019 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:58:12.020+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:58:12.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:12.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:13.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:13.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:14.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:14.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:15.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:15.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:16.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:16.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:17.020 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:58:17.022+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:58:17.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:17.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:18.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:18.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:19.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:19.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:20.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:20.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:21.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:21.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:22.022 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:58:22.023+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:58:22.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:22.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:23.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:23.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:24.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:24.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:25.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:25.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:26.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:26.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:27.023 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:58:27.024+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:58:27.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:27.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:28.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:28.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:29.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:29.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:30.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:30.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:31.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:31.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:32.024 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:58:32.025+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:58:32.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:32.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:33.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:33.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:34.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:34.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:35.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:35.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:36.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:36.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:37.025 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:58:37.026+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:58:37.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:37.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:38.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:38.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:39.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:39.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:40.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:40.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:41.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:41.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:42.026 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:58:42.027+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:58:42.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:42.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:43.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:43.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:44.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:44.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:45.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:45.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:46.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:46.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:47.027 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:58:47.028+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:58:47.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:47.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:48.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:48.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:49.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:49.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:50.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:50.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:51.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:51.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:52.029 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:58:52.029+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:58:52.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:52.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:53.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:53.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:54.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:54.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:55.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:55.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:56.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:56.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:57.030 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:58:57.030+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:58:57.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:57.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:58.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:58.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:58:59.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:58:59.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:00.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:00.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:01.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:01.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:02.030 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:59:02.031+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:59:02.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:02.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:03.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:03.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:04.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:04.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:05.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:05.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:06.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:06.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:07.031 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:59:07.032+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:59:07.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:07.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:08.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:08.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:09.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:09.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:10.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:10.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:11.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:11.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:12.033 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:59:12.033+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:59:12.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:12.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:13.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:13.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:14.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:14.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:15.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:15.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:16.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:16.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:17.035 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:59:17.034+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:59:17.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:17.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:18.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:18.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:19.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:19.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:20.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:20.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:21.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:21.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:22.035 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:59:22.035+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:59:22.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:22.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:23.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:23.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:24.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:24.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:25.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:25.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:26.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:26.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:27.036 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:59:27.036+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:59:27.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:27.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:28.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:28.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:29.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:29.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:30.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:30.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:31.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:31.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:32.037 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:59:32.038+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:59:32.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:32.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:33.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:33.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:34.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:34.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:35.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:35.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:36.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:36.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:37.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:37.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:37.037 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:59:37.038+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:59:37.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:37.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:39.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:39.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:39.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:39.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:40.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:40.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:41.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:41.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:42.039 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:59:42.039+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:59:42.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:42.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:43.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:43.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:44.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:44.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:45.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:45.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:46.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:46.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:47.040 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:59:47.040+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:59:47.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:47.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:48.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:48.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:49.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:49.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:50.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:50.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:51.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:51.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:52.041 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:59:52.042+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:59:52.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:52.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:53.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:53.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:54.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:54.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:55.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:55.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:56.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:56.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:57.042 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T05:59:57.042+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T05:59:57.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:57.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:58.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:58.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T05:59:59.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T05:59:59.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:00.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:00.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:01.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:01.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:02.043 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:00:02.044+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:00:02.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:02.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:03.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:03.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:04.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:04.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:05.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:05.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:06.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:06.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:07.044 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:00:07.044+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:00:07.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:07.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:08.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:08.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:09.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:09.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:10.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:10.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:11.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:11.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:12.044 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:00:12.045+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:00:12.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:12.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:13.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:13.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:14.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:14.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:15.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:15.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:16.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:16.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:17.045 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:00:17.046+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:00:17.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:17.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:18.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:18.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:19.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:19.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:20.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:20.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:21.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:21.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:22.046 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:00:22.047+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:00:22.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:22.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:23.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:23.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:24.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:24.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:25.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:25.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:26.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:26.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:27.047 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:00:27.048+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:00:27.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:27.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:28.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:28.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:29.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:29.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:30.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:30.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:31.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:31.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:32.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:00:32.049+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:00:32.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:32.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:34.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:34.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:34.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:34.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:35.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:35.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:36.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:36.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:37.050 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:00:37.050+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:00:38.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:38.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:39.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:39.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:40.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:40.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:41.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:41.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:42.050 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:00:42.051+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:00:42.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:42.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:43.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:43.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:44.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:44.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:45.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:45.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:46.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:46.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:47.052 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:00:47.052+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:00:47.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:47.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:48.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:48.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:49.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:49.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:50.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:50.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:51.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:51.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:52.053 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:00:52.053+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:00:52.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:52.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:53.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:53.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:54.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:54.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:55.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:55.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:56.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:56.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:57.053 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:00:57.054+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:00:57.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:57.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:58.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:58.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:00:59.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:00:59.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:00.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:00.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:01.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:01.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:02.054 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:01:02.055+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:01:02.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:02.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:03.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:03.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:04.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:04.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:05.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:05.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:06.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:06.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:07.056 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:01:07.057+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:01:07.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:07.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:08.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:08.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:09.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:09.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:10.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:10.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:11.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:11.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:12.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:12.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:12.056 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:01:12.057+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:01:12.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:12.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:13.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:13.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:14.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:14.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:15.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:15.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:16.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:16.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:17.058 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:01:17.058+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:01:17.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:17.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:18.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:18.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:19.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:19.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:20.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:20.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:21.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:21.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:22.058 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:01:22.060+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:01:22.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:22.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:23.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:23.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:24.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:24.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:25.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:25.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:26.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:27.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:27.059 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:01:27.061+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:01:28.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:28.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:29.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:29.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:29.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:30.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:31.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:31.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:32.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:32.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:32.059 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:01:32.060+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:01:33.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:33.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:34.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:34.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:35.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:35.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:36.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:36.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:36.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:36.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:37.060 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:01:37.061+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:01:37.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:37.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:38.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:38.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:40.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:40.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:41.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:41.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:42.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:42.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:42.061 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:01:42.062+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:01:43.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:43.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:44.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:44.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:45.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:45.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:46.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:46.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:47.062 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:01:47.063+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:01:47.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:47.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:48.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:48.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:49.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:49.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:50.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:50.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:51.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:51.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:52.063 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:01:52.064+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:01:52.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:52.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:53.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:53.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:54.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:54.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:55.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:55.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:56.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:56.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:57.065 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:01:57.065+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:01:57.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:57.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:58.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:58.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:01:59.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:01:59.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:00.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:00.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:01.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:01.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:02.065 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:02:02.066+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:02:02.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:02.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:03.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:03.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:04.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:04.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:05.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:05.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:06.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:06.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:07.067 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:02:07.067+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:02:07.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:07.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:08.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:08.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:09.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:09.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:10.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:10.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:11.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:11.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:12.067 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:02:12.068+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:02:12.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:12.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:13.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:13.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:14.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:14.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:15.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:15.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:16.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:16.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:17.069 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:02:17.069+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:02:17.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:17.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:18.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:18.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:19.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:19.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:20.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:20.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:21.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:21.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:22.069 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:02:22.070+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:02:22.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:22.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:23.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:23.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:24.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:24.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:25.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:25.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:26.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:26.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:27.070 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:02:27.071+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:02:27.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:27.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:28.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:28.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:29.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:29.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:30.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:30.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:31.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:31.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:32.071 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:02:32.072+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:02:32.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:32.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:33.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:33.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:34.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:34.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:35.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:35.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:36.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:36.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:37.072 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:02:37.073+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:02:37.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:37.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:38.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:38.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:39.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:39.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:40.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:40.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:41.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:41.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:42.073 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:02:42.074+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:02:42.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:42.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:43.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:43.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:44.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:44.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:45.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:45.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:46.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:46.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:47.074 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:02:47.075+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:02:47.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:47.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:48.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:48.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:49.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:49.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:50.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:50.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:51.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:51.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:52.078 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:02:52.076+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:02:52.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:52.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:53.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:53.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:54.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:54.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:55.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:55.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:56.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:56.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:57.077 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:02:57.077+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:02:57.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:57.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:58.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:58.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:02:59.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:02:59.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:00.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:00.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:01.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:01.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:02.077 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:03:02.078+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:03:02.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:02.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:03.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:03.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:04.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:04.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:05.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:05.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:06.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:06.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:07.079 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:03:07.079+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:03:07.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:07.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:08.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:08.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:09.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:09.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:10.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:10.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:11.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:11.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:12.079 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:03:12.080+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:03:12.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:12.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:13.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:13.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:14.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:14.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:15.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:15.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:16.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:16.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:17.081 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:03:17.081+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:03:17.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:17.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:18.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:18.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:19.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:19.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:20.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:20.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:21.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:21.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:22.081 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:03:22.082+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:03:22.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:22.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:23.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:23.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:24.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:24.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:25.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:25.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:26.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:26.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:27.082 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:03:27.083+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:03:27.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:27.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:28.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:28.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:29.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:29.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:30.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:30.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:31.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:31.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:32.083 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:03:32.084+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:03:32.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:32.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:33.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:33.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:34.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:34.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:35.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:35.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:36.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:36.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:37.084 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:03:37.085+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:03:37.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:37.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:38.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:38.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:39.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:39.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:40.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:40.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:41.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:41.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:42.085 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:03:42.086+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:03:42.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:42.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:43.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:43.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:44.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:44.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:45.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:45.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:46.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:46.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:47.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:47.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:48.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:48.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:49.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:49.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:50.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:50.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:51.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:51.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:52.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:03:52.089+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:03:52.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:52.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:53.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:53.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:54.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:54.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:55.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:55.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:56.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:56.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:57.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:03:57.089+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:03:57.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:57.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:58.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:58.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:03:59.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:03:59.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:00.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:00.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:01.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:01.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:02.090 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:04:02.090+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:04:02.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:02.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:03.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:03.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:04.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:04.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:05.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:05.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:06.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:06.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:07.091 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:04:07.091+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:04:07.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:07.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:08.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:08.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:09.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:09.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:10.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:10.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:11.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:11.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:12.092 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:04:12.092+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:04:12.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:12.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:13.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:13.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:14.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:14.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:15.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:15.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:16.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:16.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:17.092 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:04:17.093+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:04:17.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:17.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:19.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:19.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:20.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:20.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:21.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:21.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:22.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:22.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:22.093 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:04:22.094+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:04:23.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:23.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:24.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:24.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:25.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:25.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:25.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:25.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:27.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:27.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:27.094 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:04:27.096+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:04:27.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:27.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:28.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:28.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:29.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:29.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:30.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:30.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:31.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:31.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:32.095 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:04:32.097+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:04:32.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:32.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:34.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:34.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:35.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:35.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:36.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:36.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:37.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:37.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:37.095 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:04:37.096+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:04:38.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:38.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:39.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:39.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:40.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:40.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:41.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:41.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:42.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:42.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:42.096 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:04:42.097+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:04:43.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:43.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:43.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:43.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:44.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:44.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:45.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:45.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:46.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:46.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:47.097 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:04:47.098+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:04:47.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:47.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:48.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:48.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:49.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:49.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:50.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:50.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:51.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:51.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:52.099 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:04:52.099+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:04:52.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:52.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:53.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:53.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:54.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:54.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:55.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:55.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:56.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:56.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:57.099 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:04:57.100+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:04:58.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:58.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:04:59.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:04:59.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:00.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:00.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:00.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:00.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:01.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:01.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:02.100 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:05:02.101+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:05:02.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:02.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:03.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:03.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:04.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:04.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:05.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:05.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:06.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:06.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:07.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:05:07.103+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:05:07.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:07.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:08.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:08.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:09.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:09.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:10.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:10.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:11.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:11.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:12.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:05:12.104+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:05:12.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:12.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:13.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:13.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:14.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:14.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:15.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:15.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:16.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:16.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:17.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:05:17.104+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:05:17.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:17.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:18.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:18.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:19.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:19.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:20.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:20.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:21.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:21.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:22.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:05:22.105+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:05:22.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:22.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:23.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:23.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:24.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:24.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:25.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:25.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:26.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:26.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:27.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:05:27.106+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:05:27.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:27.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:28.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:28.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:29.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:29.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:30.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:30.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:31.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:31.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:32.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:32.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:33.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:33.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:34.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:34.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:35.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:35.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:36.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:36.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:37.107 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:05:37.108+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:05:37.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:37.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:38.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:38.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:39.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:39.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:40.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:40.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:41.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:41.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:42.109 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:05:42.110+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:05:42.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:42.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:43.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:43.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:44.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:44.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:45.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:45.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:46.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:46.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:47.110 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:05:47.110+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:05:47.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:47.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:48.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:48.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:49.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:49.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:50.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:50.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:51.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:51.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:52.111 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:05:52.111+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:05:52.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:52.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:53.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:53.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:54.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:54.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:55.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:55.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:56.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:56.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:57.112 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:05:57.112+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:05:57.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:57.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:58.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:58.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:05:59.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:05:59.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:00.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:00.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:01.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:01.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:02.113 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:06:02.114+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:06:02.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:02.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:03.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:03.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:04.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:04.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:05.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:05.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:06.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:06.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:07.113 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:06:07.114+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:06:07.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:07.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:08.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:08.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:09.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:09.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:10.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:10.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:11.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:11.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:12.115 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:06:12.115+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:06:12.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:12.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:13.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:13.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:14.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:14.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:15.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:15.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:16.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:16.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:17.116 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:06:17.116+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:06:17.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:17.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:18.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:18.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:19.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:19.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:20.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:20.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:21.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:21.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:22.117 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:06:22.117+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:06:22.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:22.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:23.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:23.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:24.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:24.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:25.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:25.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:26.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:26.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:27.118 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:06:27.119+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:06:27.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:27.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:28.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:28.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:29.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:29.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:30.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:30.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:31.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:31.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:32.119 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:06:32.120+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:06:32.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:32.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:33.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:33.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:34.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:34.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:35.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:35.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:36.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:36.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:37.120 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:06:37.120+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:06:37.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:37.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:38.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:38.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:39.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:39.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:40.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:40.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:41.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:41.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:42.121 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:06:42.121+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:06:42.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:42.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:43.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:43.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:44.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:44.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:45.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:45.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:46.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:46.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:47.122 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:06:47.122+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:06:47.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:47.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:48.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:48.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:49.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:49.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:50.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:50.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:51.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:51.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:52.123 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:06:52.123+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:06:52.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:52.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:53.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:53.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:54.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:54.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:55.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:55.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:56.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:56.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:57.124 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:06:57.124+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:06:57.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:57.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:58.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:58.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:06:59.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:06:59.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:00.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:00.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:01.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:01.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:02.124 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:07:02.125+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:07:02.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:02.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:03.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:03.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:04.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:04.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:05.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:05.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:06.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:06.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:07.125 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:07:07.126+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:07:07.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:07.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:08.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:08.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:09.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:09.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:10.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:10.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:11.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:11.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:12.127 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:07:12.127+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:07:12.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:12.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:13.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:13.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:14.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:14.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:15.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:15.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:16.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:16.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:17.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:17.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:18.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:18.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:19.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:19.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:20.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:20.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:21.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:21.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:22.129 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:07:22.130+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:07:22.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:22.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:23.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:23.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:24.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:24.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:25.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:25.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:26.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:26.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:27.130 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:07:27.131+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:07:27.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:27.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:28.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:28.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:29.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:29.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:30.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:30.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:31.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:31.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:32.131 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:07:32.132+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:07:32.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:32.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:33.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:33.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:34.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:34.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:35.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:35.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:36.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:36.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:37.132 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:07:37.133+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:07:37.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:37.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:38.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:38.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:39.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:39.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:40.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:40.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:41.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:41.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:42.133 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:07:42.134+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:07:42.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:42.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:43.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:43.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:44.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:44.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:45.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:45.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:46.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:46.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:47.134 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:07:47.134+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:07:47.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:47.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:48.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:48.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:49.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:49.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:50.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:50.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:51.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:51.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:52.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:07:52.136+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:07:52.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:52.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:53.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:53.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:54.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:54.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:55.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:55.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:56.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:56.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:57.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:07:57.136+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:07:57.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:57.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:58.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:58.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:07:59.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:07:59.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:00.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:00.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:01.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:01.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:02.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:08:02.138+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:08:02.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:02.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:03.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:03.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:04.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:04.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:05.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:05.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:06.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:06.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:07.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:08:07.138+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:08:07.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:07.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:08.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:08.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:09.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:09.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:10.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:10.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:11.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:11.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:12.138 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:08:12.139+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:08:12.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:12.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:13.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:13.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:14.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:14.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:15.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:15.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:16.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:16.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:17.139 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:08:17.140+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:08:17.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:17.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:18.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:18.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:19.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:19.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:20.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:20.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:21.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:21.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:22.140 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:08:22.141+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:08:22.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:22.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:23.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:23.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:24.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:24.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:25.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:25.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:26.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:26.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:27.141 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:08:27.142+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:08:27.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:27.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:28.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:28.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:29.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:29.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:30.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:30.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:31.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:31.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:32.143 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:08:32.143+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:08:32.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:32.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:33.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:33.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:34.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:34.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:35.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:35.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:36.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:36.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:37.144 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:08:37.145+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:08:37.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:37.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:38.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:38.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:39.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:39.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:40.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:40.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:41.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:41.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:42.145 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:08:42.146+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:08:42.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:42.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:43.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:43.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:44.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:44.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:45.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:45.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:46.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:46.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:47.146 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:08:47.147+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:08:47.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:47.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:48.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:48.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:49.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:49.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:50.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:50.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:51.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:51.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:52.147 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:08:52.148+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:08:52.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:52.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:53.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:53.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:54.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:54.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:55.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:55.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:56.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:56.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:57.148 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:08:57.148+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:08:57.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:57.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:58.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:58.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:08:59.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:08:59.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:00.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:00.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:01.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:01.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:02.149 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:09:02.149+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:09:02.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:02.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:03.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:03.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:04.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:04.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:05.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:05.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:06.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:06.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:07.149 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:09:07.150+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:09:07.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:07.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:08.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:08.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:09.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:09.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:10.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:10.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:11.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:11.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:12.151 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:09:12.152+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:09:12.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:12.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:13.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:13.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:14.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:14.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:15.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:15.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:16.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:16.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:17.152 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:09:17.153+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:09:17.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:17.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:18.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:18.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:19.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:19.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:20.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:20.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:21.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:21.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:22.153 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:09:22.154+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:09:22.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:22.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:23.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:23.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:24.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:24.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:25.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:25.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:26.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:26.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:27.154 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:09:27.154+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:09:27.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:27.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:28.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:28.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:29.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:29.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:30.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:30.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:31.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:31.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:32.154 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:09:32.155+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:09:32.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:32.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:33.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:33.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:34.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:34.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:35.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:35.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:36.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:36.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:37.156 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:09:37.157+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:09:37.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:37.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:38.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:38.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:39.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:39.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:40.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:40.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:41.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:41.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:42.156 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:09:42.157+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:09:42.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:42.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:43.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:43.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:44.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:44.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:45.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:45.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:46.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:46.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:47.158 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:09:47.159+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:09:47.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:47.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:48.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:48.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:49.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:49.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:50.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:50.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:51.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:51.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:52.159 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:09:52.160+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:09:52.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:52.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:53.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:53.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:54.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:54.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:55.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:55.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:56.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:56.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:57.160 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:09:57.161+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:09:57.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:57.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:09:58.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:09:58.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:00.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:00.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:01.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:01.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:02.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:02.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:02.161 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:10:02.162+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:10:03.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:03.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:04.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:04.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:05.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:05.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:06.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:06.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:07.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:07.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:07.161 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:10:07.162+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:10:08.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:08.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:09.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:09.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:10.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:10.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:11.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:11.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:12.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:12.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:12.162 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:10:12.163+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:10:13.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:13.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:14.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:14.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:15.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:15.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:16.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:16.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:17.163 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:10:17.165+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:10:17.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:17.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:18.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:18.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:19.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:19.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:20.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:20.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:21.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:21.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:22.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:22.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:22.164 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:10:22.165+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:10:23.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:23.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:24.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:24.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:25.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:25.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:26.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:26.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:27.165 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:10:27.166+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:10:27.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:27.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:28.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:28.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:29.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:29.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:30.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:30.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:31.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:31.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:32.166 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:10:32.167+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:10:32.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:32.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:33.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:33.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:34.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:34.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:35.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:35.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:36.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:36.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:37.167 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:10:37.168+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:10:37.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:37.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:38.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:38.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:39.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:39.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:40.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:40.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:41.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:41.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:42.168 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:10:42.170+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:10:42.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:42.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:43.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:43.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:44.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:44.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:45.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:45.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:46.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:46.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:47.169 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:10:47.171+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:10:47.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:47.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:48.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:48.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:49.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:49.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:50.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:50.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:51.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:51.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:52.170 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:10:52.170+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:10:52.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:52.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:53.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:53.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:54.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:54.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:55.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:55.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:56.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:56.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:57.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:57.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:57.170 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:10:57.171+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:10:58.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:58.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:10:59.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:10:59.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:00.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:00.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:01.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:01.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:02.172 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:11:02.172+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:11:02.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:02.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:03.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:03.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:04.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:04.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:05.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:05.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:06.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:06.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:07.172 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:11:07.173+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:11:07.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:07.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:08.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:08.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:09.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:09.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:10.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:10.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:11.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:11.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:12.174 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:11:12.175+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:11:12.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:12.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:13.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:13.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:14.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:14.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:15.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:15.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:16.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:16.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:17.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:17.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:17.175 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:11:17.175+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:11:18.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:18.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:19.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:19.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:20.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:20.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:21.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:21.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:22.176 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:11:22.176+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:11:22.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:22.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:23.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:23.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:24.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:24.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:25.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:25.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:26.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:26.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:27.177 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:11:27.178+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:11:27.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:27.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:28.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:28.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:29.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:29.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:30.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:30.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:31.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:31.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:32.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:32.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:32.178 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:11:32.179+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:11:33.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:33.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:34.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:34.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:35.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:35.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:36.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:36.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:37.179 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:11:37.180+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:11:37.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:37.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:38.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:38.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:39.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:39.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:40.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:40.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:41.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:41.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:42.179 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:11:42.180+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:11:42.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:42.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:43.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:43.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:44.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:44.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:45.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:45.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:46.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:46.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:47.181 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:11:47.182+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:11:47.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:47.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:48.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:48.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:49.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:49.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:50.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:50.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:51.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:51.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:52.181 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:11:52.182+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:11:52.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:52.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:53.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:53.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:54.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:54.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:55.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:55.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:56.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:56.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:57.183 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:11:57.183+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:11:57.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:57.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:58.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:58.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:11:59.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:11:59.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:00.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:00.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:01.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:01.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:02.184 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:12:02.184+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:12:02.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:02.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:03.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:03.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:04.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:04.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:05.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:05.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:06.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:06.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:07.184 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:12:07.185+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:12:07.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:07.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:08.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:08.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:09.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:09.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:10.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:10.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:11.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:11.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:12.186 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:12:12.186+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:12:12.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:12.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:13.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:13.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:14.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:14.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:15.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:15.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:16.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:16.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:17.187 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:12:17.188+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:12:17.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:17.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:18.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:18.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:19.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:19.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:20.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:20.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:21.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:21.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:22.188 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:12:22.189+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:12:22.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:22.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:23.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:23.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:24.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:24.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:25.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:25.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:26.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:26.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:27.189 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:12:27.189+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:12:27.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:27.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:28.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:28.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:29.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:29.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:30.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:30.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:31.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:31.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:32.189 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:12:32.190+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:12:32.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:32.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:33.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:33.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:34.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:34.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:35.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:35.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:36.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:36.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:37.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:12:37.191+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:12:37.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:37.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:38.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:38.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:39.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:39.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:40.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:40.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:41.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:41.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:42.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:12:42.192+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:12:42.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:42.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:43.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:43.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:44.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:44.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:45.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:45.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:46.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:46.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:47.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:12:47.194+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:12:47.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:47.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:48.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:48.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:49.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:49.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:50.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:50.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:51.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:51.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:52.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:12:52.194+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:12:52.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:52.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:53.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:53.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:54.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:54.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:55.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:55.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:56.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:56.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:57.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:12:57.195+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:12:57.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:57.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:58.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:58.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:12:59.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:12:59.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:00.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:00.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:01.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:01.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:02.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:13:02.196+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:13:02.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:02.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:03.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:03.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:04.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:04.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:05.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:05.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:06.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:06.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:07.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:13:07.197+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:13:07.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:07.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:08.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:08.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:09.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:09.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:10.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:10.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:11.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:11.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:12.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:13:12.198+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:13:12.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:12.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:13.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:13.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:14.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:14.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:15.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:15.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:16.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:16.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:17.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:13:17.199+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:13:17.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:17.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:18.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:18.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:19.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:19.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:20.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:20.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:21.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:21.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:22.199 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:13:22.201+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:13:22.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:22.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:23.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:23.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:24.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:24.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:25.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:25.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:26.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:26.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:27.200 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:13:27.201+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:13:27.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:27.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:28.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:28.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:29.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:29.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:30.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:30.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:31.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:31.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:32.202 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:13:32.202+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:13:32.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:32.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:33.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:33.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:34.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:34.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:35.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:35.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:36.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:36.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:37.203 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:13:37.203+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:13:37.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:37.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:38.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:38.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:39.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:39.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:40.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:40.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:41.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:41.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:42.203 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:13:42.204+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:13:42.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:42.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:43.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:43.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:44.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:44.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:45.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:45.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:46.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:46.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:47.204 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:13:47.206+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:13:47.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:47.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:48.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:48.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:49.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:49.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:50.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:50.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:51.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:51.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:52.205 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:13:52.207+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:13:52.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:52.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:53.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:53.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:54.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:54.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:55.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:55.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:56.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:56.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:57.205 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:13:57.206+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:13:57.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:57.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:58.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:58.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:13:59.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:13:59.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:00.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:00.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:01.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:01.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:02.206 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:14:02.207+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:14:02.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:02.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:03.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:03.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:04.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:04.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:05.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:05.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:06.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:06.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:07.207 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:14:07.208+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:14:07.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:07.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:08.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:08.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:09.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:09.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:10.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:10.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:11.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:11.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:12.209 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:14:12.209+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:14:12.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:12.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:13.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:13.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:14.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:14.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:15.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:15.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:16.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:16.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:17.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:14:17.210+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:14:17.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:17.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:18.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:18.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:19.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:19.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:20.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:20.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:21.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:21.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:22.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:14:22.211+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:14:22.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:22.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:23.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:23.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:24.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:24.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:25.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:25.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:26.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:26.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:27.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:14:27.212+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:14:27.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:27.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:28.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:28.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:29.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:29.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:30.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:30.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:31.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:31.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:32.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:14:32.213+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:14:32.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:32.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:33.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:33.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:34.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:34.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:35.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:35.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:36.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:36.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:37.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:14:37.214+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:14:38.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:38.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:38.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:38.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:39.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:40.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:41.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:41.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:41.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:41.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:42.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:14:42.215+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:14:42.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:42.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:44.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:44.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:45.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:45.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:46.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:46.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:47.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:47.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:47.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:14:47.216+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:14:48.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:48.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:49.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:49.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:50.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:50.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:51.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:51.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:51.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:51.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:52.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:14:52.217+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:14:52.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:52.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:53.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:53.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:54.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:54.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:55.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:55.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:56.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:56.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:57.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:14:57.218+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:14:57.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:57.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:58.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:58.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:14:59.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:14:59.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:00.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:00.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:01.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:01.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:02.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:15:02.219+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:15:02.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:02.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:03.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:03.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:04.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:04.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:05.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:05.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:06.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:06.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:07.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:15:07.220+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:15:07.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:07.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:08.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:08.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:09.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:09.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:10.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:10.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:11.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:11.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:12.220 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:15:12.221+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:15:12.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:12.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:13.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:13.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:14.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:14.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:15.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:15.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:16.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:16.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:17.221 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:15:17.222+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:15:17.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:17.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:18.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:18.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:20.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:20.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:21.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:21.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:22.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:22.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:22.222 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:15:22.223+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:15:23.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:23.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:24.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:24.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:25.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:25.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:26.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:26.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:27.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:27.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:27.223 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:15:27.224+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:15:28.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:28.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:29.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:29.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:29.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:29.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:30.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:30.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:31.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:31.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:32.224 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:15:32.225+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:15:32.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:32.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:33.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:33.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:34.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:34.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:35.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:35.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:36.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:36.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:37.225 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:15:37.226+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:15:37.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:37.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:38.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:38.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:39.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:39.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:40.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:40.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:41.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:41.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:42.228 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:15:42.227+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:15:42.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:42.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:43.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:43.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:44.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:44.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:45.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:45.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:46.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:46.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:47.228 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:15:47.229+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:15:47.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:47.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:48.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:48.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:49.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:49.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:50.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:50.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:51.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:51.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:52.228 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:15:52.229+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:15:52.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:52.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:53.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:53.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:54.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:54.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:55.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:55.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:56.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:56.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:57.231 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:15:57.231+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:15:57.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:57.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:58.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:58.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:15:59.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:15:59.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:00.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:00.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:01.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:01.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:02.230 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:16:02.231+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:16:02.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:02.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:03.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:03.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:04.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:04.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:05.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:05.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:06.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:06.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:07.231 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:16:07.232+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:16:07.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:07.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:08.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:08.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:09.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:09.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:10.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:10.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:11.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:11.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:12.232 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:16:12.234+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:16:12.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:12.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:13.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:13.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:14.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:14.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:15.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:15.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:16.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:16.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:17.233 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:16:17.234+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:16:17.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:17.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:18.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:18.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:19.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:19.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:20.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:20.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:21.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:21.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:22.234 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:16:22.235+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:16:22.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:22.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:23.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:23.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:24.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:24.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:25.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:25.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:26.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:26.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:27.236 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:16:27.236+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:16:27.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:27.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:28.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:28.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:29.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:29.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:30.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:30.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:31.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:31.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:32.236 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:16:32.237+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:16:32.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:32.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:33.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:33.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:34.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:34.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:35.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:35.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:36.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:36.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:37.237 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:16:37.238+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:16:38.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:38.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:39.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:39.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:39.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:39.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:40.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:40.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:41.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:41.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:42.238 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:16:42.239+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:16:42.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:42.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:43.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:43.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:44.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:44.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:46.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:46.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:47.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:47.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:47.239 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:16:47.241+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:16:48.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:48.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:48.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:48.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:49.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:49.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:50.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:51.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:51.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:51.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:52.240 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:16:52.242+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:16:52.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:52.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:53.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:53.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:54.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:54.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:55.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:55.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:56.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:56.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:57.242 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:16:57.243+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:16:57.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:57.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:58.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:58.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:16:59.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:16:59.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:00.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:00.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:01.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:01.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:02.243 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:17:02.244+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:17:02.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:02.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:03.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:03.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:04.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:04.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:05.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:05.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:06.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:06.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:07.244 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:17:07.244+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:17:07.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:07.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:08.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:08.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:09.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:09.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:10.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:10.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:11.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:11.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:12.244 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:17:12.245+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:17:12.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:12.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:13.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:13.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:14.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:14.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:15.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:15.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:16.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:16.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:17.245 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:17:17.246+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:17:17.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:17.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:18.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:18.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:19.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:19.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:20.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:20.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:21.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:21.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:22.246 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:17:22.247+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:17:22.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:22.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:23.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:23.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:24.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:24.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:25.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:25.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:26.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:26.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:27.247 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:17:27.248+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:17:27.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:27.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:28.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:28.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:29.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:29.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:30.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:30.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:31.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:31.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:32.248 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:17:32.249+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:17:32.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:32.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:33.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:33.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:34.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:34.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:35.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:35.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:36.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:36.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:37.250 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:17:37.251+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:17:37.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:37.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:38.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:38.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:39.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:39.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:40.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:40.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:41.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:41.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:42.251 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:17:42.252+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:17:42.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:42.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:43.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:43.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:44.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:44.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:45.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:45.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:46.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:46.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:47.252 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:17:47.253+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:17:47.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:47.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:48.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:48.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:49.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:49.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:50.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:50.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:51.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:51.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:52.252 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:17:52.253+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:17:52.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:52.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:53.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:53.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:54.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:54.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:55.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:55.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:56.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:56.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:57.254 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:17:57.255+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:17:57.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:57.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:58.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:58.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:17:59.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:17:59.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:00.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:00.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:01.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:01.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:02.255 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:18:02.256+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:18:02.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:02.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:03.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:03.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:04.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:04.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:05.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:05.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:06.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:06.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:07.256 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:18:07.257+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:18:07.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:07.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:08.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:08.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:09.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:09.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:10.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:10.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:11.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:11.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:12.256 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:18:12.257+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:18:12.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:12.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:13.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:13.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:14.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:14.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:15.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:15.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:16.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:16.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:17.258 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:18:17.259+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:18:17.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:17.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:18.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:18.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:19.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:19.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:20.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:20.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:21.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:21.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:22.258 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:18:22.259+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:18:22.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:22.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:23.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:23.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:24.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:24.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:25.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:25.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:26.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:26.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:27.259 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:18:27.260+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:18:27.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:27.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:28.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:28.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:29.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:29.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:30.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:30.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:31.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:31.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:32.261 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:18:32.262+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:18:32.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:32.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:33.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:33.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:34.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:34.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:35.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:35.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:36.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:36.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:37.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:18:37.263+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:18:37.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:37.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:38.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:38.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:39.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:39.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:40.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:40.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:41.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:41.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:42.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:18:42.263+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:18:42.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:42.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:43.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:43.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:44.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:44.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:45.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:45.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:46.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:46.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:47.264 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:18:47.265+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:18:47.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:47.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:48.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:48.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:49.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:49.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:50.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:50.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:51.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:51.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:52.264 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:18:52.265+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:18:52.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:52.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:53.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:53.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:54.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:54.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:55.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:55.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:56.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:56.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:57.266 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:18:57.267+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:18:57.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:57.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:58.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:58.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:18:59.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:18:59.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:00.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:00.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:01.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:01.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:02.267 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:19:02.268+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:19:02.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:02.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:03.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:03.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:04.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:04.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:05.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:05.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:06.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:06.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:07.267 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:19:07.268+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:19:07.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:07.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:08.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:08.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:09.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:09.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:10.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:10.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:11.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:11.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:12.269 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:19:12.270+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:19:12.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:12.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:13.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:13.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:14.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:14.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:15.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:15.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:16.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:16.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:17.270 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:19:17.271+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:19:17.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:17.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:18.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:18.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:19.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:19.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:20.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:20.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:21.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:21.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:22.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:19:22.271+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:19:22.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:22.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:23.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:23.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:24.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:24.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:25.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:25.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:26.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:26.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:27.272 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:19:27.273+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:19:27.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:27.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:28.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:28.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:29.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:29.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:30.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:30.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:31.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:31.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:32.273 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:19:32.274+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:19:32.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:32.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:33.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:33.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:34.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:34.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:35.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:35.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:36.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:36.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:37.273 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:19:37.274+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:19:37.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:37.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:38.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:38.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:39.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:39.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:40.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:40.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:41.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:41.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:42.274 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:19:42.276+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:19:42.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:42.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:43.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:43.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:44.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:44.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:45.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:45.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:46.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:46.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:47.275 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:19:47.276+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:19:47.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:47.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:48.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:48.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:49.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:49.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:50.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:50.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:51.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:51.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:52.276 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:19:52.277+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:19:52.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:52.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:53.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:53.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:54.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:54.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:55.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:55.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:56.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:56.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:57.277 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:19:57.279+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:19:57.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:57.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:58.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:58.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:19:59.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:19:59.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:00.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:00.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:01.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:01.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:02.278 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:20:02.280+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:20:02.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:02.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:03.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:03.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:04.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:04.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:05.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:05.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:06.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:06.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:07.279 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:20:07.280+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:20:07.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:07.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:08.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:08.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:09.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:09.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:10.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:10.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:11.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:11.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:12.280 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:20:12.281+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:20:12.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:12.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:13.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:13.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:14.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:14.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:15.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:15.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:16.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:16.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:17.280 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:20:17.281+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:20:17.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:17.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:18.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:18.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:19.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:19.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:20.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:20.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:21.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:21.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:22.281 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:20:22.282+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:20:22.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:22.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:23.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:23.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:24.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:24.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:25.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:25.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:26.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:26.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:27.283 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:20:27.283+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:20:27.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:27.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:28.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:28.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:29.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:29.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:30.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:30.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:31.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:31.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:32.283 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:20:32.284+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:20:32.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:32.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:33.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:33.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:34.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:34.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:35.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:35.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:36.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:36.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:37.284 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:20:37.285+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:20:37.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:37.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:38.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:38.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:39.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:39.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:40.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:40.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:41.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:41.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:42.286 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:20:42.287+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:20:42.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:42.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:43.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:43.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:44.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:44.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:45.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:45.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:46.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:46.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:47.287 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:20:47.288+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:20:47.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:47.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:48.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:48.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:49.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:49.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:50.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:50.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:51.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:51.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:52.287 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:20:52.288+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:20:52.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:52.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:53.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:53.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:54.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:54.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:55.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:55.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:56.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:56.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:57.288 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:20:57.289+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:20:57.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:57.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:58.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:58.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:20:59.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:20:59.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:00.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:00.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:01.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:01.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:02.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:21:02.290+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:21:02.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:02.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:03.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:03.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:04.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:04.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:05.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:05.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:06.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:06.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:07.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:07.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:08.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:08.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:09.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:09.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:10.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:10.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:11.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:11.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:12.292 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:21:12.293+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:21:12.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:12.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:13.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:13.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:14.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:14.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:15.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:15.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:16.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:16.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:17.293 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:21:17.294+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:21:17.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:17.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:18.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:18.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:19.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:19.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:20.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:20.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:21.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:21.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:22.294 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:21:22.295+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:21:22.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:22.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:23.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:23.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:24.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:24.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:25.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:25.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:26.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:26.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:27.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:21:27.296+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:21:27.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:27.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:28.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:28.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:29.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:29.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:30.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:30.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:31.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:31.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:32.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:21:32.296+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:21:32.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:32.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:33.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:33.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:34.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:34.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:35.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:35.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:36.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:36.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:37.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:21:37.298+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:21:37.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:37.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:38.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:38.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:39.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:39.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:40.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:40.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:41.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:41.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:42.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:21:42.298+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:21:42.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:42.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:43.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:43.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:44.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:44.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:45.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:45.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:46.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:46.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:47.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:21:47.299+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:21:47.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:47.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:48.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:48.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:49.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:49.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:50.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:50.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:51.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:51.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:52.299 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:21:52.300+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:21:52.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:52.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:53.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:53.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:54.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:54.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:55.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:55.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:56.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:56.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:57.301 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:21:57.302+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:21:57.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:57.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:58.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:58.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:21:59.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:21:59.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:00.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:00.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:01.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:01.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:02.301 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:22:02.302+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:22:02.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:02.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:03.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:03.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:04.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:04.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:05.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:05.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:06.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:06.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:07.303 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:22:07.304+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:22:07.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:07.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:08.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:08.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:09.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:09.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:10.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:10.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:11.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:11.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:12.303 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:22:12.304+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:22:12.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:12.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:13.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:13.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:14.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:14.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:15.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:15.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:16.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:16.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:17.304 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:22:17.305+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:22:17.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:17.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:18.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:18.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:19.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:19.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:20.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:20.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:21.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:21.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:22.305 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:22:22.306+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:22:22.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:22.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:23.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:23.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:24.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:24.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:25.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:25.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:26.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:26.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:27.306 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:22:27.308+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:22:27.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:27.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:28.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:28.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:29.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:29.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:30.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:30.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:31.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:31.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:32.308 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:22:32.309+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:22:32.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:32.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:33.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:33.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:34.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:34.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:35.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:35.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:36.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:36.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:37.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:22:37.310+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:22:37.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:37.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:38.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:38.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:39.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:39.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:40.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:40.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:41.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:41.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:42.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:22:42.310+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:22:42.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:42.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:43.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:43.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:44.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:44.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:45.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:45.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:46.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:46.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:47.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:22:47.311+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:22:47.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:47.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:48.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:48.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:49.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:49.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:50.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:50.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:51.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:51.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:52.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:22:52.313+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:22:52.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:52.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:53.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:53.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:54.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:54.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:55.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:55.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:56.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:56.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:57.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:22:57.313+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:22:57.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:57.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:58.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:58.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:22:59.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:22:59.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:00.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:00.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:01.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:01.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:02.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:23:02.315+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:23:02.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:02.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:03.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:03.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:04.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:04.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:05.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:05.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:06.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:06.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:07.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:23:07.316+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:23:07.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:07.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:08.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:08.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:09.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:09.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:10.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:10.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:11.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:11.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:12.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:23:12.315+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:23:12.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:12.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:13.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:13.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:14.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:14.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:15.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:15.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:16.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:16.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:17.315 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:23:17.317+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:23:17.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:17.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:18.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:18.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:19.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:19.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:20.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:20.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:21.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:21.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:22.317 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:23:22.318+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:23:22.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:22.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:23.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:23.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:24.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:24.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:25.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:25.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:26.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:26.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:27.318 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:23:27.319+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:23:27.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:27.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:28.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:28.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:29.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:29.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:30.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:30.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:31.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:31.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:32.318 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:23:32.319+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:23:32.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:32.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:33.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:33.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:34.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:34.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:35.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:35.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:36.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:36.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:37.319 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:23:37.320+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:23:37.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:37.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:38.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:38.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:39.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:39.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:40.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:40.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:41.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:41.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:42.321 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:23:42.321+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:23:42.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:42.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:43.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:43.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:44.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:44.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:45.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:45.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:46.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:46.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:47.322 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:23:47.323+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:23:47.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:47.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:48.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:48.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:49.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:49.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:50.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:50.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:51.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:51.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:52.323 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:23:52.324+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:23:52.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:52.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:53.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:53.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:54.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:54.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:55.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:55.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:56.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:56.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:57.323 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:23:57.324+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:23:57.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:57.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:58.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:58.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:23:59.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:23:59.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:00.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:00.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:01.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:01.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:02.324 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:24:02.325+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:24:02.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:02.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:03.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:03.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:04.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:04.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:05.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:05.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:06.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:06.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:07.326 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:24:07.327+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:24:07.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:07.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:08.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:08.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:09.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:09.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:10.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:10.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:11.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:11.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:12.326 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:24:12.327+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:24:12.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:12.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:13.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:13.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:14.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:14.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:15.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:15.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:16.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:16.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:17.327 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:24:17.328+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:24:17.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:17.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:18.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:18.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:19.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:19.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:20.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:20.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:21.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:21.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:22.328 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:24:22.329+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:24:22.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:22.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:23.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:23.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:24.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:24.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:25.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:25.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:26.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:26.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:27.331 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:24:27.331+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:24:27.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:27.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:28.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:28.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:29.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:29.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:30.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:30.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:31.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:31.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:32.330 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:24:32.331+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:24:32.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:32.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:33.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:33.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:34.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:34.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:35.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:35.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:36.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:36.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:37.332 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:24:37.332+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:24:37.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:37.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:38.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:38.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:39.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:39.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:40.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:40.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:41.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:41.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:42.332 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:24:42.333+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:24:42.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:42.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:43.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:43.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:44.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:44.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:45.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:45.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:46.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:46.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:47.334 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:24:47.335+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:24:47.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:47.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:48.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:48.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:49.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:49.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:50.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:50.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:51.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:51.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:52.334 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:24:52.335+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:24:52.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:52.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:53.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:53.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:54.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:54.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:55.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:55.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:56.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:56.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:57.335 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:24:57.336+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:24:57.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:57.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:24:59.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:24:59.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:00.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:00.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:00.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:00.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:02.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:02.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:02.336 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:25:02.337+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:25:03.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:03.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:03.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:03.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:04.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:04.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:05.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:05.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:06.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:06.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:07.337 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:25:07.338+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:25:07.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:07.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:08.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:08.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:09.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:09.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:10.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:10.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:11.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:11.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:12.339 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:25:12.340+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:25:12.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:13.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:14.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:14.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:15.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:15.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:16.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:16.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:17.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:17.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:17.339 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:25:17.340+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:25:18.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:18.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:19.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:19.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:20.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:20.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:21.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:21.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:22.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:22.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:22.340 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:25:22.341+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:25:23.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:23.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:24.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:24.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:25.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:25.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:26.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:26.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:27.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:27.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:27.341 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:25:27.342+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:25:28.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:28.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:29.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:29.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:30.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:30.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:31.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:31.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:32.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:32.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:32.342 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:25:32.343+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:25:33.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:33.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:34.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:34.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:35.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:35.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:36.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:36.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:37.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:37.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:37.343 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:25:37.344+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:25:38.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:38.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:39.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:39.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:40.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:40.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:41.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:41.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:42.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:42.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:42.345 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:25:42.346+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:25:43.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:43.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:44.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:44.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:45.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:45.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:46.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:46.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:47.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:47.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:47.345 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:25:47.346+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:25:48.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:48.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:49.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:49.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:50.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:50.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:51.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:51.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:52.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:52.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:52.346 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:25:52.347+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:25:53.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:53.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:54.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:54.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:55.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:55.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:56.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:56.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:57.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:57.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:57.348 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:25:57.349+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:25:58.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:58.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:25:59.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:25:59.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:00.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:00.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:01.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:01.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:02.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:02.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:02.348 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:26:02.349+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:26:03.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:03.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:04.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:04.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:05.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:05.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:06.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:06.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:07.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:07.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:07.349 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:26:07.351+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:26:08.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:08.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:09.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:09.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:10.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:10.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:11.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:11.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:12.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:12.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:12.350 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:26:12.352+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:26:13.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:13.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:14.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:14.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:15.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:15.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:16.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:16.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:17.351 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:26:17.351+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:26:17.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:17.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:18.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:18.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:19.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:19.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:20.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:20.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:21.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:21.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:22.351 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:26:22.352+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:26:22.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:22.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:23.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:23.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:24.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:24.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:25.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:25.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:26.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:26.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:27.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:27.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:27.353 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:26:27.354+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:26:28.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:28.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:29.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:29.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:30.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:30.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:31.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:31.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:32.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:32.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:32.353 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:26:32.354+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:26:33.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:33.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:34.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:34.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:35.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:35.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:36.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:36.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:37.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:37.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:37.355 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:26:37.356+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:26:38.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:38.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:39.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:39.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:40.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:40.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:41.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:41.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:42.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:42.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:42.355 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:26:42.356+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:26:43.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:43.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:44.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:44.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:45.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:45.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:46.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:46.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:47.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:47.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:47.356 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:26:47.357+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:26:48.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:48.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:49.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:49.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:50.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:50.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:51.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:51.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:52.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:52.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:52.361 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:26:52.358+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:26:53.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:53.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:54.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:54.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:55.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:55.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:56.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:56.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:57.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:57.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:57.359 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:26:57.360+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:26:58.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:58.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:26:59.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:26:59.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:00.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:00.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:01.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:01.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:02.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:02.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:02.360 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:27:02.361+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:27:03.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:03.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:04.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:04.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:05.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:05.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:06.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:06.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:07.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:07.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:07.361 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:27:07.362+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:27:08.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:08.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:09.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:09.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:10.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:10.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:11.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:11.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:12.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:12.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:12.362 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:27:12.362+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:27:13.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:13.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:14.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:14.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:15.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:15.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:16.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:16.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:17.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:17.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:17.362 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:27:17.363+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:27:18.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:18.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:19.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:19.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:20.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:20.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:21.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:21.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:22.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:22.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:22.363 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:27:22.364+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:27:23.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:23.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:24.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:24.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:25.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:25.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:26.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:26.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:27.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:27.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:27.365 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:27:27.365+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:27:28.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:28.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:29.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:29.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:30.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:30.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:31.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:31.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:32.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:32.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:32.365 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:27:32.366+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:27:33.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:33.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:34.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:34.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:35.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:35.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:36.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:36.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:37.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:37.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:37.366 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:27:37.367+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:27:38.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:38.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:39.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:39.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:40.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:40.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:41.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:41.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:42.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:42.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:42.368 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:27:42.368+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:27:43.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:43.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:44.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:44.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:45.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:45.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:46.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:46.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:47.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:47.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:47.368 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:27:47.369+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:27:48.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:48.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:49.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:49.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:50.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:50.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:51.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:51.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:52.369 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:27:52.370+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:27:52.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:52.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:53.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:53.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:54.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:54.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:55.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:55.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:56.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:56.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:57.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:57.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:57.397 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:27:57.371+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:27:58.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:58.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:27:59.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:27:59.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:00.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:00.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:01.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:01.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:02.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:02.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:02.371 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:28:02.372+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:28:03.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:03.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:04.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:04.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:05.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:05.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:06.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:06.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:07.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:07.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:07.371 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:28:07.373+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:28:08.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:08.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:09.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:09.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:10.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:10.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:11.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:11.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:12.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:12.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:12.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:28:12.373+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:28:13.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:13.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:14.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:14.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:15.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:15.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:16.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:16.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:17.373 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:28:17.374+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:28:17.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:17.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:18.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:18.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:19.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:19.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:20.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:20.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:21.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:21.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:22.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:22.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:22.375 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:28:22.376+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:28:23.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:23.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:24.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:24.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:25.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:25.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:26.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:26.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:27.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:27.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:27.376 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:28:27.377+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:28:28.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:28.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:29.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:29.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:30.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:30.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:31.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:31.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:32.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:32.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:32.377 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:28:32.378+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:28:33.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:33.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:34.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:34.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:35.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:35.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:36.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:36.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:37.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:37.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:37.379 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:28:37.380+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:28:38.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:38.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:39.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:39.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:40.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:40.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:41.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:41.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:42.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:42.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:42.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:28:42.381+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:28:43.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:43.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:44.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:44.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:45.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:45.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:46.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:46.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:47.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:47.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:47.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:28:47.381+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:28:48.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:48.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:49.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:49.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:50.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:50.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:51.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:51.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:52.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:52.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:52.381 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:28:52.382+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:28:53.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:53.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:54.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:54.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:55.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:55.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:56.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:56.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:57.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:57.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:57.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:28:57.383+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:28:58.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:58.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:28:59.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:28:59.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:00.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:00.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:01.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:01.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:02.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:02.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:02.383 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:29:02.385+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:29:03.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:03.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:04.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:04.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:05.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:05.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:06.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:06.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:07.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:07.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:07.384 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:29:07.386+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:29:08.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:08.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:09.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:09.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:10.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:10.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:11.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:11.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:12.386 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:29:12.387+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:29:12.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:12.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:13.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:13.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:14.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:14.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:15.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:15.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:16.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:16.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:17.387 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:29:17.387+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:29:17.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:17.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:18.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:18.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:19.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:19.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:20.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:20.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:21.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:21.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:22.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:29:22.388+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:29:22.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:22.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:23.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:23.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:24.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:24.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:25.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:25.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:26.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:26.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:27.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:29:27.389+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:29:27.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:27.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:28.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:28.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:29.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:29.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:30.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:30.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:31.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:31.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:32.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:29:32.390+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:29:32.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:32.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:33.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:33.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:34.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:34.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:35.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:35.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:36.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:36.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:37.390 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:29:37.391+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:29:37.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:37.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:38.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:38.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:39.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:39.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:40.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:40.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:41.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:41.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:42.391 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:29:42.392+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:29:42.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:42.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:43.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:43.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:44.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:44.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:45.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:45.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:46.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:46.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:47.392 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:29:47.393+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:29:47.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:47.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:48.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:48.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:49.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:49.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:50.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:50.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:51.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:51.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:52.394 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:29:52.394+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:29:52.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:52.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:53.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:53.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:54.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:54.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:55.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:55.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:56.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:56.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:57.394 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:29:57.395+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:29:57.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:57.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:58.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:58.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:29:59.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:29:59.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:00.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:00.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:01.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:01.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:02.396 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:30:02.396+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:30:02.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:02.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:03.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:03.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:04.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:04.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:05.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:05.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:06.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:06.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:07.396 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:30:07.397+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:30:07.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:07.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:08.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:08.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:09.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:09.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:10.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:10.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:11.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:11.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:12.397 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:30:12.398+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:30:12.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:12.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:13.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:13.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:14.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:14.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:15.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:15.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:16.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:16.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:17.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:17.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:17.398 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:30:17.399+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:30:18.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:18.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:19.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:19.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:20.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:20.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:21.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:21.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:22.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:22.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:22.399 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:30:22.400+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:30:23.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:23.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:24.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:24.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:25.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:25.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:26.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:26.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:27.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:27.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:27.400 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:30:27.401+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:30:28.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:28.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:29.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:29.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:30.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:30.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:31.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:31.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:32.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:32.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:32.401 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:30:32.402+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:30:33.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:33.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:34.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:34.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:35.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:35.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:36.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:36.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:37.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:37.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:37.402 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:30:37.403+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:30:38.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:38.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:39.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:39.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:40.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:40.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:41.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:41.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:42.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:42.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:42.403 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:30:42.404+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:30:43.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:43.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:44.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:44.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:45.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:45.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:46.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:46.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:47.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:47.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:47.404 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:30:47.405+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:30:48.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:48.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:49.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:49.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:50.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:50.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:51.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:51.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:52.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:52.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:52.405 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:30:52.406+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:30:53.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:53.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:54.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:54.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:55.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:55.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:56.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:56.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:57.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:57.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:57.407 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:30:57.408+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:30:58.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:58.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:30:59.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:30:59.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:00.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:00.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:01.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:01.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:02.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:02.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:02.407 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:31:02.408+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:31:03.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:03.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:04.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:04.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:05.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:05.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:06.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:06.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:07.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:07.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:07.408 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:31:07.409+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:31:08.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:08.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:09.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:09.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:10.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:10.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:11.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:11.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:12.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:12.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:12.409 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:31:12.410+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:31:13.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:13.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:14.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:14.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:15.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:15.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:16.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:16.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:17.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:17.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:17.410 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:31:17.411+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:31:18.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:18.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:19.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:19.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:20.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:20.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:21.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:21.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:22.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:22.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:22.411 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:31:22.412+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:31:23.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:23.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:24.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:24.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:25.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:25.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:26.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:26.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:27.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:27.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:27.412 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:31:27.413+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:31:28.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:28.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:29.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:29.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:30.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:30.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:31.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:31.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:32.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:32.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:32.413 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:31:32.414+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:31:33.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:33.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:34.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:34.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:35.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:35.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:36.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:36.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:37.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:37.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:37.414 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:31:37.415+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:31:38.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:38.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:39.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:39.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:40.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:40.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:41.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:41.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:42.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:42.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:42.415 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:31:42.416+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:31:43.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:43.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:44.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:44.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:45.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:45.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:46.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:46.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:47.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:47.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:47.416 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:31:47.417+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:31:48.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:48.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:49.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:49.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:50.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:50.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:51.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:51.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:52.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:52.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:52.417 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:31:52.418+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:31:53.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:53.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:54.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:54.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:55.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:55.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:56.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:56.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:57.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:57.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:57.418 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:31:57.419+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:31:58.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:58.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:31:59.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:31:59.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:00.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:00.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:01.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:01.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:02.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:02.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:02.419 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:32:02.420+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:32:03.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:03.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:04.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:04.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:05.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:05.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:06.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:06.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:07.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:07.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:07.420 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:32:07.422+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:32:08.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:08.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:09.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:09.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:10.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:10.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:11.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:11.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:12.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:12.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:12.421 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:32:12.423+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:32:13.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:13.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:14.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:14.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:15.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:15.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:16.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:16.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:17.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:17.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:17.422 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:32:17.424+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:32:18.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:18.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:19.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:19.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:20.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:20.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:21.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:21.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:22.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:22.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:22.422 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:32:22.423+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:32:23.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:23.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:24.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:24.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:25.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:25.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:26.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:26.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:27.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:27.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:27.424 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:32:27.424+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:32:28.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:28.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:29.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:29.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:30.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:30.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:31.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:31.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:32.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:32.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:32.424 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:32:32.425+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:32:33.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:33.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:34.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:34.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:35.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:35.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:36.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:36.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:37.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:37.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:37.425 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:32:37.426+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:32:38.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:38.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:39.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:39.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:40.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:40.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:41.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:41.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:42.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:42.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:42.426 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:32:42.427+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:32:43.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:43.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:44.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:44.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:45.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:45.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:46.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:46.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:47.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:47.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:47.427 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:32:47.428+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:32:48.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:48.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:49.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:49.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:50.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:50.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:51.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:51.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:52.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:52.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:52.427 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:32:52.428+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:32:53.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:53.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:54.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:54.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:55.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:55.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:56.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:56.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:57.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:57.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:57.429 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:32:57.430+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:32:58.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:58.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:32:59.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:32:59.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:00.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:00.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:01.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:01.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:02.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:02.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:02.430 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:33:02.431+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:33:03.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:03.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:04.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:04.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:05.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:05.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:06.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:06.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:07.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:07.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:07.432 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:33:07.433+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:33:08.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:08.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:09.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:09.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:10.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:10.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:11.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:11.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:12.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:12.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:12.433 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:33:12.434+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:33:13.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:13.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:14.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:14.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:15.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:15.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:16.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:16.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:17.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:17.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:17.434 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:33:17.435+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:33:18.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:18.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:19.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:19.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:20.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:20.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:21.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:21.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:22.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:22.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:22.435 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:33:22.436+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:33:23.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:23.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:24.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:24.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:25.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:25.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:26.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:26.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:27.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:27.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:27.436 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:33:27.437+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:33:28.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:28.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:29.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:29.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:30.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:30.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:31.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:31.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:32.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:32.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:32.436 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:33:32.437+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:33:33.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:33.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:34.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:34.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:35.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:35.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:36.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:36.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:37.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:37.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:37.438 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:33:37.439+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:33:38.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:38.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:39.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:39.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:40.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:40.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:41.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:41.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:42.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:42.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:42.439 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:33:42.440+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:33:43.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:43.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:44.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:44.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:45.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:45.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:46.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:46.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:47.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:47.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:47.440 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:33:47.441+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:33:48.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:48.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:49.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:49.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:50.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:50.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:51.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:51.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:52.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:52.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:52.441 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:33:52.442+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:33:53.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:53.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:54.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:54.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:55.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:55.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:56.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:56.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:57.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:57.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:57.441 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:33:57.442+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:33:58.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:58.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:33:59.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:33:59.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:00.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:00.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:01.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:01.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:02.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:02.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:02.443 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:34:02.444+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:34:03.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:03.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:04.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:04.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:05.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:05.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:06.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:06.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:07.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:07.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:07.443 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:34:07.444+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:34:08.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:08.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:09.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:09.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:10.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:10.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:11.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:11.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:12.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:12.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:12.444 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:34:12.445+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:34:13.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:13.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:14.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:14.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:15.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:15.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:16.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:16.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:17.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:17.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:17.446 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:34:17.447+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:34:18.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:18.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:19.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:19.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:20.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:20.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:21.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:21.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:22.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:22.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:22.447 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:34:22.448+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:34:23.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:23.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:24.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:24.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:25.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:25.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:26.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:26.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:27.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:27.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:27.447 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:34:27.448+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:34:28.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:28.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:29.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:29.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:30.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:30.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:31.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:31.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:32.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:32.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:32.449 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:34:32.450+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:34:33.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:33.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:34.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:34.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:35.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:35.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:36.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:36.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:37.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:37.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:37.450 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:34:37.450+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:34:38.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:38.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:39.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:39.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:40.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:40.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:41.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:41.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:42.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:42.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:42.450 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:34:42.451+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:34:43.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:43.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:44.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:44.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:45.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:45.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:46.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:46.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:47.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:47.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:47.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:34:47.452+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:34:48.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:48.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:49.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:49.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:50.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:50.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:51.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:51.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:52.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:52.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:52.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:34:52.453+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:34:53.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:53.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:54.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:54.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:55.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:55.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:56.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:56.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:57.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:57.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:57.454 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:34:57.454+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:34:58.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:58.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:34:59.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:34:59.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:00.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:00.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:01.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:01.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:02.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:02.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:02.455 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:35:02.456+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:35:03.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:03.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:04.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:04.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:05.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:05.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:06.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:06.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:07.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:07.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:07.455 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:35:07.456+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:35:08.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:08.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:09.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:09.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:10.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:10.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:11.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:11.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:12.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:12.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:12.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:35:12.458+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:35:13.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:13.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:14.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:14.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:15.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:15.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:16.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:16.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:17.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:17.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:17.457 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:35:17.459+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:35:18.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:18.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:19.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:19.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:20.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:20.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:21.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:21.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:22.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:22.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:22.458 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:35:22.459+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:35:23.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:23.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:24.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:24.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:25.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:25.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:26.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:26.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:27.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:27.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:27.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:35:27.460+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:35:28.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:28.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:29.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:29.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:30.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:30.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:31.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:31.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:32.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:32.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:32.460 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:35:32.461+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:35:33.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:33.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:34.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:34.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:35.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:35.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:36.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:36.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:37.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:37.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:37.460 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:35:37.461+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:35:38.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:38.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:39.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:39.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:40.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:40.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:41.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:41.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:42.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:42.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:42.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:35:42.462+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:35:43.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:43.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:44.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:44.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:45.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:45.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:46.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:46.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:47.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:47.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:47.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:35:47.464+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:35:48.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:48.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:49.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:49.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:50.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:50.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:51.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:51.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:52.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:52.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:52.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:35:52.465+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:35:53.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:53.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:54.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:54.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:55.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:55.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:56.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:56.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:57.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:57.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:57.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:35:57.466+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:35:58.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:58.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:35:59.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:35:59.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:00.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:00.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:00.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:01.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:01.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:01.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:02.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:36:02.466+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:36:02.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:02.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:03.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:03.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:04.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:04.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:05.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:05.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:06.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:06.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:07.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:07.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:08.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:08.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:10.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:10.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:10.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:10.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:11.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:11.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:12.468 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:36:12.469+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:36:12.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:12.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:14.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:14.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:15.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:15.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:16.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:16.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:17.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:17.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:17.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:36:17.470+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:36:18.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:18.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:19.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:19.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:20.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:20.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:21.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:21.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:21.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:21.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:22.470 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:36:22.471+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:36:22.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:22.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:23.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:23.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:24.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:24.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:25.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:25.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:26.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:26.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:27.471 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:36:27.472+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:36:27.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:27.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:28.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:28.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:29.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:29.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:30.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:30.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:31.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:31.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:32.472 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:36:32.473+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:36:32.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:32.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:33.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:33.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:34.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:34.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:35.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:35.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:36.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:36.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:37.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:36:37.474+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:36:37.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:37.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:38.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:38.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:39.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:39.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:40.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:40.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:41.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:41.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:42.474 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:36:42.475+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:36:42.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:42.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:43.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:43.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:44.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:44.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:45.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:45.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:46.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:46.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:47.475 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:36:47.475+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:36:47.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:47.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:48.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:48.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:49.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:49.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:50.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:50.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:51.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:51.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:52.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:36:52.476+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:36:52.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:52.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:54.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:54.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:55.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:55.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:55.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:55.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:56.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:56.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:57.477 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:36:57.477+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:36:57.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:57.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:36:58.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:36:58.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:00.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:00.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:00.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:00.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:01.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:01.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:02.477 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:37:02.478+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:37:02.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:02.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:03.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:03.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:04.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:04.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:05.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:05.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:06.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:06.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:07.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:37:07.479+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:37:07.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:07.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:08.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:08.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:09.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:09.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:10.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:10.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:11.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:11.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:12.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:37:12.480+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:37:12.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:12.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:13.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:13.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:14.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:14.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:15.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:15.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:16.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:16.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:17.481 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:37:17.482+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:37:17.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:17.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:18.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:18.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:19.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:19.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:20.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:20.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:21.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:21.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:22.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:37:22.483+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:37:22.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:22.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:23.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:23.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:24.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:24.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:25.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:25.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:26.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:26.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:27.483 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:37:27.483+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:37:27.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:27.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:28.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:28.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:29.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:29.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:30.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:30.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:31.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:31.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:32.484 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:37:32.484+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:37:32.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:32.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:33.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:33.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:34.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:34.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:35.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:35.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:36.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:36.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:37.484 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:37:37.485+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:37:37.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:37.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:38.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:38.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:39.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:39.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:40.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:40.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:41.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:41.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:42.485 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:37:42.486+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:37:42.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:42.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:43.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:43.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:44.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:44.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:45.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:45.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:46.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:46.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:47.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:37:47.488+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:37:47.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:47.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:48.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:48.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:49.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:49.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:50.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:50.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:51.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:51.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:52.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:37:52.488+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:37:52.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:52.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:53.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:53.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:54.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:54.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:55.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:55.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:56.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:56.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:57.488 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:37:57.489+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:37:57.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:57.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:58.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:58.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:37:59.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:37:59.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:00.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:00.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:01.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:01.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:02.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:38:02.490+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:38:02.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:02.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:03.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:03.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:04.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:04.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:05.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:05.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:06.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:06.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:07.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:38:07.492+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:38:07.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:07.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:08.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:08.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:09.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:09.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:10.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:10.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:11.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:11.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:12.491 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:38:12.493+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:38:12.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:12.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:13.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:13.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:14.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:14.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:15.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:15.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:16.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:16.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:17.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:38:17.494+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:38:17.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:17.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:18.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:18.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:19.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:19.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:20.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:20.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:21.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:21.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:22.494 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:38:22.496+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:38:22.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:22.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:23.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:23.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:24.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:24.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:25.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:25.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:26.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:26.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:27.494 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:38:27.495+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:38:27.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:27.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:28.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:28.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:29.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:29.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:30.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:30.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:31.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:31.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:32.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:38:32.496+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:38:32.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:32.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:33.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:33.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:34.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:34.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:35.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:35.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:36.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:36.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:37.497 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:38:37.498+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:38:37.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:37.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:38.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:38.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:39.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:39.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:40.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:40.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:41.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:41.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:42.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:38:42.498+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:38:42.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:42.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:43.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:43.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:44.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:44.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:45.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:45.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:46.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:46.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:47.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:38:47.499+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:38:47.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:47.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:48.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:48.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:49.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:49.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:50.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:50.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:51.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:51.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:52.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:38:52.500+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:38:52.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:52.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:53.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:53.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:54.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:54.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:55.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:55.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:56.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:56.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:57.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:38:57.501+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:38:57.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:57.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:58.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:58.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:38:59.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:38:59.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:00.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:00.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:01.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:01.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:02.501 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:39:02.502+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:39:02.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:02.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:03.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:03.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:04.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:04.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:05.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:05.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:06.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:06.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:07.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:39:07.503+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:39:07.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:07.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:08.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:08.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:09.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:09.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:10.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:10.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:11.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:11.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:12.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:39:12.504+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:39:12.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:12.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:13.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:13.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:14.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:14.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:15.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:15.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:16.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:16.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:17.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:39:17.505+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:39:17.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:17.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:18.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:18.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:19.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:19.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:20.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:20.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:21.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:21.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:22.505 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:39:22.506+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:39:22.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:22.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:23.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:23.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:24.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:24.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:25.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:25.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:26.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:26.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:27.507 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:39:27.507+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:39:27.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:27.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:28.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:28.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:29.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:29.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:30.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:30.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:31.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:31.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:32.507 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:39:32.508+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:39:32.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:32.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:33.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:33.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:34.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:34.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:35.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:35.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:36.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:36.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:37.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:39:37.509+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:39:37.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:37.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:38.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:38.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:39.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:39.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:40.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:40.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:41.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:41.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:42.510 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:39:42.510+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:39:42.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:42.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:43.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:43.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:44.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:44.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:45.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:45.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:46.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:46.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:47.510 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:39:47.511+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:39:47.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:47.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:48.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:48.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:49.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:49.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:50.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:50.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:51.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:51.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:52.511 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:39:52.512+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:39:52.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:52.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:53.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:53.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:54.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:54.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:55.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:55.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:56.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:56.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:57.512 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:39:57.513+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:39:57.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:57.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:58.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:58.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:39:59.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:39:59.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:00.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:00.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:01.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:01.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:02.513 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:40:02.514+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:40:02.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:02.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:03.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:03.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:04.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:04.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:05.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:05.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:06.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:06.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:07.514 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:40:07.515+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:40:07.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:07.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:08.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:08.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:09.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:09.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:10.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:10.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:11.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:11.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:12.515 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:40:12.516+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:40:12.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:12.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:13.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:13.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:14.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:14.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:15.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:15.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:16.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:16.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:17.516 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:40:17.517+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:40:17.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:17.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:18.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:18.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:19.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:19.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:20.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:20.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:21.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:21.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:22.517 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:40:22.518+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:40:22.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:22.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:23.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:23.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:24.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:24.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:25.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:25.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:26.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:26.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:27.518 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:40:27.519+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:40:27.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:27.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:28.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:28.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:29.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:29.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:30.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:30.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:31.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:31.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:32.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:40:32.520+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:40:32.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:32.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:33.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:33.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:34.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:34.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:35.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:35.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:36.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:36.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:37.520 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:40:37.521+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:40:37.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:37.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:38.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:38.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:39.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:39.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:40.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:40.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:41.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:41.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:42.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:40:42.522+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:40:42.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:42.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:43.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:43.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:44.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:44.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:45.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:45.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:46.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:46.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:47.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:40:47.522+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:40:47.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:47.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:48.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:48.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:49.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:49.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:50.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:50.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:51.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:51.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:52.522 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:40:52.523+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:40:52.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:52.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:53.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:53.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:54.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:54.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:55.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:55.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:56.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:56.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:57.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:40:57.524+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:40:57.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:57.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:58.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:58.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:40:59.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:40:59.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:00.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:00.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:01.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:01.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:02.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:02.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:02.524 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:41:02.525+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:41:03.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:03.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:04.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:04.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:05.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:05.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:06.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:06.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:07.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:07.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:07.526 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:41:07.527+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:41:08.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:08.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:09.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:09.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:10.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:10.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:11.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:11.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:12.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:12.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:12.533 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:41:12.528+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:41:13.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:13.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:14.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:14.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:15.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:15.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:16.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:16.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:17.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:17.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:17.528 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:41:17.529+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:41:18.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:18.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:19.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:19.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:20.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:20.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:21.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:21.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:22.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:22.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:22.529 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:41:22.531+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:41:23.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:23.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:24.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:24.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:25.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:25.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:26.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:26.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:27.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:27.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:27.530 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:41:27.532+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:41:28.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:28.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:29.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:29.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:30.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:30.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:31.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:31.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:32.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:32.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:32.531 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:41:32.532+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:41:33.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:33.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:34.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:34.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:35.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:35.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:36.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:36.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:37.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:37.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:37.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:41:37.533+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:41:38.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:38.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:39.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:39.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:40.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:40.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:41.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:41.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:42.533 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:41:42.534+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:41:42.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:42.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:43.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:43.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:44.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:44.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:45.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:45.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:46.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:46.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:47.534 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:41:47.535+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:41:47.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:47.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:48.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:48.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:49.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:49.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:50.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:50.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:51.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:51.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:52.535 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:41:52.536+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:41:52.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:52.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:53.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:53.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:54.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:54.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:55.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:55.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:56.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:56.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:57.536 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:41:57.536+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:41:57.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:57.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:58.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:58.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:41:59.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:41:59.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:00.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:00.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:01.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:01.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:02.536 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:42:02.537+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:42:02.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:02.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:03.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:03.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:04.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:04.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:05.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:05.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:06.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:06.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:07.538 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:42:07.539+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:42:07.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:07.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:08.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:08.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:09.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:09.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:10.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:10.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:11.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:11.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:12.538 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:42:12.539+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:42:12.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:12.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:13.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:13.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:14.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:14.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:15.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:15.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:16.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:16.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:17.540 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:42:17.541+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:42:17.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:17.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:18.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:18.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:19.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:19.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:20.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:20.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:21.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:21.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:22.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:42:22.542+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:42:22.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:22.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:23.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:23.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:24.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:24.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:25.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:25.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:26.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:26.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:27.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:42:27.542+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:42:27.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:27.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:28.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:28.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:29.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:29.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:30.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:30.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:31.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:31.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:32.542 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:42:32.543+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:42:32.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:32.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:33.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:33.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:34.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:34.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:35.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:35.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:36.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:36.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:37.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:42:37.544+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:42:37.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:37.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:38.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:38.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:39.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:39.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:40.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:40.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:41.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:41.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:42.544 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:42:42.545+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:42:42.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:42.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:43.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:43.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:44.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:44.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:45.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:45.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:46.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:46.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:47.545 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:42:47.546+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:42:47.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:47.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:48.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:48.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:49.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:49.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:50.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:50.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:51.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:51.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:52.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:42:52.547+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:42:52.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:52.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:53.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:53.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:54.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:54.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:55.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:55.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:57.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:57.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:57.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:42:57.549+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:42:57.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:57.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:42:59.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:42:59.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:00.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:00.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:01.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:01.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:01.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:01.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:02.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:43:02.549+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:43:02.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:02.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:03.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:03.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:04.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:04.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:06.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:06.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:07.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:07.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:07.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:43:07.550+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:43:08.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:08.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:09.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:09.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:10.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:10.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:11.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:11.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:12.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:12.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:12.553 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:43:12.551+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:43:13.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:13.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:14.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:14.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:15.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:15.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:16.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:16.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:17.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:17.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:17.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:43:17.552+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:43:18.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:18.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:19.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:19.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:20.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:20.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:21.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:21.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:22.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:22.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:22.553 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:43:22.554+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:43:23.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:23.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:24.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:24.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:25.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:25.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:26.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:26.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:27.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:27.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:27.553 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:43:27.554+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:43:28.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:28.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:29.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:29.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:30.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:30.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:31.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:31.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:32.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:32.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:32.554 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:43:32.555+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:43:33.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:33.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:34.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:34.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:35.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:35.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:36.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:36.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:37.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:37.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:37.556 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:43:37.556+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:43:38.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:38.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:39.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:39.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:40.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:40.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:41.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:41.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:42.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:42.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:42.556 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:43:42.557+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:43:43.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:43.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:44.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:44.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:45.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:45.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:46.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:46.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:47.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:47.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:47.557 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:43:47.558+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:43:48.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:48.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:49.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:49.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:50.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:50.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:51.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:51.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:52.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:52.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:52.558 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:43:52.559+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:43:53.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:53.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:54.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:54.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:55.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:55.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:56.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:56.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:57.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:57.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:57.559 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:43:57.560+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:43:58.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:58.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:43:59.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:43:59.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:00.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:00.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:01.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:01.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:02.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:02.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:02.560 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:44:02.561+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:44:03.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:03.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:04.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:04.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:05.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:05.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:06.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:06.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:07.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:44:07.562+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:44:07.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:07.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:08.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:08.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:09.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:09.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:10.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:10.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:11.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:11.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:12.562 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:44:12.563+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:44:12.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:12.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:13.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:13.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:14.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:14.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:15.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:15.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:16.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:16.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:17.564 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:44:17.565+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:44:17.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:17.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:18.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:18.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:19.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:19.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:20.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:20.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:21.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:21.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:22.565 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:44:22.566+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:44:22.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:22.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:23.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:23.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:24.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:24.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:25.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:25.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:26.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:26.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:27.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:44:27.568+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:44:27.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:27.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:28.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:28.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:29.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:29.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:30.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:30.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:31.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:31.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:32.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:44:32.569+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:44:32.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:32.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:33.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:33.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:34.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:34.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:35.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:35.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:36.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:36.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:37.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:44:37.569+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:44:37.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:37.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:38.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:38.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:39.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:39.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:40.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:40.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:41.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:41.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:42.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:44:42.570+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:44:42.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:42.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:43.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:43.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:44.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:44.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:45.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:45.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:46.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:46.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:47.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:44:47.571+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:44:47.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:47.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:48.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:48.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:49.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:49.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:50.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:50.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:51.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:51.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:52.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:44:52.571+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:44:52.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:52.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:53.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:53.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:54.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:54.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:55.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:55.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:56.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:56.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:57.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:44:57.572+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:44:57.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:57.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:58.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:58.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:44:59.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:44:59.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:00.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:00.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:01.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:01.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:02.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:45:02.573+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:45:02.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:02.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:03.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:03.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:04.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:04.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:05.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:05.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:06.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:06.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:07.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:45:07.573+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:45:07.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:07.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:08.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:08.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:09.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:09.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:10.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:10.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:11.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:11.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:12.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:45:12.575+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:45:12.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:12.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:13.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:13.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:14.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:14.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:15.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:15.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:16.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:16.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:17.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:45:17.575+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:45:17.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:17.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:18.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:18.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:19.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:19.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:20.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:20.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:21.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:21.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:22.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:45:22.576+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:45:22.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:22.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:23.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:23.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:24.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:24.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:25.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:25.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:26.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:26.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:27.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:45:27.577+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:45:27.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:27.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:28.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:28.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:29.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:29.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:30.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:30.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:31.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:31.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:32.577 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:45:32.578+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:45:32.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:32.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:33.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:33.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:34.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:34.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:35.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:35.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:36.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:36.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:37.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:45:37.579+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:45:37.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:37.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:38.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:38.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:39.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:39.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:40.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:40.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:41.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:41.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:42.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:45:42.580+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:45:42.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:42.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:43.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:43.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:44.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:44.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:45.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:45.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:46.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:46.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:47.580 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:45:47.581+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:45:47.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:47.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:48.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:48.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:49.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:49.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:50.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:50.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:51.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:51.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:52.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:45:52.582+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:45:52.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:52.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:53.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:53.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:54.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:54.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:55.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:55.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:56.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:56.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:57.582 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:45:57.583+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:45:57.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:57.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:58.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:58.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:45:59.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:45:59.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:00.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:00.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:01.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:01.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:02.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:46:02.584+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:46:02.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:02.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:03.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:03.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:04.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:04.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:05.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:05.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:06.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:06.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:07.584 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:46:07.585+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:46:07.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:07.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:08.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:08.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:09.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:09.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:10.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:10.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:11.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:11.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:12.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:46:12.587+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:46:12.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:12.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:13.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:13.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:14.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:14.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:15.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:15.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:16.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:16.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:17.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:46:17.587+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:46:17.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:17.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:18.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:18.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:19.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:19.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:20.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:20.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:21.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:21.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:22.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:46:22.588+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:46:22.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:22.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:23.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:23.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:24.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:24.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:25.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:25.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:26.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:26.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:27.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:46:27.589+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:46:28.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:28.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:29.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:29.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:30.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:30.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:30.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:30.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:31.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:31.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:32.589 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:46:32.590+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:46:32.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:32.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:33.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:33.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:35.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:35.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:36.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:36.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:37.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:37.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:37.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:46:37.591+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:46:38.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:38.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:39.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:39.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:40.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:40.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:41.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:41.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:42.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:42.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:42.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:46:42.592+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:46:43.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:43.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:44.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:44.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:45.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:45.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:46.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:46.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:47.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:47.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:48.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:48.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:49.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:49.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:50.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:50.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:51.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:51.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:52.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:52.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:52.593 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:46:52.594+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:46:53.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:53.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:54.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:54.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:55.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:55.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:56.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:56.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:57.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:57.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:57.594 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:46:57.595+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:46:58.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:58.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:46:59.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:46:59.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:00.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:00.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:01.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:01.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:02.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:02.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:02.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:47:02.596+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:47:03.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:03.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:04.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:04.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:05.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:05.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:06.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:06.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:07.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:07.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:07.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:47:07.598+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:47:08.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:08.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:09.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:09.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:10.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:10.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:11.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:11.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:12.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:12.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:12.597 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:47:12.598+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:47:13.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:13.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:14.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:14.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:15.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:15.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:16.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:16.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:17.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:17.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:17.598 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:47:17.599+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:47:18.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:18.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:19.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:19.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:20.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:20.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:21.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:21.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:22.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:22.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:22.600 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:47:22.601+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:47:23.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:23.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:24.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:24.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:25.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:25.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:26.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:26.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:27.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:27.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:27.600 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:47:27.602+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:47:28.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:28.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:29.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:29.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:30.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:30.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:31.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:31.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:32.601 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:47:32.603+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:47:32.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:32.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:33.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:33.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:34.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:34.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:35.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:35.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:36.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:36.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:37.602 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:47:37.604+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:47:37.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:37.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:38.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:38.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:39.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:39.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:40.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:40.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:41.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:41.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:42.603 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:47:42.604+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:47:42.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:42.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:43.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:43.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:44.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:44.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:45.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:45.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:46.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:46.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:47.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:47.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:47.603 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:47:47.604+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:47:48.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:48.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:49.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:49.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:50.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:50.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:51.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:51.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:52.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:52.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:52.605 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:47:52.606+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:47:53.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:53.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:54.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:54.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:55.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:55.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:56.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:56.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:57.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:57.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:57.606 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:47:57.606+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:47:58.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:58.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:47:59.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:47:59.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:00.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:00.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:01.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:01.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:02.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:02.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:02.607 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:48:02.608+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:48:03.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:03.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:04.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:04.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:05.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:05.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:06.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:06.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:07.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:07.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:07.607 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:48:07.608+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:48:08.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:08.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:09.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:09.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:10.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:10.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:11.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:11.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:12.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:12.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:12.609 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:48:12.609+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:48:13.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:13.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:14.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:14.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:15.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:15.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:16.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:16.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:17.609 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:48:17.610+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:48:17.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:17.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:18.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:18.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:19.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:19.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:20.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:20.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:21.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:21.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:22.610 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:48:22.611+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:48:22.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:22.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:23.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:23.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:24.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:24.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:25.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:25.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:26.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:26.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:27.611 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:48:27.612+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:48:27.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:27.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:28.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:28.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:29.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:29.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:30.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:30.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:31.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:31.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:32.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:48:32.613+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:48:32.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:32.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:33.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:33.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:34.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:34.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:35.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:35.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:36.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:36.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:37.613 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:48:37.614+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:48:37.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:37.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:38.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:38.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:39.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:39.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:40.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:40.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:41.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:41.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:42.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:48:42.615+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:48:42.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:42.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:43.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:43.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:44.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:44.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:45.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:45.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:46.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:46.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:47.615 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:48:47.616+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:48:47.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:47.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:48.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:48.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:49.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:49.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:50.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:50.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:51.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:51.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:52.616 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:48:52.616+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:48:52.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:52.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:53.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:53.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:55.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:55.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:56.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:56.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:57.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:57.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:57.617 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:48:57.618+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:48:58.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:58.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:48:59.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:48:59.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:00.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:00.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:00.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:00.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:01.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:02.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:02.619 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:49:02.619+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:49:03.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:03.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:04.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:04.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:04.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:04.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:06.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:06.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:07.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:07.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:07.620 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:49:07.621+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:49:08.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:08.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:09.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:09.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:10.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:10.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:11.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:11.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:12.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:12.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:12.621 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:49:12.622+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:49:13.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:13.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:14.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:14.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:15.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:15.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:16.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:16.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:17.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:17.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:17.621 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:49:17.622+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:49:18.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:18.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:19.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:19.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:20.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:20.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:21.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:21.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:22.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:22.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:22.622 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:49:22.623+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:49:23.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:23.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:24.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:24.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:25.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:25.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:26.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:26.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:27.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:27.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:27.624 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:49:27.625+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:49:28.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:28.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:29.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:29.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:30.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:30.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:30.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:30.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:31.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:31.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:32.625 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:49:32.626+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:49:32.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:32.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:33.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:33.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:34.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:34.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:35.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:35.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:36.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:36.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:37.626 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:49:37.627+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:49:37.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:37.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:39.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:39.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:39.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:39.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:40.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:40.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:41.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:41.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:42.626 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:49:42.627+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:49:42.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:42.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:44.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:44.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:45.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:45.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:46.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:46.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:47.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:47.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:47.627 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:49:47.628+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:49:48.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:48.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:49.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:49.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:50.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:50.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:51.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:51.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:52.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:52.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:52.628 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:49:52.629+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:49:53.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:53.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:54.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:54.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:55.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:55.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:56.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:56.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:57.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:57.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:57.629 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:49:57.630+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:49:58.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:58.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:49:59.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:49:59.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:00.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:00.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:00.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:00.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:01.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:01.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:02.630 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:50:02.631+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:50:02.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:02.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:03.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:03.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:05.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:05.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:06.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:06.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:07.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:07.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:07.631 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:50:07.632+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:50:08.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:08.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:09.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:09.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:10.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:10.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:11.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:11.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:12.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:12.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:12.632 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:50:12.633+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:50:13.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:13.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:14.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:14.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:15.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:15.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:16.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:16.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:17.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:17.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:17.633 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:50:17.634+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:50:18.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:18.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:19.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:19.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:20.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:20.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:21.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:21.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:22.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:22.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:22.634 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:50:22.636+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:50:23.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:23.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:24.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:24.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:25.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:25.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:26.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:26.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:27.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:27.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:27.637 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:50:27.636+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:50:28.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:28.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:29.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:29.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:30.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:30.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:31.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:31.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:32.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:32.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:32.637 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:50:32.639+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:50:33.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:33.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:34.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:34.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:35.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:35.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:36.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:36.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:37.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:37.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:37.638 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:50:37.640+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:50:38.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:38.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:39.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:39.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:40.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:40.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:41.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:41.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:42.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:42.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:42.638 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:50:42.639+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:50:43.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:43.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:44.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:44.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:45.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:45.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:46.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:46.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:47.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:47.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:47.639 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:50:47.640+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:50:48.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:48.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:49.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:49.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:50.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:50.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:51.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:51.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:52.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:52.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:52.641 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:50:52.642+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:50:53.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:53.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:54.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:54.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:55.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:55.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:56.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:56.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:57.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:57.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:57.642 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:50:57.643+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:50:58.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:58.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:50:59.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:50:59.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:00.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:00.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:01.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:01.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:02.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:02.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:02.643 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:51:02.643+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:51:03.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:03.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:04.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:04.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:05.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:05.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:06.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:06.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:07.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:07.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:07.643 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:51:07.644+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:51:08.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:08.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:09.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:09.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:10.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:10.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:11.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:11.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:12.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:12.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:12.644 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:51:12.645+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:51:13.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:13.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:14.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:14.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:15.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:15.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:16.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:16.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:17.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:17.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:17.646 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:51:17.647+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:51:18.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:18.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:19.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:19.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:20.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:20.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:21.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:21.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:22.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:22.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:22.647 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:51:22.648+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:51:23.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:23.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:24.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:24.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:25.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:25.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:26.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:26.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:27.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:27.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:27.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:51:27.649+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:51:28.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:28.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:29.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:29.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:30.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:30.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:31.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:31.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:32.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:32.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:32.649 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:51:32.650+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:51:33.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:33.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:34.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:34.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:35.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:35.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:36.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:36.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:37.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:37.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:37.650 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:51:37.651+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:51:37.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:37.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:39.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:39.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:40.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:40.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:41.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:41.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:42.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:42.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:42.650 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:51:42.651+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:51:43.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:43.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:44.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:44.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:45.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:45.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:46.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:46.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:47.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:47.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:47.651 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:51:47.652+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:51:48.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:48.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:49.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:49.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:50.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:50.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:51.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:51.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:52.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:52.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:52.653 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:51:52.654+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:51:53.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:53.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:54.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:54.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:55.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:55.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:56.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:56.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:57.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:57.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:57.653 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:51:57.654+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:51:58.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:58.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:51:59.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:51:59.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:00.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:00.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:01.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:01.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:02.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:02.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:02.655 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:52:02.655+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:52:03.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:03.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:04.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:04.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:05.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:05.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:06.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:06.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:07.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:07.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:07.655 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:52:07.656+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:52:08.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:08.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:09.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:09.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:10.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:10.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:11.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:11.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:12.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:12.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:12.657 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:52:12.658+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:52:13.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:13.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:14.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:14.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:15.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:15.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:16.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:16.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:17.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:17.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:17.657 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:52:17.658+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:52:18.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:18.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:19.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:19.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:20.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:20.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:21.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:21.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:22.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:22.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:22.658 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:52:22.659+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:52:23.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:23.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:24.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:24.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:25.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:25.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:26.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:26.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:27.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:27.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:27.659 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:52:27.660+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:52:28.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:28.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:29.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:29.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:30.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:30.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:31.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:31.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:32.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:32.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:32.660 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:52:32.661+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:52:33.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:33.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:34.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:34.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:35.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:35.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:36.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:36.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:37.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:37.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:37.661 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:52:37.662+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:52:38.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:38.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:39.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:39.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:40.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:40.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:41.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:41.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:42.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:42.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:42.663 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:52:42.663+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:52:43.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:43.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:44.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:44.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:45.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:45.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:46.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:46.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:47.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:47.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:47.664 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:52:47.665+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:52:48.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:48.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:49.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:49.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:50.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:50.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:51.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:51.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:52.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:52.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:52.665 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:52:52.666+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:52:53.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:53.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:54.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:54.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:55.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:55.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:56.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:56.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:57.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:57.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:57.665 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:52:57.666+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:52:58.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:58.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:52:59.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:52:59.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:00.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:00.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:01.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:01.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:02.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:02.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:02.666 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:53:02.667+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:53:03.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:03.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:04.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:04.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:05.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:05.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:06.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:06.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:07.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:07.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:07.667 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:53:07.668+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:53:08.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:08.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:09.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:09.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:10.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:10.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:11.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:11.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:12.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:12.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:12.670 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:53:12.669+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:53:13.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:13.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:14.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:14.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:15.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:15.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:16.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:16.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:17.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:17.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:17.670 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:53:17.670+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:53:18.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:18.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:19.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:19.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:20.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:20.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:21.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:21.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:22.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:22.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:22.671 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:53:22.671+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:53:23.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:23.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:24.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:24.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:25.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:25.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:26.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:26.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:27.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:27.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:27.671 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:53:27.672+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:53:28.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:28.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:29.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:29.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:30.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:30.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:31.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:31.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:32.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:32.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:32.672 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:53:32.673+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:53:33.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:33.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:34.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:34.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:35.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:35.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:36.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:36.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:37.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:37.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:37.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:53:37.675+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:53:38.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:38.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:39.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:39.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:40.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:40.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:41.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:41.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:42.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:42.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:42.674 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:53:42.676+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:53:43.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:43.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:44.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:44.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:45.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:45.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:46.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:46.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:47.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:47.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:47.675 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:53:47.676+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:53:48.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:48.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:49.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:49.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:50.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:50.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:51.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:51.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:52.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:52.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:52.675 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:53:52.676+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:53:53.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:53.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:54.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:54.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:55.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:55.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:56.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:56.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:57.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:57.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:57.676 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:53:57.677+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:53:58.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:58.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:53:59.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:53:59.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:00.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:00.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:01.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:01.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:02.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:02.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:02.678 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:54:02.679+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:54:03.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:03.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:04.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:04.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:05.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:05.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:06.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:06.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:07.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:07.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:07.679 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:54:07.680+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:54:08.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:08.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:09.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:09.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:10.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:10.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:11.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:11.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:12.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:12.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:13.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:13.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:14.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:14.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:15.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:15.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:16.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:16.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:16.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:54:16.465+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:54:17.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:17.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:18.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:18.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:19.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:19.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:20.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:20.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:21.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:21.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:21.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:54:21.466+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:54:22.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:22.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:23.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:23.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:24.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:24.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:25.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:25.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:26.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:26.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:26.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:54:26.467+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:54:27.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:27.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:28.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:28.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:29.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:29.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:30.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:30.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:31.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:31.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:31.467 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:54:31.468+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:54:32.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:32.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:33.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:33.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:34.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:34.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:35.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:35.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:36.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:36.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:36.468 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:54:36.469+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:54:37.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:37.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:38.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:38.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:39.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:39.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:40.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:40.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:41.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:41.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:41.470 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:54:41.471+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:54:42.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:42.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:43.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:43.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:43.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:43.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:44.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:44.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:46.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:46.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:46.471 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:54:46.472+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:54:46.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:46.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:47.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:47.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:49.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:49.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:50.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:50.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:51.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:51.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:51.472 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:54:51.473+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:54:52.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:52.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:53.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:53.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:54.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:54.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:55.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:55.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:56.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:56.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:56.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:54:56.474+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:54:57.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:57.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:58.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:58.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:54:59.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:54:59.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:00.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:00.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:01.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:01.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:01.474 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:55:01.475+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:55:02.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:02.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:03.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:03.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:04.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:04.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:05.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:05.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:06.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:06.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:06.475 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:55:06.476+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:55:07.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:07.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:08.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:08.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:09.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:09.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:10.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:10.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:11.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:11.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:11.475 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:55:11.476+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:55:12.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:12.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:13.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:13.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:14.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:14.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:15.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:15.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:16.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:16.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:16.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:55:16.477+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:55:17.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:17.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:18.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:18.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:19.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:19.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:20.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:20.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:20.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:20.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:21.478 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:55:21.478+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:55:22.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:22.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:23.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:23.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:24.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:24.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:25.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:25.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:26.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:26.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:26.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:55:26.480+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:55:27.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:27.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:28.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:28.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:29.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:29.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:30.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:30.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:31.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:31.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:31.480 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:55:31.481+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:55:32.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:32.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:33.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:33.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:34.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:34.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:35.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:35.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:36.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:36.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:36.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:55:36.483+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:55:37.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:37.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:38.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:38.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:39.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:39.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:40.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:40.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:41.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:41.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:41.484 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:55:41.485+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:55:42.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:42.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:43.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:43.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:44.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:44.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:45.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:45.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:46.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:46.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:46.485 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:55:46.486+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:55:47.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:47.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:48.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:48.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:49.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:49.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:50.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:50.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:51.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:51.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:51.486 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:55:51.487+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:55:52.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:52.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:53.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:53.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:54.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:54.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:55.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:55.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:56.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:56.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:56.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:55:56.488+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:55:57.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:57.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:58.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:58.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:55:59.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:55:59.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:00.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:00.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:01.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:01.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:01.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:56:01.489+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:56:02.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:02.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:03.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:03.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:04.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:04.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:05.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:05.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:06.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:06.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:06.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:56:06.491+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:56:07.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:07.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:08.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:08.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:09.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:09.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:10.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:10.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:11.491 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:56:11.492+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:56:11.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:11.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:12.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:12.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:13.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:13.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:14.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:14.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:15.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:15.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:16.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:16.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:16.493 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:56:16.493+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:56:17.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:17.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:18.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:18.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:19.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:19.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:20.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:20.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:21.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:21.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:21.493 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:56:21.495+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:56:22.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:22.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:23.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:23.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:24.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:24.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:25.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:25.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:26.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:26.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:26.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:56:26.496+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:56:27.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:27.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:28.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:28.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:29.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:29.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:30.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:30.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:31.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:31.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:31.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:56:31.496+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:56:32.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:32.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:33.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:33.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:34.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:34.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:35.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:35.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:36.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:36.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:36.497 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:56:36.499+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:56:37.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:37.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:38.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:38.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:39.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:39.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:40.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:40.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:41.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:41.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:41.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:56:41.500+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:56:42.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:42.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:43.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:43.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:44.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:44.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:45.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:45.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:46.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:46.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:46.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:56:46.500+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:56:47.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:47.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:48.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:48.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:49.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:49.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:50.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:50.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:51.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:51.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:51.501 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:56:51.502+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:56:52.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:52.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:53.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:53.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:54.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:54.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:55.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:55.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:56.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:56.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:56.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:56:56.504+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:56:57.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:57.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:58.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:58.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:56:59.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:56:59.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:00.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:00.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:01.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:01.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:01.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:57:01.505+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:57:02.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:02.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:03.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:03.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:04.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:04.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:05.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:05.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:06.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:06.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:06.505 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:57:06.506+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:57:07.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:07.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:08.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:08.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:09.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:09.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:10.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:10.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:11.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:11.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:11.507 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:57:11.508+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:57:12.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:12.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:13.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:13.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:14.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:14.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:15.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:15.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:16.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:16.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:16.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:57:16.510+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:57:17.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:17.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:18.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:18.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:19.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:19.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:20.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:20.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:21.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:21.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:21.510 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:57:21.511+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:57:22.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:22.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:23.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:23.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:24.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:24.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:25.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:25.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:26.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:26.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:26.511 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:57:26.512+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:57:27.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:27.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:28.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:28.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:29.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:29.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:30.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:30.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:31.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:31.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:31.513 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:57:31.514+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:57:32.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:32.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:33.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:33.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:34.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:34.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:35.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:35.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:36.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:36.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:37.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:37.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:37.720 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:57:37.721+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:57:38.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:38.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:39.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:39.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:40.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:40.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:41.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:41.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:42.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:42.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:43.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:43.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:44.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:44.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:45.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:45.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:46.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:46.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:47.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:47.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:47.723 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:57:47.723+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:57:48.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:48.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:49.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:49.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:50.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:50.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:51.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:51.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:52.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:52.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:52.723 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:57:52.724+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:57:53.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:53.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:54.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:54.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:55.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:55.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:56.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:56.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:57.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:57.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:57.723 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:57:57.724+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:57:58.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:58.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:57:59.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:57:59.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:00.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:00.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:01.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:01.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:02.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:02.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:02.724 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:58:02.725+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:58:03.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:03.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:04.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:04.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:05.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:05.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:06.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:06.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:07.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:07.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:07.725 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:58:07.726+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:58:08.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:08.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:09.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:09.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:10.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:10.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:11.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:11.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:12.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:12.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:12.726 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:58:12.727+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:58:13.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:13.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:14.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:14.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:15.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:15.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:16.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:16.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:17.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:17.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:17.727 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:58:17.728+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:58:18.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:18.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:19.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:19.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:20.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:20.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:21.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:21.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:22.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:22.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:22.729 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:58:22.729+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:58:23.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:23.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:24.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:24.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:25.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:25.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:26.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:26.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:27.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:27.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:27.729 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:58:27.730+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:58:28.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:28.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:29.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:29.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:30.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:30.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:31.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:31.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:32.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:32.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:32.730 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:58:32.731+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:58:33.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:33.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:34.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:34.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:35.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:35.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:36.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:36.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:37.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:37.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:37.732 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:58:37.733+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:58:38.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:38.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:39.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:39.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:40.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:40.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:41.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:41.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:42.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:42.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:42.732 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:58:42.733+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:58:43.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:43.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:44.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:44.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:45.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:45.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:46.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:46.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:47.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:47.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:47.733 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:58:47.734+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:58:48.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:48.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:49.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:49.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:50.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:50.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:51.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:51.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:52.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:52.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:52.734 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:58:52.735+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:58:53.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:53.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:54.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:54.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:55.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:55.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:56.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:56.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:57.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:57.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:57.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:58:57.736+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:58:58.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:58.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:58:59.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:58:59.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:00.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:00.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:01.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:01.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:02.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:02.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:02.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:59:02.737+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:59:03.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:03.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:04.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:04.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:05.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:05.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:06.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:06.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:07.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:07.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:07.737 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:59:07.738+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:59:08.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:08.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:09.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:09.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:10.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:10.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:11.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:11.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:12.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:12.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:12.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:59:12.740+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:59:13.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:13.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:14.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:14.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:15.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:15.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:16.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:16.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:17.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:17.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:17.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:59:17.740+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:59:18.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:18.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:19.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:19.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:20.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:20.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:21.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:21.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:22.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:22.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:22.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:59:22.742+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:59:23.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:23.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:24.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:24.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:25.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:25.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:26.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:26.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:27.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:27.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:27.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:59:27.742+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:59:28.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:28.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:29.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:29.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:30.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:30.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:31.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:31.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:32.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:32.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:32.743 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:59:32.743+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:59:33.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:33.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:34.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:34.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:35.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:35.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:36.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:36.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:37.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:37.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:37.743 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:59:37.745+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:59:38.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:38.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:39.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:39.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:40.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:40.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:41.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:41.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:42.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:42.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:42.744 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:59:42.746+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:59:43.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:43.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:44.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:44.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:45.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:45.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:46.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:46.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:47.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:59:47.746+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:59:47.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:47.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:48.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:48.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:49.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:49.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:50.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:50.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:51.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:51.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:52.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:52.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:52.746 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:59:52.747+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:59:53.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:53.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:54.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:54.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:55.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:55.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:56.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:56.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:57.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:57.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:57.746 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T06:59:57.747+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T06:59:58.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:58.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T06:59:59.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T06:59:59.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:00.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:00.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:01.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:01.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:02.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:02.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:02.747 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:00:02.748+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:00:03.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:03.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:04.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:04.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:05.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:05.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:06.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:06.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:07.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:07.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:07.749 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:00:07.750+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:00:08.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:08.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:09.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:09.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:10.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:10.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:11.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:11.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:12.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:12.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:12.750 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:00:12.750+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:00:13.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:13.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:14.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:14.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:15.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:15.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:16.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:16.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:17.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:17.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:17.751 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:00:17.752+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:00:18.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:18.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:19.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:19.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:20.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:20.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:21.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:21.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:22.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:22.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:22.751 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:00:22.753+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:00:23.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:23.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:24.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:24.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:25.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:25.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:26.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:26.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:27.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:27.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:27.752 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:00:27.753+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:00:28.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:28.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:29.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:29.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:30.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:30.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:31.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:31.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:32.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:32.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:32.753 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:00:32.754+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:00:33.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:33.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:34.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:34.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:35.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:35.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:36.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:36.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:37.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:37.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:37.754 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:00:37.755+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:00:38.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:38.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:39.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:39.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:40.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:40.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:41.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:41.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:42.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:42.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:42.756 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:00:42.757+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:00:43.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:43.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:44.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:44.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:45.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:45.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:46.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:46.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:47.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:47.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:47.756 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:00:47.757+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:00:48.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:48.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:49.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:49.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:50.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:50.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:51.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:51.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:52.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:52.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:52.758 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:00:52.758+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:00:53.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:53.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:54.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:54.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:55.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:55.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:56.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:56.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:57.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:57.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:57.758 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:00:57.759+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:00:58.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:58.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:00:59.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:00:59.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:00.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:00.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:01.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:01.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:02.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:02.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:02.759 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:01:02.760+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:01:03.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:03.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:04.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:04.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:05.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:05.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:06.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:06.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:07.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:07.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:07.760 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:01:07.761+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:01:08.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:08.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:09.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:09.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:10.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:10.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:11.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:11.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:12.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:12.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:12.761 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:01:12.762+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:01:13.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:13.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:14.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:14.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:15.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:15.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:16.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:16.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:17.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:17.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:17.763 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:01:17.764+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:01:18.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:18.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:19.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:19.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:20.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:20.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:21.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:21.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:22.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:22.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:22.765 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:01:22.765+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:01:23.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:23.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:24.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:24.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:25.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:25.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:26.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:26.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:27.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:27.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:27.765 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:01:27.765+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:01:28.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:28.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:29.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:29.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:30.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:30.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:31.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:31.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:32.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:32.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:32.765 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:01:32.766+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:01:33.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:33.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:34.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:34.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:35.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:35.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:36.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:36.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:37.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:37.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:37.766 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:01:37.767+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:01:38.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:38.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:39.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:39.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:40.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:40.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:41.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:41.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:42.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:42.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:42.767 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:01:42.768+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:01:43.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:43.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:44.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:44.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:45.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:45.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:46.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:46.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:47.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:47.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:47.768 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:01:47.769+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:01:48.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:48.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:49.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:49.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:50.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:50.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:51.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:51.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:52.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:52.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:52.770 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:01:52.771+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:01:53.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:53.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:54.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:54.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:55.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:55.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:56.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:56.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:57.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:57.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:57.771 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:01:57.772+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:01:58.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:58.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:01:59.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:01:59.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:00.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:00.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:01.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:01.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:02.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:02.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:02.772 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:02:02.773+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:02:03.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:03.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:04.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:04.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:05.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:05.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:06.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:06.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:07.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:07.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:07.772 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:02:07.773+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:02:08.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:08.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:09.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:09.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:10.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:10.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:11.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:11.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:12.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:12.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:12.773 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:02:12.774+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:02:13.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:13.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:14.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:14.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:15.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:15.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:16.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:16.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:17.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:17.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:17.774 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:02:17.775+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:02:18.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:18.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:19.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:19.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:20.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:20.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:21.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:21.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:22.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:22.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:22.775 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:02:22.776+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:02:23.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:23.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:24.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:24.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:25.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:25.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:26.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:26.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:27.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:27.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:27.776 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:02:27.777+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:02:28.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:28.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:29.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:29.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:30.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:30.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:31.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:31.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:32.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:32.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:32.777 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:02:32.778+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:02:33.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:33.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:34.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:34.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:35.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:35.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:36.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:36.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:37.778 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:02:37.780+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:02:37.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:37.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:38.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:38.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:39.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:39.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:40.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:40.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:41.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:41.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:42.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:42.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:42.779 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:02:42.781+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:02:43.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:43.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:44.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:44.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:45.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:45.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:46.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:46.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:47.780 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:02:47.782+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:02:47.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:47.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:48.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:48.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:49.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:49.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:50.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:50.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:51.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:51.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:52.781 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:02:52.782+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:02:52.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:52.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:53.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:53.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:54.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:54.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:55.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:55.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:56.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:56.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:57.782 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:02:57.783+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:02:57.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:57.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:58.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:58.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:02:59.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:02:59.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:00.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:00.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:01.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:01.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:02.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:02.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:02.782 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:03:02.783+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:03:03.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:03.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:04.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:04.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:05.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:05.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:06.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:06.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:07.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:07.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:07.784 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:03:07.785+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:03:08.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:08.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:09.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:09.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:10.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:10.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:11.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:11.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:12.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:12.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:12.784 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:03:12.785+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:03:13.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:13.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:14.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:14.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:15.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:15.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:16.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:16.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:17.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:17.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:17.785 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:03:17.786+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:03:18.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:18.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:19.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:19.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:20.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:20.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:21.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:21.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:22.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:22.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:22.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:03:22.787+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:03:23.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:23.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:24.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:24.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:25.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:25.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:26.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:26.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:27.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:27.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:27.787 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:03:27.788+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:03:28.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:28.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:29.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:29.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:30.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:30.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:31.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:31.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:32.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:32.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:32.788 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:03:32.789+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:03:33.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:33.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:34.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:34.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:35.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:35.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:36.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:36.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:37.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:37.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:37.789 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:03:37.790+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:03:38.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:38.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:39.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:39.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:40.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:40.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:41.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:41.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:42.791 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:03:42.791+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:03:42.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:42.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:43.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:43.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:44.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:44.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:45.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:45.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:46.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:46.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:47.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:47.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:47.791 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:03:47.792+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:03:48.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:48.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:49.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:49.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:50.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:50.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:51.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:51.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:52.792 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:03:52.793+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:03:52.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:52.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:53.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:53.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:54.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:54.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:55.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:55.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:56.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:56.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:57.793 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:03:57.794+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:03:57.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:57.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:58.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:58.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:03:59.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:03:59.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:00.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:00.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:01.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:01.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:02.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:02.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:02.794 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:04:02.795+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:04:03.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:03.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:04.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:04.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:05.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:05.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:06.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:06.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:07.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:07.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:07.796 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:04:07.796+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:04:08.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:08.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:09.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:09.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:10.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:10.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:11.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:11.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:12.797 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:04:12.797+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:04:12.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:12.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:13.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:13.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:14.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:14.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:15.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:15.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:16.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:16.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:17.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:17.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:17.797 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:04:17.798+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:04:18.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:18.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:19.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:19.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:20.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:20.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:21.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:21.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:22.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:22.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:22.798 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:04:22.799+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:04:23.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:23.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:24.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:24.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:25.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:25.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:26.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:26.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:27.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:27.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:27.799 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:04:27.800+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:04:28.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:28.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:29.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:29.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:30.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:30.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:31.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:31.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:32.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:32.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:32.800 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:04:32.801+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:04:33.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:33.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:34.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:34.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:35.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:35.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:36.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:36.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:37.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:37.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:37.801 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:04:37.802+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:04:38.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:38.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:39.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:39.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:40.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:40.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:41.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:41.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:42.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:42.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:42.802 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:04:42.803+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:04:43.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:43.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:44.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:44.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:45.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:45.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:46.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:46.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:47.803 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:04:47.804+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:04:47.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:47.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:48.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:48.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:49.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:49.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:50.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:50.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:51.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:51.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:52.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:52.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:52.805 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:04:52.806+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:04:53.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:53.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:54.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:54.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:55.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:55.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:56.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:56.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:57.806 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:04:57.806+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:04:57.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:57.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:58.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:58.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:04:59.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:04:59.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:00.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:00.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:01.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:01.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:02.806 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:05:02.807+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:05:02.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:02.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:03.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:03.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:04.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:04.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:05.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:05.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:06.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:06.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:07.812 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:05:07.809+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:05:07.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:07.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:08.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:08.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:09.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:09.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:10.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:10.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:11.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:11.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:12.809 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:05:12.809+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:05:12.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:12.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:13.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:13.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:14.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:14.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:15.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:15.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:16.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:16.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:17.809 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:05:17.810+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:05:17.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:17.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:18.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:18.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:19.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:19.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:20.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:20.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:21.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:21.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:22.811 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:05:22.812+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:05:22.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:22.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:23.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:23.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:24.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:24.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:25.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:25.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:26.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:26.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:27.812 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:05:27.812+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:05:27.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:27.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:28.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:28.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:29.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:29.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:30.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:30.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:31.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:31.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:32.812 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:05:32.813+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:05:32.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:32.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:33.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:33.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:34.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:34.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:35.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:35.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:36.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:36.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:37.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:37.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:37.814 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:05:37.815+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:05:38.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:38.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:39.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:39.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:40.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:40.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:41.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:41.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:42.815 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:05:42.817+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:05:42.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:42.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:43.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:43.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:44.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:44.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:45.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:45.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:46.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:46.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:47.816 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:05:47.818+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:05:47.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:47.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:48.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:48.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:49.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:49.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:50.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:50.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:51.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:51.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:52.817 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:05:52.817+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:05:52.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:52.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:53.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:53.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:54.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:54.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:55.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:55.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:56.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:56.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:57.817 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:05:57.818+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:05:57.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:57.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:58.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:58.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:05:59.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:05:59.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:00.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:00.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:01.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:01.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:02.818 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:06:02.819+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:06:02.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:02.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:03.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:03.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:04.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:04.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:05.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:05.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:06.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:06.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:07.819 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:06:07.819+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:06:07.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:07.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:08.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:08.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:09.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:09.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:10.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:10.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:11.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:11.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:12.820 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:06:12.821+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:06:13.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:13.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:14.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:14.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:15.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:15.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:15.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:15.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:16.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:16.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:17.821 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:06:17.821+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:06:17.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:17.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:18.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:18.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:19.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:19.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:20.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:20.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:21.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:21.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:22.822 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:06:22.822+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:06:22.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:22.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:23.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:23.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:24.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:24.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:25.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:25.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:26.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:26.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:27.822 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:06:27.823+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:06:27.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:27.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:28.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:28.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:29.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:29.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:30.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:30.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:31.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:31.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:32.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:32.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:32.823 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:06:32.824+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:06:33.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:33.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:34.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:34.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:35.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:35.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:36.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:36.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:37.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:37.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:37.824 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:06:37.825+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:06:38.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:38.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:39.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:39.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:40.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:40.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:41.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:41.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:42.825 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:06:42.826+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:06:42.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:42.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:43.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:43.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:44.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:44.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:45.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:45.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:46.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:46.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:47.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:47.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:47.826 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:06:47.827+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:06:48.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:48.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:49.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:49.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:50.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:50.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:51.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:51.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:52.827 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:06:52.828+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:06:52.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:52.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:53.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:53.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:54.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:54.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:55.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:55.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:56.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:56.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:57.828 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:06:57.829+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:06:57.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:57.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:58.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:58.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:06:59.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:06:59.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:00.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:00.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:01.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:01.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:02.829 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:07:02.830+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:07:02.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:02.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:03.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:03.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:04.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:04.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:05.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:05.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:06.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:06.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:07.830 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:07:07.831+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:07:07.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:07.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:08.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:08.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:09.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:09.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:10.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:10.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:11.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:11.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:12.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:12.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:12.832 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:07:12.833+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:07:13.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:13.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:14.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:14.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:15.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:15.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:16.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:16.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:17.832 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:07:17.833+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:07:17.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:17.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:18.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:18.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:19.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:19.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:20.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:20.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:21.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:21.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:22.833 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:07:22.834+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:07:22.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:22.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:23.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:23.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:24.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:24.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:25.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:25.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:26.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:26.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:27.834 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:07:27.835+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:07:27.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:27.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:28.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:28.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:29.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:29.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:30.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:30.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:31.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:31.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:32.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:32.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:32.835 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:07:32.836+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:07:33.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:33.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:34.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:34.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:35.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:35.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:36.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:36.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:37.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:37.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:37.837 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:07:37.838+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:07:38.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:38.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:39.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:39.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:40.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:40.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:41.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:41.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:42.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:42.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:42.837 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:07:42.838+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:07:43.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:43.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:44.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:44.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:45.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:45.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:46.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:46.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:47.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:47.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:47.838 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:07:47.839+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:07:48.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:48.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:49.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:49.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:50.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:50.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:51.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:51.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:52.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:52.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:52.840 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:07:52.841+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:07:53.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:53.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:54.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:54.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:55.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:55.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:56.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:56.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:57.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:57.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:57.840 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:07:57.841+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:07:58.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:58.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:07:59.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:07:59.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:00.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:00.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:01.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:01.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:02.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:02.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:02.841 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:08:02.843+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:08:03.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:03.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:04.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:04.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:05.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:05.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:06.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:06.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:07.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:07.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:07.843 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:08:07.844+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:08:08.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:08.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:09.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:09.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:10.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:10.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:11.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:11.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:12.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:12.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:12.843 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:08:12.844+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:08:13.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:13.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:14.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:14.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:15.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:15.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:16.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:16.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:17.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:17.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:17.844 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:08:17.845+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:08:18.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:18.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:19.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:19.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:20.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:20.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:21.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:21.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:22.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:22.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:22.846 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:08:22.847+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:08:23.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:23.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:24.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:24.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:25.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:25.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:26.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:26.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:27.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:27.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:27.846 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:08:27.847+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:08:28.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:28.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:29.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:29.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:30.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:30.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:31.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:31.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:32.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:32.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:32.848 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:08:32.849+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:08:33.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:33.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:34.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:34.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:35.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:35.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:36.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:36.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:37.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:37.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:37.849 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:08:37.849+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:08:38.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:38.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:39.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:39.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:40.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:40.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:41.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:41.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:42.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:42.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:42.849 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:08:42.851+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:08:43.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:43.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:44.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:44.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:45.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:45.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:46.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:46.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:47.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:47.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:47.850 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:08:47.852+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:08:48.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:48.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:49.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:49.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:50.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:50.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:51.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:51.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:52.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:52.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:52.851 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:08:52.852+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:08:53.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:53.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:54.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:54.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:55.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:55.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:56.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:56.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:57.852 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:08:57.853+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:08:57.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:57.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:58.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:58.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:08:59.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:08:59.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:00.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:00.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:01.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:01.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:02.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:02.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:03.052 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:09:02.853+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:09:03.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:03.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:04.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:04.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:05.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:05.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:06.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:06.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:07.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:07.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:07.854 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:09:07.855+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:09:08.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:08.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:09.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:09.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:10.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:10.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:11.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:11.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:12.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:12.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:12.855 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:09:12.856+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:09:13.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:13.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:14.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:14.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:15.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:15.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:16.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:16.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:17.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:17.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:17.856 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:09:17.857+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:09:18.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:18.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:19.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:19.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:20.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:20.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:21.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:21.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:22.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:22.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:22.857 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:09:22.858+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:09:23.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:23.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:24.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:24.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:25.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:25.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:26.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:26.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:27.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:27.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:27.858 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:09:27.859+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:09:28.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:28.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:29.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:29.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:30.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:30.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:31.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:31.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:32.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:32.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:32.858 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:09:32.859+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:09:33.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:33.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:34.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:34.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:35.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:35.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:36.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:36.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:37.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:37.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:37.859 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:09:37.860+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:09:38.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:38.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:39.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:39.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:40.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:40.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:41.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:41.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:42.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:42.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:42.860 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:09:42.861+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:09:43.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:43.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:44.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:44.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:45.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:45.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:46.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:46.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:47.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:47.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:47.861 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:09:47.862+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:09:48.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:48.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:49.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:49.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:50.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:50.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:51.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:51.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:52.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:52.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:52.862 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:09:52.863+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:09:53.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:53.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:54.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:54.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:55.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:55.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:56.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:56.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:57.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:57.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:57.863 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:09:57.864+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:09:58.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:58.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:09:59.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:09:59.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:00.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:00.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:01.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:01.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:02.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:02.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:02.865 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:10:02.866+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:10:03.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:03.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:04.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:04.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:05.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:05.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:06.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:06.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:07.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:07.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:07.865 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:10:07.866+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:10:08.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:08.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:09.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:09.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:10.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:10.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:11.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:11.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:12.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:12.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:12.867 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:10:12.867+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:10:13.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:13.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:14.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:14.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:15.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:15.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:16.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:16.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:17.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:17.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:17.867 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:10:17.868+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:10:18.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:18.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:19.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:19.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:20.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:20.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:21.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:21.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:22.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:22.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:22.868 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:10:22.869+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:10:23.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:23.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:24.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:24.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:25.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:25.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:26.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:26.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:27.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:27.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:27.870 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:10:27.871+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:10:28.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:28.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:29.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:29.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:30.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:30.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:31.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:31.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:32.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:32.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:32.871 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:10:32.872+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:10:33.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:33.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:34.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:34.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:35.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:35.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:36.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:36.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:37.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:37.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:37.871 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:10:37.872+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:10:38.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:38.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:39.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:39.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:40.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:40.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:41.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:41.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:42.873 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:10:42.874+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:10:42.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:42.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:43.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:43.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:44.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:44.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:45.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:45.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:46.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:46.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:47.874 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:10:47.875+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:10:47.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:47.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:48.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:48.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:49.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:49.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:50.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:50.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:51.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:51.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:52.875 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:10:52.876+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:10:52.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:52.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:53.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:53.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:54.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:54.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:55.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:55.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:56.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:56.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:57.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:57.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:57.875 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:10:57.877+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:10:58.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:58.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:10:59.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:10:59.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:00.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:00.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:01.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:01.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:02.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:02.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:02.876 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:11:02.877+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:11:03.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:03.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:04.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:04.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:05.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:05.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:06.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:06.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:07.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:07.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:07.877 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:11:07.878+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:11:08.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:08.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:09.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:09.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:10.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:10.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:11.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:11.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:12.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:12.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:12.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:11:12.879+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:11:13.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:13.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:14.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:14.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:15.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:15.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:16.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:16.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:17.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:17.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:17.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:11:17.880+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:11:18.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:18.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:19.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:19.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:20.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:20.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:21.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:21.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:22.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:22.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:22.880 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:11:22.881+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:11:23.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:23.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:24.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:24.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:25.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:25.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:26.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:26.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:27.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:27.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:27.882 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:11:27.883+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:11:28.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:28.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:29.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:29.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:30.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:30.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:31.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:31.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:32.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:32.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:32.882 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:11:32.883+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:11:33.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:33.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:34.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:34.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:35.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:35.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:36.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:36.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:37.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:37.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:37.884 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:11:37.885+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:11:38.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:38.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:39.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:39.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:40.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:40.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:41.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:41.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:42.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:42.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:42.884 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:11:42.886+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:11:43.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:43.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:44.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:44.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:45.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:45.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:46.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:46.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:47.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:47.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:47.886 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:11:47.887+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:11:48.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:48.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:49.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:49.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:50.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:50.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:51.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:51.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:52.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:52.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:52.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:11:52.889+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:11:53.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:53.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:54.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:54.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:55.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:55.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:56.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:56.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:57.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:57.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:57.891 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:11:57.889+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:11:58.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:58.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:11:59.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:11:59.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:00.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:00.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:01.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:01.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:02.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:02.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:02.889 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:12:02.890+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:12:03.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:03.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:04.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:04.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:05.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:05.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:06.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:06.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:07.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:07.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:07.890 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:12:07.890+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:12:08.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:08.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:09.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:09.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:10.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:10.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:11.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:11.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:12.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:12.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:12.890 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:12:12.891+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:12:13.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:13.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:14.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:14.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:15.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:15.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:16.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:16.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:17.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:17.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:17.892 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:12:17.892+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:12:18.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:18.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:19.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:19.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:20.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:20.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:21.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:21.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:22.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:22.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:22.893 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:12:22.894+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:12:23.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:23.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:24.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:24.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:25.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:25.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:26.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:26.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:27.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:27.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:27.894 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:12:27.895+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:12:28.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:28.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:29.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:29.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:30.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:30.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:31.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:31.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:32.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:32.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:32.895 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:12:32.895+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:12:33.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:33.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:34.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:34.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:35.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:35.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:36.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:36.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:37.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:37.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:37.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:12:37.896+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:12:38.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:38.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:39.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:39.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:40.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:40.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:41.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:41.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:42.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:42.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:42.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:12:42.898+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:12:43.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:43.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:44.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:44.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:45.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:45.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:46.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:46.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:47.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:47.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:47.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:12:47.899+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:12:48.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:48.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:49.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:49.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:50.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:50.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:51.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:51.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:52.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:52.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:52.899 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:12:52.900+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:12:53.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:53.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:54.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:54.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:55.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:55.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:56.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:56.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:57.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:57.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:57.900 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:12:57.900+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:12:58.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:58.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:12:59.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:12:59.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:00.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:00.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:01.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:01.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:02.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:02.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:02.900 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:13:02.901+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:13:03.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:03.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:04.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:04.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:05.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:05.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:06.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:06.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:07.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:07.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:07.902 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:13:07.903+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:13:08.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:08.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:09.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:09.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:10.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:10.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:11.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:11.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:12.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:12.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:12.903 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:13:12.904+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:13:13.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:13.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:14.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:14.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:15.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:15.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:16.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:16.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:17.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:17.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:17.908 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:13:17.905+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:13:18.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:18.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:19.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:19.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:20.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:20.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:21.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:21.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:22.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:22.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:22.905 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:13:22.906+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:13:23.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:23.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:24.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:24.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:25.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:25.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:26.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:26.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:27.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:27.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:27.906 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:13:27.907+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:13:28.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:28.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:29.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:29.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:30.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:30.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:31.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:31.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:32.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:32.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:32.907 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:13:32.908+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:13:33.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:33.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:34.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:34.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:35.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:35.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:36.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:36.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:37.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:37.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:37.908 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:13:37.909+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:13:38.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:38.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:39.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:39.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:40.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:40.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:41.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:41.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:42.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:42.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:42.909 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:13:42.910+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:13:43.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:43.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:44.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:44.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:45.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:45.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:46.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:46.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:47.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:47.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:47.910 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:13:47.911+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:13:48.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:48.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:49.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:49.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:50.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:50.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:51.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:51.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:52.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:52.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:52.911 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:13:52.912+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:13:53.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:53.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:54.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:54.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:55.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:55.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:56.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:56.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:57.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:57.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:57.911 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:13:57.912+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:13:58.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:58.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:13:59.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:13:59.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:00.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:00.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:01.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:01.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:02.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:02.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:02.912 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:14:02.914+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:14:03.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:03.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:04.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:04.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:05.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:05.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:06.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:06.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:07.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:07.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:07.914 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:14:07.914+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:14:08.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:08.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:09.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:09.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:10.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:10.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:11.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:11.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:12.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:12.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:12.915 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:14:12.916+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:14:13.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:13.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:14.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:14.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:15.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:15.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:16.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:16.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:17.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:17.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:17.915 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:14:17.916+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:14:18.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:18.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:19.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:19.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:20.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:20.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:21.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:21.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:22.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:22.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:22.916 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:14:22.917+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:14:23.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:23.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:24.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:24.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:25.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:25.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:26.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:26.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:27.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:27.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:27.917 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:14:27.918+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:14:28.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:28.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:29.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:29.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:30.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:30.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:31.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:31.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:32.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:32.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:32.918 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:14:32.919+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:14:33.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:33.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:34.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:34.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:35.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:35.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:36.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:36.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:37.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:37.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:37.919 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:14:37.920+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:14:38.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:38.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:39.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:39.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:40.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:40.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:41.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:41.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:42.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:42.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:42.920 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:14:42.921+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:14:43.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:43.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:44.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:44.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:45.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:45.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:46.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:46.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:47.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:47.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:47.921 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:14:47.923+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:14:48.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:48.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:49.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:49.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:50.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:50.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:51.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:51.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:52.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:52.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:52.922 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:14:52.924+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:14:53.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:53.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:54.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:54.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:55.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:55.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:56.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:56.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:57.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:57.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:57.923 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:14:57.924+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:14:58.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:58.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:14:59.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:14:59.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:00.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:00.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:01.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:01.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:02.924 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:15:02.924+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:15:02.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:02.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:03.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:03.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:04.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:04.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:05.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:05.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:06.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:06.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:07.925 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:15:07.926+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:15:07.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:07.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:08.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:08.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:09.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:09.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:10.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:10.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:11.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:11.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:12.925 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:15:12.926+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:15:12.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:12.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:13.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:13.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:14.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:14.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:15.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:15.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:16.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:16.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:17.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:17.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:17.926 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:15:17.927+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:15:18.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:18.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:19.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:19.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:20.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:20.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:21.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:21.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:22.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:22.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:22.928 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:15:22.929+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:15:23.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:23.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:24.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:24.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:25.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:25.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:26.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:26.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:27.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:27.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:27.928 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:15:27.929+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:15:28.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:28.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:29.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:29.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:30.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:30.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:31.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:31.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:32.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:32.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:32.929 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:15:32.930+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:15:33.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:33.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:34.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:34.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:35.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:35.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:36.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:36.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:37.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:37.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:37.930 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:15:37.932+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:15:38.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:38.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:39.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:39.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:40.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:40.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:41.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:41.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:42.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:42.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:42.931 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:15:42.932+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:15:43.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:43.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:44.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:44.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:45.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:45.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:46.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:46.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:47.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:47.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:47.933 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:15:47.934+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:15:48.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:48.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:49.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:49.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:50.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:50.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:51.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:51.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:52.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:52.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:52.933 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:15:52.934+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:15:53.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:53.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:54.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:54.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:55.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:55.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:56.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:56.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:57.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:57.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:57.934 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:15:57.935+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:15:58.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:58.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:15:59.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:15:59.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:00.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:00.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:01.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:01.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:02.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:02.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:02.936 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:16:02.937+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:16:03.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:03.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:04.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:04.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:05.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:05.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:06.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:06.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:07.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:07.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:07.937 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:16:07.938+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:16:08.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:08.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:09.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:09.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:10.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:10.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:11.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:11.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:12.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:12.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:12.937 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:16:12.938+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:16:13.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:13.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:14.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:14.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:15.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:15.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:16.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:16.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:17.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:17.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:17.939 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:16:17.939+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:16:18.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:18.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:19.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:19.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:20.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:20.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:21.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:21.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:22.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:22.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:22.939 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:16:22.940+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:16:23.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:23.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:24.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:24.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:25.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:25.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:26.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:26.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:27.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:27.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:27.940 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:16:27.941+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:16:28.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:28.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:29.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:29.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:30.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:30.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:31.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:31.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:32.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:32.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:32.941 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:16:32.942+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:16:33.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:33.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:34.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:34.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:35.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:35.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:36.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:36.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:37.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:37.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:37.943 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:16:37.944+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:16:38.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:38.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:39.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:39.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:40.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:40.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:41.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:41.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:42.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:42.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:42.943 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:16:42.944+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:16:43.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:43.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:44.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:44.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:45.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:45.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:46.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:46.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:47.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:47.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:47.945 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:16:47.946+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:16:48.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:48.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:49.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:49.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:50.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:50.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:51.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:51.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:52.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:52.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:52.946 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:16:52.947+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:16:53.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:53.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:54.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:54.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:55.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:55.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:56.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:56.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:57.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:57.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:57.946 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:16:57.947+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:16:58.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:58.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:16:59.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:16:59.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:00.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:00.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:01.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:01.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:02.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:02.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:02.947 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:17:02.948+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:17:03.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:03.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:04.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:04.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:05.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:05.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:06.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:06.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:07.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:07.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:07.949 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:17:07.950+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:17:08.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:08.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:09.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:09.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:10.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:10.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:11.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:11.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:12.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:12.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:12.950 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:17:12.951+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:17:13.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:13.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:14.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:14.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:15.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:15.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:16.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:16.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:17.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:17.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:17.950 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:17:17.951+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:17:18.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:18.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:19.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:19.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:20.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:20.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:21.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:21.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:22.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:22.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:22.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:17:22.952+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:17:23.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:23.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:24.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:24.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:25.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:25.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:26.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:26.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:27.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:27.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:27.952 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:17:27.953+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:17:28.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:28.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:29.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:29.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:30.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:30.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:31.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:31.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:32.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:32.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:32.953 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:17:32.954+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:17:33.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:33.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:34.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:34.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:35.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:35.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:36.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:36.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:37.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:37.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:37.954 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:17:37.955+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:17:38.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:38.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:39.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:39.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:40.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:40.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:41.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:41.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:42.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:42.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:42.955 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:17:42.956+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:17:43.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:43.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:44.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:44.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:45.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:45.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:46.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:46.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:47.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:47.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:47.956 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:17:47.957+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:17:48.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:48.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:49.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:49.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:50.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:50.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:51.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:51.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:52.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:52.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:52.957 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:17:52.959+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:17:53.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:53.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:54.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:54.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:55.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:55.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:56.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:56.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:57.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:57.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:57.957 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:17:57.959+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:17:58.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:58.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:17:59.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:17:59.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:00.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:00.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:01.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:01.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:02.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:02.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:02.958 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:18:02.959+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:18:03.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:03.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:04.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:04.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:05.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:05.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:06.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:06.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:07.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:07.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:07.959 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:18:07.960+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:18:08.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:08.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:09.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:09.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:10.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:10.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:11.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:11.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:12.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:12.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:12.961 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:18:12.962+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:18:13.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:13.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:14.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:14.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:15.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:15.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:16.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:16.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:17.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:17.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:17.961 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:18:17.963+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:18:18.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:18.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:19.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:19.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:20.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:20.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:21.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:21.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:22.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:22.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:22.963 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:18:22.964+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:18:23.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:23.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:24.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:24.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:25.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:25.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:26.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:26.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:27.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:27.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:27.963 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:18:27.965+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:18:28.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:28.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:29.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:29.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:30.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:30.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:31.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:31.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:32.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:32.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:32.965 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:18:32.966+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:18:33.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:33.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:34.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:34.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:35.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:35.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:36.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:36.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:37.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:37.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:37.965 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:18:37.966+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:18:38.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:38.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:39.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:39.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:40.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:40.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:41.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:41.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:42.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:42.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:42.966 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:18:42.967+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:18:43.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:43.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:44.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:44.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:45.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:45.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:46.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:46.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:47.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:47.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:47.967 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:18:47.968+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:18:48.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:48.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:49.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:49.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:50.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:50.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:51.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:51.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:52.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:52.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:52.968 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:18:52.969+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:18:53.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:53.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:54.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:54.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:55.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:55.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:56.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:56.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:57.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:57.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:57.969 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:18:57.970+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:18:58.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:58.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:18:59.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:18:59.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:00.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:00.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:01.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:01.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:02.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:02.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:02.972 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:19:02.972+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:19:03.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:03.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:04.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:04.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:05.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:05.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:06.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:06.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:07.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:07.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:07.971 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:19:07.972+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:19:08.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:08.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:09.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:09.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:10.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:10.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:11.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:11.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:12.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:12.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:12.972 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:19:12.974+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:19:13.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:13.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:14.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:14.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:15.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:15.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:16.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:16.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:17.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:17.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:17.973 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:19:17.974+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:19:18.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:18.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:19.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:19.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:20.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:20.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:21.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:21.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:22.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:22.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:22.974 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:19:22.976+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:19:23.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:23.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:24.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:24.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:25.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:25.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:26.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:26.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:27.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:27.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:27.975 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:19:27.976+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:19:28.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:28.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:29.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:29.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:30.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:30.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:31.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:31.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:32.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:32.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:32.976 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:19:32.977+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:19:33.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:33.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:34.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:34.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:35.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:35.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:36.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:36.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:37.978 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:19:37.979+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:19:37.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:37.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:39.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:39.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:40.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:40.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:41.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:41.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:42.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:42.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:42.979 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:19:42.980+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:19:43.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:43.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:44.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:44.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:45.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:45.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:46.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:46.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:47.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:47.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:47.980 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:19:47.981+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:19:48.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:48.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:49.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:49.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:50.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:50.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:51.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:51.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:52.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:52.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:52.980 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:19:52.982+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:19:53.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:53.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:54.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:54.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:54.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:54.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:55.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:55.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:56.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:56.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:57.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:57.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:57.981 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:19:57.982+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:19:58.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:58.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:19:59.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:19:59.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:00.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:00.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:01.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:01.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:02.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:02.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:02.982 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:20:02.983+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:20:03.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:03.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:04.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:04.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:05.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:05.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:06.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:06.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:07.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:07.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:07.983 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:20:07.984+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:20:08.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:08.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:09.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:09.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:10.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:10.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:11.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:11.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:12.984 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:20:12.985+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:20:12.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:12.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:13.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:13.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:14.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:14.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:15.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:15.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:17.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:17.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:17.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:17.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:17.985 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:20:17.986+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:20:18.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:18.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:19.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:19.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:20.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:20.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:21.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:21.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:22.986 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:20:22.987+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:20:23.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:23.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:24.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:24.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:25.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:25.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:26.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:26.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:27.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:27.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:27.987 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:20:27.988+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:20:28.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:28.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:29.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:29.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:30.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:30.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:31.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:31.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:32.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:32.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:32.988 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:20:32.989+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:20:33.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:33.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:34.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:34.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:35.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:35.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:36.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:36.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:37.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:37.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:37.989 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:20:37.990+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:20:38.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:38.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:39.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:39.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:40.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:40.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:41.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:41.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:42.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:42.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:42.990 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:20:42.991+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:20:43.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:43.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:44.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:44.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:45.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:45.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:46.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:46.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:47.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:47.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:47.991 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:20:47.992+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:20:48.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:48.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:49.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:49.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:50.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:50.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:51.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:51.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:52.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:52.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:52.992 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:20:52.993+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:20:53.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:53.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:54.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:54.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:55.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:55.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:56.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:56.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:57.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:57.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:57.993 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:20:57.995+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:20:58.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:58.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:20:59.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:20:59.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:00.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:00.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:01.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:01.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:02.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:02.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:02.994 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:21:02.996+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:21:03.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:03.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:04.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:04.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:05.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:05.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:06.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:06.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:07.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:07.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:07.995 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:21:07.997+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:21:08.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:08.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:09.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:09.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:10.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:10.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:11.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:11.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:12.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:12.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:12.995 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:21:12.997+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:21:13.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:13.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:14.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:14.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:15.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:15.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:16.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:16.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:17.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:17.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:17.997 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:21:17.998+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:21:18.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:18.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:19.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:19.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:20.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:20.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:21.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:21.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:22.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:22.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:22.997 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:21:22.998+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:21:23.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:23.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:24.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:24.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:25.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:25.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:26.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:26.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:27.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:27.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:27.998 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:21:27.999+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:21:28.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:28.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:29.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:29.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:30.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:30.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:31.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:31.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:32.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:32.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:32.999 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:21:33.000+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:21:33.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:33.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:34.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:34.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:35.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:35.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:36.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:36.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:37.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:37.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:38.001 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:21:38.001+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:21:38.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:38.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:39.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:39.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:40.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:40.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:41.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:41.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:42.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:42.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:43.001 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:21:43.002+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:21:43.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:43.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:44.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:44.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:45.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:45.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:46.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:46.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:47.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:47.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:48.002 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:21:48.003+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:21:48.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:48.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:49.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:49.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:50.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:50.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:51.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:51.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:52.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:52.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:53.003 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:21:53.004+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:21:53.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:53.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:54.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:54.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:55.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:55.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:56.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:56.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:57.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:57.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:58.004 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:21:58.005+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:21:58.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:58.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:21:59.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:21:59.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:00.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:00.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:01.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:01.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:02.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:02.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:03.005 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:22:03.006+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:22:03.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:03.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:04.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:04.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:05.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:05.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:06.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:06.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:07.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:07.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:08.007 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:22:08.008+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:22:08.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:08.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:09.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:09.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:10.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:10.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:11.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:11.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:12.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:12.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:13.007 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:22:13.008+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:22:13.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:13.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:14.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:14.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:15.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:15.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:16.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:16.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:17.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:17.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:18.008 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:22:18.009+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:22:18.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:18.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:19.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:19.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:20.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:20.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:21.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:21.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:22.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:22.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:23.009 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:22:23.010+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:22:23.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:23.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:24.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:24.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:25.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:25.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:26.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:26.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:27.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:27.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:28.010 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:22:28.012+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:22:28.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:28.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:29.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:29.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:30.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:30.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:31.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:31.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:32.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:32.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:33.011 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:22:33.013+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:22:33.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:33.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:34.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:34.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:35.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:35.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:36.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:36.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:37.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:37.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:38.012 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:22:38.013+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:22:38.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:38.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:39.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:39.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:40.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:40.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:41.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:41.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:42.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:42.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:43.013 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:22:43.014+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:22:43.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:43.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:44.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:44.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:45.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:45.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:46.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:46.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:47.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:47.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:48.014 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:22:48.016+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:22:48.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:48.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:49.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:49.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:50.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:50.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:51.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:51.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:52.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:52.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:53.015 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:22:53.017+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:22:53.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:53.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:54.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:54.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:55.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:55.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:56.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:56.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:57.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:57.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:58.016 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:22:58.018+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:22:58.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:58.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:22:59.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:22:59.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:00.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:00.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:01.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:01.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:02.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:02.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:03.017 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:23:03.018+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:23:03.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:03.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:04.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:04.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:05.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:05.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:06.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:06.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:07.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:07.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:08.018 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:23:08.019+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:23:08.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:08.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:09.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:09.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:10.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:10.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:11.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:11.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:12.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:12.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:13.019 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:23:13.020+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:23:13.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:13.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:14.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:14.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:15.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:15.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:16.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:16.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:17.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:17.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:18.020 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:23:18.021+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:23:18.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:18.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:19.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:19.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:20.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:20.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:21.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:21.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:22.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:22.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:23.021 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:23:23.022+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:23:23.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:23.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:24.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:24.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:25.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:25.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:26.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:26.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:27.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:27.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:28.022 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:23:28.023+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:23:28.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:28.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:29.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:29.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:30.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:30.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:32.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:32.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:33.023 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:23:33.025+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:23:33.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:33.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:34.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:34.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:35.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:35.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:36.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:36.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:37.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:37.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:38.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:38.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:38.024 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:23:38.026+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:23:39.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:39.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:40.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:40.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:40.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:40.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:42.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:42.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:42.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:42.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:43.025 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:23:43.027+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:23:43.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:43.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:44.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:44.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:45.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:45.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:46.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:46.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:47.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:47.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:48.026 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:23:48.027+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:23:48.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:48.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:49.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:49.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:50.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:50.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:51.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:51.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:52.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:52.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:53.027 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:23:53.028+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:23:53.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:53.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:54.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:54.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:55.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:55.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:56.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:56.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:57.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:57.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:58.028 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:23:58.029+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:23:58.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:58.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:23:59.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:23:59.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:00.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:00.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:01.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:01.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:02.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:02.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:03.029 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:24:03.030+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:24:03.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:03.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:04.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:04.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:05.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:05.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:06.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:06.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:07.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:07.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:08.030 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:24:08.032+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:24:08.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:08.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:09.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:09.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:10.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:10.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:11.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:11.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:12.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:12.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:13.030 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:24:13.033+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:24:13.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:13.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:14.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:14.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:16.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:16.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:17.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:17.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:18.031 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:24:18.033+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:24:18.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:18.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:19.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:19.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:20.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:20.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:21.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:21.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:22.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:22.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:23.032 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:24:23.033+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:24:23.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:23.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:24.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:24.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:25.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:25.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:26.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:26.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:27.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:27.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:28.033 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:24:28.035+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:24:28.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:28.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:29.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:29.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:30.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:30.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:31.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:31.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:32.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:32.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:33.034 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:24:33.036+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:24:33.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:33.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:34.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:34.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:35.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:35.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:36.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:36.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:37.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:37.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:38.035 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:24:38.036+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:24:38.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:38.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:39.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:39.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:40.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:40.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:41.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:41.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:42.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:42.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:43.036 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:24:43.038+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:24:43.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:43.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:44.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:44.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:45.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:45.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:46.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:46.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:47.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:47.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:48.037 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:24:48.038+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:24:48.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:48.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:49.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:49.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:50.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:50.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:51.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:51.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:52.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:52.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:53.038 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:24:53.039+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:24:53.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:53.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:54.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:54.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:55.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:55.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:56.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:56.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:57.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:57.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:58.039 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:24:58.040+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:24:58.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:58.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:24:59.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:24:59.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:00.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:00.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:01.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:01.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:02.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:02.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:03.040 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:25:03.041+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:25:03.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:03.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:04.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:04.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:05.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:05.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:06.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:06.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:07.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:07.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:08.041 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:25:08.042+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:25:08.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:08.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:09.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:09.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:10.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:10.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:11.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:11.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:12.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:12.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:13.043 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:25:13.044+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:25:13.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:13.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:14.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:14.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:15.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:15.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:16.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:16.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:17.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:17.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:18.043 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:25:18.044+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:25:18.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:18.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:19.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:19.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:20.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:20.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:21.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:21.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:22.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:22.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:23.044 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:25:23.046+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:25:23.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:23.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:24.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:24.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:25.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:25.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:26.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:26.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:27.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:27.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:28.045 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:25:28.047+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:25:28.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:28.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:29.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:29.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:30.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:30.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:31.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:31.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:32.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:32.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:33.046 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:25:33.047+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:25:33.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:33.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:34.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:34.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:35.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:35.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:36.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:36.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:37.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:37.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:38.047 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:25:38.048+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:25:38.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:38.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:39.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:39.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:40.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:40.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:41.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:41.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:42.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:42.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:43.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:25:43.049+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:25:43.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:43.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:44.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:44.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:45.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:45.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:46.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:46.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:47.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:47.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:48.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:25:48.050+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:25:48.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:48.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:49.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:49.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:50.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:50.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:51.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:51.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:52.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:52.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:53.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:53.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:54.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:54.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:55.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:55.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:56.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:56.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:57.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:57.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:58.051 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:25:58.053+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:25:58.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:58.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:25:59.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:25:59.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:00.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:00.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:01.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:01.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:02.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:02.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:03.052 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:26:03.054+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:26:03.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:03.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:04.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:04.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:05.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:05.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:06.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:06.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:07.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:07.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:08.053 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:26:08.054+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:26:08.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:08.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:09.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:09.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:10.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:10.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:11.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:11.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:12.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:12.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:13.054 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:26:13.055+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:26:13.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:13.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:14.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:14.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:15.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:15.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:16.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:16.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:17.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:17.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:18.055 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:26:18.056+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:26:18.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:18.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:19.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:19.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:20.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:20.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:21.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:21.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:22.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:22.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:23.056 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:26:23.057+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:26:23.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:23.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:24.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:24.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:25.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:25.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:26.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:26.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:27.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:27.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:28.057 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:26:28.058+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:26:28.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:28.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:29.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:29.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:30.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:30.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:31.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:31.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:32.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:32.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:33.058 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:26:33.059+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:26:33.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:33.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:34.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:34.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:35.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:35.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:36.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:36.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:37.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:37.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:38.059 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:26:38.060+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:26:38.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:38.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:39.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:39.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:40.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:40.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:41.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:41.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:42.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:42.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:43.060 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:26:43.061+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:26:43.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:43.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:44.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:44.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:45.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:45.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:46.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:46.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:47.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:47.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:48.061 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:26:48.062+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:26:48.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:48.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:49.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:49.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:50.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:50.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:51.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:51.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:52.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:52.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:53.062 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:26:53.063+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:26:53.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:53.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:54.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:54.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:55.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:55.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:56.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:56.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:57.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:57.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:58.063 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:26:58.065+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:26:58.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:58.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:26:59.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:26:59.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:00.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:00.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:01.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:01.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:02.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:02.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:03.064 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:27:03.065+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:27:03.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:03.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:04.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:04.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:05.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:05.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:06.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:06.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:07.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:07.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:08.066 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:27:08.067+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:27:08.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:08.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:09.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:09.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:10.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:10.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:11.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:11.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:12.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:12.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:13.066 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:27:13.067+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:27:13.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:13.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:14.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:14.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:15.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:15.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:16.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:16.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:17.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:17.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:18.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:18.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:19.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:19.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:20.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:20.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:21.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:21.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:22.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:22.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:23.067 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:27:23.070+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:27:23.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:23.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:24.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:24.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:25.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:25.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:26.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:26.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:27.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:27.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:28.068 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:27:28.070+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:27:28.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:28.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:29.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:29.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:30.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:30.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:31.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:31.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:32.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:32.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:33.069 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:27:33.071+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:27:33.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:33.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:34.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:34.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:35.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:35.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:36.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:36.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:37.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:37.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:38.070 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:27:38.071+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:27:38.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:38.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:39.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:39.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:40.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:40.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:41.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:41.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:42.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:42.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:43.071 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:27:43.072+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:27:43.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:43.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:44.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:44.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:45.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:45.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:46.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:46.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:47.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:47.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:48.072 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:27:48.074+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:27:48.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:48.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:49.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:49.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:50.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:50.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:51.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:51.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:52.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:52.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:53.073 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:27:53.074+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:27:53.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:53.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:54.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:54.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:55.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:55.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:56.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:56.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:57.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:57.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:58.074 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:27:58.075+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:27:58.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:58.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:27:59.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:27:59.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:00.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:00.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:01.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:01.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:02.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:02.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:03.078 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:28:03.077+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:28:03.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:03.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:04.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:04.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:05.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:05.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:06.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:06.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:07.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:07.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:08.076 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:28:08.078+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:28:08.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:08.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:09.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:09.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:10.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:10.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:11.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:11.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:12.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:12.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:13.077 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:28:13.079+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:28:13.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:13.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:14.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:14.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:15.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:15.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:16.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:16.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:17.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:17.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:18.078 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:28:18.079+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:28:18.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:18.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:19.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:19.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:20.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:20.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:21.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:21.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:22.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:22.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:23.079 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:28:23.080+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:28:23.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:23.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:24.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:24.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:25.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:25.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:26.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:26.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:27.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:27.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:28.080 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:28:28.081+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:28:28.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:28.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:29.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:29.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:30.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:30.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:31.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:31.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:32.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:32.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:33.081 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:28:33.082+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:28:33.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:33.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:34.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:34.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:35.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:35.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:36.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:36.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:37.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:37.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:38.082 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:28:38.083+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:28:38.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:38.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:39.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:39.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:40.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:40.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:41.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:41.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:42.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:42.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:43.083 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:28:43.084+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:28:43.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:43.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:44.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:44.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:45.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:45.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:46.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:46.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:47.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:47.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:48.085 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:28:48.086+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:28:48.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:48.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:49.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:49.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:50.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:50.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:51.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:51.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:52.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:52.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:53.085 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:28:53.086+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:28:53.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:53.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:54.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:54.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:55.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:55.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:56.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:56.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:57.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:57.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:58.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:28:58.088+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:28:58.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:58.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:28:59.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:28:59.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:00.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:00.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:01.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:01.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:02.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:02.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:03.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:29:03.088+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:29:03.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:03.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:04.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:04.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:05.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:05.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:06.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:06.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:07.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:07.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:08.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:29:08.089+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:29:08.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:08.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:09.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:09.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:10.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:10.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:11.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:11.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:12.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:12.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:13.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:29:13.091+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:29:13.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:13.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:14.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:14.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:15.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:15.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:16.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:16.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:17.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:17.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:18.090 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:29:18.091+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:29:18.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:18.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:19.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:19.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:20.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:20.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:21.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:21.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:22.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:22.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:23.091 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:29:23.092+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:29:23.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:23.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:24.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:24.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:25.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:25.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:26.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:26.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:27.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:27.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:28.092 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:29:28.093+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:29:28.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:28.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:29.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:29.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:30.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:30.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:31.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:31.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:32.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:32.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:33.093 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:29:33.094+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:29:33.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:33.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:34.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:34.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:35.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:35.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:36.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:36.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:37.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:37.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:38.094 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:29:38.095+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:29:38.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:38.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:39.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:39.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:40.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:40.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:41.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:41.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:42.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:42.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:43.095 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:29:43.096+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:29:43.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:43.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:44.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:44.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:46.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:46.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:47.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:47.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:47.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:47.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:48.096 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:29:48.097+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:29:48.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:48.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:50.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:50.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:51.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:51.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:51.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:51.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:52.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:52.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:53.097 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:29:53.099+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:29:54.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:54.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:54.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:54.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:55.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:55.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:56.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:56.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:57.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:57.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:58.098 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:29:58.099+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:29:58.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:58.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:29:59.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:29:59.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:00.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:00.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:02.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:02.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:03.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:03.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:03.099 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:30:03.100+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:30:04.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:04.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:05.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:05.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:06.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:06.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:07.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:07.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:08.100 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:30:08.101+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:30:08.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:08.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:09.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:09.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:10.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:10.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:11.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:11.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:12.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:12.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:13.101 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:30:13.103+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:30:13.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:13.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:14.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:14.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:15.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:15.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:16.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:16.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:17.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:17.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:18.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:30:18.104+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:30:18.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:18.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:19.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:19.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:20.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:20.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:21.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:21.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:22.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:22.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:23.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:30:23.105+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:30:23.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:23.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:24.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:24.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:25.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:25.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:26.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:26.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:27.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:27.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:28.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:30:28.106+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:30:28.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:28.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:29.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:29.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:30.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:30.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:31.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:31.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:32.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:32.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:33.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:30:33.107+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:30:33.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:33.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:34.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:34.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:35.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:35.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:36.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:36.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:37.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:37.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:38.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:30:38.107+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:30:38.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:38.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:39.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:39.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:40.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:40.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:41.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:41.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:42.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:42.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:43.106 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:30:43.107+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:30:43.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:43.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:44.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:44.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:45.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:45.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:46.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:46.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:47.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:47.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:48.107 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:30:48.109+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:30:48.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:48.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:49.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:49.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:50.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:50.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:51.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:51.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:52.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:52.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:53.108 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:30:53.110+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:30:53.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:53.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:54.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:54.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:55.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:55.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:56.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:56.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:57.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:57.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:58.110 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:30:58.111+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:30:58.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:58.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:30:59.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:30:59.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:00.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:00.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:01.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:01.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:02.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:02.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:03.110 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:31:03.112+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:31:03.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:03.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:04.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:04.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:05.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:05.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:06.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:06.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:07.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:07.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:08.112 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:31:08.113+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:31:08.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:08.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:09.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:09.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:10.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:10.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:11.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:11.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:12.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:12.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:13.112 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:31:13.113+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:31:13.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:13.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:14.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:14.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:15.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:15.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:16.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:16.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:17.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:17.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:18.113 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:31:18.114+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:31:18.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:18.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:19.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:19.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:20.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:20.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:21.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:21.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:22.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:22.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:23.114 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:31:23.116+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:31:23.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:23.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:24.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:24.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:25.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:25.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:26.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:26.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:27.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:27.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:28.115 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:31:28.116+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:31:28.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:28.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:29.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:29.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:30.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:30.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:31.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:31.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:32.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:32.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:33.116 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:31:33.117+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:31:33.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:33.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:34.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:34.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:35.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:35.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:36.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:36.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:37.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:37.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:38.118 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:31:38.118+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:31:38.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:38.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:39.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:39.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:40.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:40.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:41.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:41.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:42.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:42.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:43.117 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:31:43.119+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:31:43.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:43.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:44.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:44.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:45.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:45.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:46.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:46.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:47.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:47.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:48.118 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:31:48.120+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:31:48.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:48.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:49.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:49.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:50.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:50.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:51.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:51.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:52.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:52.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:53.119 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:31:53.120+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:31:53.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:53.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:54.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:54.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:55.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:55.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:56.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:56.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:57.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:57.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:58.120 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:31:58.122+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:31:58.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:58.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:31:59.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:31:59.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:00.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:00.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:01.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:01.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:02.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:02.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:03.122 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:32:03.123+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:32:03.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:03.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:04.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:04.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:05.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:05.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:06.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:06.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:07.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:07.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:08.123 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:32:08.124+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:32:08.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:08.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:09.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:09.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:10.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:10.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:11.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:11.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:12.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:12.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:13.125 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:32:13.126+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:32:13.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:13.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:14.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:14.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:15.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:15.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:16.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:16.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:17.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:17.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:18.125 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:32:18.126+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:32:18.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:18.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:19.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:19.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:20.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:20.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:21.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:21.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:22.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:22.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:23.126 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:32:23.127+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:32:23.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:23.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:24.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:24.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:26.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:26.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:26.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:26.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:28.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:28.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:28.127 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:32:28.128+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:32:29.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:29.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:30.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:30.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:31.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:31.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:32.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:32.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:33.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:33.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:33.128 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:32:33.129+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:32:34.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:34.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:35.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:35.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:36.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:36.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:37.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:37.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:38.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:38.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:38.129 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:32:38.130+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:32:39.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:39.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:40.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:40.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:41.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:41.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:42.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:42.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:43.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:43.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:43.130 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:32:43.131+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:32:44.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:44.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:45.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:45.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:45.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:45.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:47.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:47.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:48.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:48.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:48.131 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:32:48.132+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:32:49.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:49.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:50.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:50.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:51.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:51.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:52.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:52.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:53.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:53.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:53.132 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:32:53.133+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:32:54.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:54.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:55.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:55.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:56.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:56.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:57.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:57.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:58.133 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:32:58.134+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:32:58.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:58.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:32:59.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:32:59.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:00.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:00.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:01.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:01.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:02.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:02.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:03.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:03.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:03.133 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:33:03.135+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:33:04.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:04.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:05.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:05.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:06.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:06.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:07.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:07.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:08.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:08.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:08.134 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:33:08.136+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:33:09.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:09.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:10.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:10.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:11.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:11.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:12.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:12.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:13.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:13.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:13.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:33:13.137+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:33:14.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:14.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:15.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:15.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:16.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:16.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:17.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:17.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:18.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:33:18.138+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:33:18.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:18.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:19.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:19.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:20.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:20.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:21.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:21.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:22.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:22.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:23.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:33:23.139+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:33:23.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:23.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:24.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:24.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:25.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:25.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:26.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:26.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:27.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:27.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:28.138 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:33:28.140+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:33:28.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:28.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:29.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:29.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:30.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:30.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:31.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:31.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:32.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:32.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:33.139 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:33:33.141+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:33:33.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:33.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:34.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:34.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:35.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:35.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:36.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:36.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:37.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:37.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:38.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:38.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:38.140 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:33:38.143+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:33:39.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:39.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:40.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:40.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:41.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:41.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:42.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:42.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:43.141 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:33:43.143+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:33:43.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:43.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:44.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:44.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:45.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:45.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:46.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:46.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:47.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:47.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:48.142 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:33:48.145+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:33:48.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:48.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:49.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:49.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:50.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:50.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:51.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:51.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:52.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:52.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:53.143 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:33:53.145+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:33:53.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:53.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:54.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:54.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:55.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:55.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:56.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:56.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:57.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:57.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:58.144 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:33:58.145+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:33:58.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:58.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:33:59.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:33:59.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:00.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:00.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:01.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:01.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:02.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:02.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:03.145 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:34:03.147+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:34:03.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:03.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:04.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:04.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:05.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:05.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:06.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:06.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:07.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:07.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:08.146 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:34:08.147+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:34:08.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:08.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:09.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:09.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:10.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:10.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:11.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:11.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:12.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:12.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:13.147 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:34:13.148+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:34:13.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:13.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:14.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:14.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:15.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:15.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:16.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:16.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:17.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:17.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:18.148 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:34:18.149+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:34:18.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:18.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:19.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:19.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:20.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:20.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:21.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:21.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:22.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:22.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:23.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:23.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:23.149 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:34:23.150+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:34:24.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:24.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:25.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:25.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:26.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:26.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:27.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:27.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:27.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:27.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:28.150 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:34:28.151+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:34:28.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:28.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:29.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:29.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:30.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:30.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:32.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:32.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:32.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:32.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:33.151 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:34:33.152+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:34:34.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:34.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:35.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:35.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:36.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:36.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:37.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:37.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:38.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:38.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:38.152 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:34:38.153+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:34:39.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:39.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:40.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:40.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:41.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:41.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:42.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:42.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:43.153 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:34:43.154+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:34:43.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:43.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:44.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:44.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:45.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:45.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:46.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:46.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:47.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:47.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:48.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:48.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:48.154 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:34:48.155+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:34:49.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:49.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:50.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:50.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:51.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:51.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:52.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:52.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:53.155 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:34:53.156+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:34:53.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:53.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:54.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:54.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:55.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:55.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:56.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:56.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:57.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:57.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:58.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:58.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:34:58.156 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:34:58.157+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:34:59.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:34:59.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:00.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:00.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:01.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:01.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:02.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:02.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:03.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:03.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:03.157 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:35:03.158+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:35:04.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:04.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:05.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:05.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:06.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:06.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:07.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:07.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:08.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:08.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:08.158 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:35:08.159+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:35:09.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:09.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:10.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:10.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:11.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:11.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:12.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:12.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:13.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:13.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:13.159 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:35:13.161+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:35:14.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:14.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:15.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:15.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:16.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:16.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:17.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:17.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:18.160 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:35:18.161+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:35:18.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:18.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:19.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:19.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:20.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:20.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:21.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:21.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:22.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:22.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:23.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:23.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:23.161 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:35:23.163+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:35:24.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:24.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:25.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:25.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:26.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:26.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:26.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:27.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:28.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:28.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:28.162 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:35:28.163+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:35:28.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:28.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:29.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:29.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:31.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:31.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:32.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:32.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:33.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:33.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:33.163 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:35:33.164+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:35:34.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:34.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:35.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:35.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:36.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:36.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:37.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:37.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:38.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:38.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:38.164 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:35:38.165+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:35:39.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:39.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:40.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:40.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:41.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:41.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:42.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:42.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:43.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:43.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:43.165 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:35:43.166+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:35:44.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:44.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:45.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:45.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:46.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:46.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:47.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:47.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:48.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:48.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:48.166 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:35:48.167+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:35:49.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:49.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:50.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:50.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:51.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:51.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:52.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:52.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:53.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:53.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:53.167 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:35:53.168+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:35:54.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:54.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:55.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:55.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:56.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:56.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:57.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:57.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:57.760 INFO:tasks.ceph.cluster1.osd.2.gibba022.stderr:2021-11-21T07:35:57.761+0000 7fb5c8707700 -1 reset not still connected to 0x5596ceb60b60 2021-11-21T07:35:57.761 INFO:tasks.ceph.cluster1.osd.2.gibba022.stderr:2021-11-21T07:35:57.761+0000 7fb5c8707700 -1 reset not still connected to 0x5596ceb61a00 2021-11-21T07:35:57.761 INFO:tasks.ceph.cluster1.osd.2.gibba022.stderr:2021-11-21T07:35:57.762+0000 7fb5c8707700 -1 reset not still connected to 0x5596ceccd6c0 2021-11-21T07:35:57.761 INFO:tasks.ceph.cluster1.osd.2.gibba022.stderr:2021-11-21T07:35:57.762+0000 7fb5c8707700 -1 reset not still connected to 0x5596cedd48f0 2021-11-21T07:35:57.762 INFO:tasks.ceph.cluster1.osd.2.gibba022.stderr:2021-11-21T07:35:57.762+0000 7fb5c8707700 -1 reset not still connected to 0x5596cf5a88f0 2021-11-21T07:35:58.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:58.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:35:58.168 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:35:58.169+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:35:59.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:35:59.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:00.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:00.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:01.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:01.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:02.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:02.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:03.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:03.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:03.169 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:36:03.171+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:36:04.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:04.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:05.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:05.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:06.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:06.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:07.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:07.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:08.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:08.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:08.170 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:36:08.171+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:36:09.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:09.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:10.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:10.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:11.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:11.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:12.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:12.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:13.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:13.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:13.171 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:36:13.172+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:36:14.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:14.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:15.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:15.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:16.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:16.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:17.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:17.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:17.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:18.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:18.172 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:36:18.173+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:36:18.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:18.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:19.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:19.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:20.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:20.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:21.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:21.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:22.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:22.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:23.173 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:36:23.174+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:36:23.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:23.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:24.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:24.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:25.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:25.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:26.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:26.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:27.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:27.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:28.174 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:36:28.175+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:36:28.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:28.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:29.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:29.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:31.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:31.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:32.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:32.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:33.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:33.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:33.175 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:36:33.176+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:36:34.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:34.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:35.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:35.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:36.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:36.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:37.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:37.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:38.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:38.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:38.176 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:36:38.177+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:36:39.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:39.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:40.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:40.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:41.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:41.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:42.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:42.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:43.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:43.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:43.177 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:36:43.178+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:36:44.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:44.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:45.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:45.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:46.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:46.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:47.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:47.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:48.177 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:36:48.180+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:36:48.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:48.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:49.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:49.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:50.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:50.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:51.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:51.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:52.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:52.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:53.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:53.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:53.179 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:36:53.181+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:36:54.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:54.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:55.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:55.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:56.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:56.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:57.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:57.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:58.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:58.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:36:58.179 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:36:58.180+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:36:59.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:36:59.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:00.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:00.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:01.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:01.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:02.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:02.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:03.180 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:37:03.182+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:37:03.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:03.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:04.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:04.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:05.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:05.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:06.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:06.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:07.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:07.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:08.181 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:37:08.182+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:37:08.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:08.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:09.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:09.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:10.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:10.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:11.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:11.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:12.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:12.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:13.182 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:37:13.184+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:37:13.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:13.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:14.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:14.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:15.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:15.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:16.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:16.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:17.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:17.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:18.183 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:37:18.185+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:37:18.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:18.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:19.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:19.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:20.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:20.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:21.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:21.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:22.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:22.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:23.184 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:37:23.185+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:37:23.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:23.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:24.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:24.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:25.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:25.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:26.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:26.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:27.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:27.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:28.185 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:37:28.186+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:37:28.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:28.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:29.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:29.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:30.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:30.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:31.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:31.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:32.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:32.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:33.186 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:37:33.187+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:37:33.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:33.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:34.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:34.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:35.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:35.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:36.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:36.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:37.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:37.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:38.187 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:37:38.188+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:37:38.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:38.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:39.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:39.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:40.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:40.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:41.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:41.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:42.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:42.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:43.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:43.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:43.188 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:37:43.190+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:37:44.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:44.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:45.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:45.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:46.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:46.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:47.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:47.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:48.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:48.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:48.189 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:37:48.191+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:37:49.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:49.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:50.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:50.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:51.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:51.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:52.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:52.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:53.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:53.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:53.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:37:53.191+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:37:54.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:54.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:55.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:55.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:56.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:56.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:57.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:57.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:58.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:37:58.192+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:37:58.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:58.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:37:59.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:37:59.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:00.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:00.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:01.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:01.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:02.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:02.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:03.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:03.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:03.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:38:03.194+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:38:04.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:04.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:05.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:05.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:06.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:06.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:07.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:07.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:08.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:08.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:08.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:38:08.195+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:38:09.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:09.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:10.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:10.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:11.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:11.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:12.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:12.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:13.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:38:13.196+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:38:13.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:13.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:14.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:14.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:15.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:15.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:16.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:16.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:17.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:17.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:18.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:18.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:18.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:38:18.197+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:38:19.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:19.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:20.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:20.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:21.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:21.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:22.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:22.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:23.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:23.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:23.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:38:23.197+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:38:24.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:24.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:25.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:25.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:26.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:26.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:27.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:27.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:28.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:28.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:28.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:38:28.198+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:38:29.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:29.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:30.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:30.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:31.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:31.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:32.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:32.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:33.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:33.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:33.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:38:33.199+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:38:34.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:34.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:35.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:35.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:36.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:36.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:37.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:37.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:38.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:38.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:38.199 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:38:38.200+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:38:39.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:39.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:40.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:40.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:41.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:41.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:42.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:42.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:43.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:43.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:43.200 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:38:43.201+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:38:44.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:44.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:45.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:45.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:46.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:46.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:47.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:47.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:48.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:48.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:48.201 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:38:48.202+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:38:49.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:49.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:50.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:50.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:51.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:51.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:52.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:52.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:53.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:53.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:53.202 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:38:53.203+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:38:54.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:54.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:54.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:54.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:56.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:56.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:56.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:56.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:58.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:58.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:38:58.204 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:38:58.205+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:38:59.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:38:59.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:00.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:00.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:01.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:01.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:02.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:02.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:03.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:03.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:03.204 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:39:03.205+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:39:04.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:04.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:05.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:05.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:06.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:06.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:06.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:06.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:08.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:08.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:08.205 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:39:08.206+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:39:09.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:09.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:10.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:10.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:11.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:11.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:12.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:12.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:13.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:13.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:13.206 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:39:13.207+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:39:14.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:14.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:15.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:15.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:16.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:16.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:17.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:17.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:18.207 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:39:18.208+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:39:18.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:18.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:19.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:19.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:20.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:20.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:21.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:21.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:22.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:22.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:23.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:23.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:23.208 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:39:23.210+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:39:24.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:24.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:25.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:25.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:26.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:26.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:27.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:27.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:28.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:28.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:28.209 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:39:28.210+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:39:29.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:29.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:30.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:30.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:31.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:31.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:32.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:32.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:33.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:33.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:33.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:39:33.211+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:39:34.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:34.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:35.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:35.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:36.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:36.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:37.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:37.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:37.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:37.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:38.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:39:38.213+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:39:38.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:38.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:39.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:39.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:40.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:40.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:41.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:41.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:42.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:42.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:43.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:39:43.214+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:39:43.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:43.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:45.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:45.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:46.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:46.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:47.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:47.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:48.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:48.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:48.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:39:48.215+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:39:49.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:49.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:50.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:50.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:51.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:51.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:52.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:52.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:53.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:53.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:53.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:39:53.215+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:39:54.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:54.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:55.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:55.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:56.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:56.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:57.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:57.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:58.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:39:58.217+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:39:58.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:58.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:39:59.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:39:59.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:00.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:00.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:01.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:01.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:02.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:02.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:03.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:40:03.218+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:40:03.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:03.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:04.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:04.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:05.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:05.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:06.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:06.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:07.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:07.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:08.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:08.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:08.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:40:08.218+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:40:09.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:09.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:10.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:10.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:11.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:11.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:12.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:12.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:13.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:13.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:13.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:40:13.219+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:40:14.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:14.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:15.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:15.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:16.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:16.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:17.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:17.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:18.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:18.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:18.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:40:18.219+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:40:19.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:19.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:20.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:20.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:21.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:21.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:22.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:22.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:23.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:23.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:23.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:40:23.220+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:40:24.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:24.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:25.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:25.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:26.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:26.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:27.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:27.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:28.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:28.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:28.220 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:40:28.221+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:40:29.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:29.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:30.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:30.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:31.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:31.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:32.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:32.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:33.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:33.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:33.221 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:40:33.222+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:40:34.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:34.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:35.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:35.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:36.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:36.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:37.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:37.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:38.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:38.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:38.222 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:40:38.223+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:40:39.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:39.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:40.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:40.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:41.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:41.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:42.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:42.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:43.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:43.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:43.223 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:40:43.224+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:40:44.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:44.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:45.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:45.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:46.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:46.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:46.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:47.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:47.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:47.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:48.223 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:40:48.225+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:40:48.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:48.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:49.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:49.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:50.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:50.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:51.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:51.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:52.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:52.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:53.225 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:40:53.226+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:40:53.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:53.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:54.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:54.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:55.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:55.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:56.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:56.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:57.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:57.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:58.226 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:40:58.227+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:40:58.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:58.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:40:59.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:40:59.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:00.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:00.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:01.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:01.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:02.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:02.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:03.227 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:41:03.228+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:41:03.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:03.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:04.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:04.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:05.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:05.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:06.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:06.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:07.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:07.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:08.228 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:41:08.229+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:41:08.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:08.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:09.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:09.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:10.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:10.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:11.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:11.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:12.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:12.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:13.229 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:41:13.231+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:41:13.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:13.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:14.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:14.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:15.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:15.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:16.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:16.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:17.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:17.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:18.230 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:41:18.232+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:41:18.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:18.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:19.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:19.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:20.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:20.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:21.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:21.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:22.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:22.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:23.231 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:41:23.233+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:41:23.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:23.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:24.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:24.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:25.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:25.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:26.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:26.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:27.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:27.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:28.232 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:41:28.233+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:41:28.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:28.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:29.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:29.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:30.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:30.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:31.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:31.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:32.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:32.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:33.233 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:41:33.234+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:41:33.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:33.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:34.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:34.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:35.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:35.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:36.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:36.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:37.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:37.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:38.234 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:41:38.236+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:41:38.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:38.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:39.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:39.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:40.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:40.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:41.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:41.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:42.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:42.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:43.235 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:41:43.236+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:41:43.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:43.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:44.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:44.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:45.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:45.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:46.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:46.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:47.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:47.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:48.235 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:41:48.237+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:41:48.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:48.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:49.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:49.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:50.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:50.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:51.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:51.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:52.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:52.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:53.237 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:41:53.239+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:41:53.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:53.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:54.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:54.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:55.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:55.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:56.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:56.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:57.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:57.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:58.238 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:41:58.240+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:41:58.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:58.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:41:59.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:41:59.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:00.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:00.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:01.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:01.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:02.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:02.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:03.239 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:42:03.241+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:42:03.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:03.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:04.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:04.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:05.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:05.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:06.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:06.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:07.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:07.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:08.240 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:42:08.242+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:42:08.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:08.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:09.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:09.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:10.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:10.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:11.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:11.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:12.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:12.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:13.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:42:13.242+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:42:13.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:13.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:14.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:14.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:15.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:15.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:16.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:16.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:17.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:17.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:18.242 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:42:18.243+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:42:18.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:18.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:19.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:19.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:20.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:20.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:21.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:21.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:22.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:22.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:23.243 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:42:23.244+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:42:23.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:23.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:24.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:24.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:25.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:25.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:26.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:26.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:27.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:27.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:28.244 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:42:28.246+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:42:28.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:28.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:29.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:29.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:30.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:30.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:31.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:31.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:32.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:32.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:33.245 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:42:33.247+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:42:33.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:33.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:34.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:34.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:35.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:35.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:36.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:36.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:37.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:37.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:38.246 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:42:38.247+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:42:38.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:38.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:39.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:39.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:40.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:40.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:41.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:41.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:42.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:42.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:43.247 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:42:43.248+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:42:43.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:43.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:44.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:44.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:45.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:45.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:46.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:46.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:47.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:47.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:48.248 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:42:48.249+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:42:48.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:48.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:49.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:49.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:50.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:50.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:51.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:51.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:52.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:52.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:53.249 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:42:53.250+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:42:53.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:53.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:54.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:54.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:55.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:55.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:56.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:56.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:57.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:57.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:58.250 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:42:58.251+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:42:58.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:58.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:42:59.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:42:59.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:00.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:00.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:01.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:01.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:02.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:02.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:03.250 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:43:03.253+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:43:03.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:03.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:04.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:04.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:05.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:05.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:06.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:06.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:07.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:07.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:08.251 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:43:08.254+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:43:08.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:08.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:09.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:09.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:10.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:10.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:11.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:11.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:12.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:12.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:13.252 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:43:13.255+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:43:13.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:13.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:14.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:14.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:15.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:15.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:16.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:16.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:17.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:17.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:18.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:18.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:19.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:19.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:20.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:20.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:21.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:21.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:22.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:22.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:23.254 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:43:23.256+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:43:23.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:23.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:24.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:24.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:25.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:25.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:26.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:26.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:27.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:27.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:28.255 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:43:28.257+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:43:28.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:28.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:29.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:29.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:30.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:30.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:31.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:31.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:32.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:32.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:33.256 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:43:33.258+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:43:33.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:33.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:34.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:34.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:35.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:35.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:36.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:36.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:37.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:37.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:38.257 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:43:38.259+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:43:38.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:38.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:39.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:39.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:40.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:40.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:41.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:41.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:42.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:42.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:43.258 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:43:43.260+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:43:43.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:43.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:44.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:44.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:45.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:45.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:46.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:46.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:47.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:47.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:48.259 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:43:48.260+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:43:48.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:48.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:49.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:49.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:50.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:50.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:51.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:51.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:52.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:52.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:53.260 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:43:53.261+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:43:53.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:53.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:54.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:54.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:55.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:55.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:56.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:56.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:57.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:57.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:58.261 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:43:58.263+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:43:58.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:58.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:43:59.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:43:59.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:00.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:00.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:01.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:01.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:02.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:02.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:03.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:44:03.264+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:44:03.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:03.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:04.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:04.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:05.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:05.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:06.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:06.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:07.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:07.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:08.263 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:44:08.265+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:44:08.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:08.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:09.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:09.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:10.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:10.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:11.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:11.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:12.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:12.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:13.264 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:44:13.266+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:44:13.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:13.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:14.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:14.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:15.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:15.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:16.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:16.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:17.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:17.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:18.265 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:44:18.266+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:44:18.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:18.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:19.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:19.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:20.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:20.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:21.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:21.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:22.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:22.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:23.266 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:44:23.267+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:44:23.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:23.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:24.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:24.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:25.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:25.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:26.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:26.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:27.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:27.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:28.267 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:44:28.268+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:44:28.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:28.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:29.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:29.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:30.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:30.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:31.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:31.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:32.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:32.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:33.268 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:44:33.269+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:44:33.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:33.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:34.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:34.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:35.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:35.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:36.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:36.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:37.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:37.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:38.269 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:44:38.270+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:44:38.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:38.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:39.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:39.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:40.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:40.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:41.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:41.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:42.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:42.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:43.270 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:44:43.271+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:44:43.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:43.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:44.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:44.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:45.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:45.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:46.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:46.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:47.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:47.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:48.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:44:48.272+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:44:48.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:48.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:49.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:49.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:50.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:50.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:51.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:51.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:52.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:52.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:53.272 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:44:53.274+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:44:53.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:53.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:54.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:54.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:55.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:55.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:56.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:56.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:57.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:57.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:58.273 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:44:58.274+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:44:58.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:58.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:44:59.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:44:59.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:00.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:00.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:01.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:01.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:02.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:02.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:03.273 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:45:03.275+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:45:03.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:03.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:04.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:04.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:05.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:05.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:06.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:06.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:07.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:07.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:08.275 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:45:08.276+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:45:08.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:08.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:09.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:09.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:10.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:10.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:11.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:11.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:12.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:12.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:13.276 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:45:13.278+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:45:13.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:13.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:14.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:14.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:15.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:15.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:16.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:16.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:17.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:17.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:18.277 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:45:18.278+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:45:18.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:18.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:19.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:19.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:20.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:20.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:21.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:21.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:22.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:22.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:23.278 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:45:23.280+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:45:23.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:23.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:24.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:24.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:25.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:25.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:26.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:26.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:27.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:27.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:28.279 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:45:28.280+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:45:28.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:28.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:29.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:29.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:30.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:30.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:31.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:31.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:32.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:32.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:33.280 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:45:33.282+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:45:33.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:33.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:34.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:34.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:35.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:35.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:36.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:36.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:37.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:37.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:38.281 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:45:38.282+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:45:38.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:38.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:39.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:39.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:40.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:40.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:41.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:41.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:42.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:42.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:43.282 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:45:43.283+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:45:43.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:43.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:44.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:44.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:45.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:45.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:46.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:46.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:47.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:47.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:48.283 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:45:48.284+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:45:48.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:48.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:49.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:49.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:50.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:50.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:51.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:51.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:52.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:52.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:53.284 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:45:53.286+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:45:53.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:53.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:54.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:54.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:55.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:55.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:56.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:56.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:57.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:57.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:58.285 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:45:58.286+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:45:58.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:58.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:45:59.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:45:59.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:00.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:00.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:01.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:01.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:02.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:02.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:03.286 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:46:03.288+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:46:03.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:03.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:04.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:04.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:05.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:05.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:06.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:06.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:07.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:07.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:08.287 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:46:08.288+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:46:08.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:08.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:09.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:09.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:10.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:10.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:11.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:11.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:12.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:12.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:13.287 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:46:13.290+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:46:13.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:13.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:14.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:14.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:15.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:15.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:16.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:16.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:17.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:17.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:18.288 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:46:18.291+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:46:18.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:18.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:19.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:19.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:20.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:20.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:21.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:21.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:22.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:22.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:23.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:46:23.290+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:46:23.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:23.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:24.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:24.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:25.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:25.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:26.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:26.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:27.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:27.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:28.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:46:28.292+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:46:28.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:28.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:29.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:29.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:30.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:30.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:31.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:31.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:32.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:32.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:33.291 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:46:33.292+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:46:33.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:33.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:34.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:34.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:35.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:35.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:36.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:36.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:37.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:37.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:38.292 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:46:38.293+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:46:38.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:38.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:39.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:39.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:40.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:40.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:41.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:41.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:42.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:42.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:43.292 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:46:43.294+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:46:43.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:43.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:44.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:44.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:45.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:45.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:46.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:46.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:47.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:47.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:48.294 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:46:48.295+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:46:48.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:48.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:49.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:49.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:50.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:50.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:51.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:51.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:52.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:52.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:53.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:46:53.296+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:46:53.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:53.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:54.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:54.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:55.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:55.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:56.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:56.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:57.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:57.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:58.296 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:46:58.298+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:46:58.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:58.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:46:59.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:46:59.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:00.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:00.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:01.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:01.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:02.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:02.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:03.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:47:03.298+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:47:03.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:03.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:04.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:04.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:05.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:05.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:06.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:06.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:07.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:07.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:08.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:47:08.299+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:47:08.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:08.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:09.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:09.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:10.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:10.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:11.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:11.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:12.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:12.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:13.299 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:47:13.301+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:47:13.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:13.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:14.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:14.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:15.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:15.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:16.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:16.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:17.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:17.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:18.300 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:47:18.302+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:47:18.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:18.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:19.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:19.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:20.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:20.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:21.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:21.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:22.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:22.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:23.301 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:47:23.302+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:47:23.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:23.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:24.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:24.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:25.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:25.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:26.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:26.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:27.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:27.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:28.302 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:47:28.303+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:47:28.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:28.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:29.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:29.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:30.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:30.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:31.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:31.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:32.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:32.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:33.303 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:47:33.304+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:47:33.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:33.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:34.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:34.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:35.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:35.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:36.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:36.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:37.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:37.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:38.304 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:47:38.306+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:47:38.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:38.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:39.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:39.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:40.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:40.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:41.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:41.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:42.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:42.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:43.305 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:47:43.307+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:47:43.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:43.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:44.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:44.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:45.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:45.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:46.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:46.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:47.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:47.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:48.306 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:47:48.308+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:47:48.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:48.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:49.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:49.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:50.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:50.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:51.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:51.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:52.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:52.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:53.307 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:47:53.308+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:47:53.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:53.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:54.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:54.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:55.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:55.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:56.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:56.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:57.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:57.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:58.308 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:47:58.309+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:47:58.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:58.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:47:59.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:47:59.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:00.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:00.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:01.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:01.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:02.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:02.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:03.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:48:03.310+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:48:03.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:03.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:04.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:04.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:05.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:05.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:06.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:06.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:07.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:07.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:08.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:48:08.311+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:48:08.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:08.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:09.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:09.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:10.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:10.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:11.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:11.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:12.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:12.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:13.311 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:48:13.312+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:48:13.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:13.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:14.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:14.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:15.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:15.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:16.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:16.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:17.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:17.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:18.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:18.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:18.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:48:18.314+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:48:19.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:19.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:20.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:20.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:21.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:21.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:22.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:22.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:23.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:23.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:23.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:48:23.315+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:48:24.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:24.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:25.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:25.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:26.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:26.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:27.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:27.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:28.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:28.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:28.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:48:28.315+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:48:29.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:29.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:30.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:30.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:31.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:31.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:32.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:32.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:33.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:33.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:33.315 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:48:33.316+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:48:34.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:34.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:35.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:35.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:36.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:36.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:37.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:37.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:38.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:38.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:38.316 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:48:38.317+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:48:39.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:39.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:40.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:40.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:41.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:41.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:42.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:42.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:43.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:43.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:43.317 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:48:43.318+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:48:44.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:44.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:45.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:45.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:46.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:46.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:47.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:47.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:48.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:48.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:48.318 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:48:48.320+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:48:49.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:49.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:50.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:50.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:51.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:51.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:52.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:52.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:53.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:53.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:53.319 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:48:53.320+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:48:54.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:54.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:55.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:55.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:56.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:56.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:57.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:57.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:58.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:58.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:48:58.320 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:48:58.321+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:48:59.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:48:59.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:00.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:00.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:01.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:01.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:02.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:02.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:03.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:03.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:04.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:04.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:05.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:05.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:06.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:06.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:07.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:07.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:08.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:08.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:08.322 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:49:08.323+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:49:09.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:09.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:10.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:10.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:11.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:11.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:12.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:12.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:13.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:13.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:13.323 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:49:13.325+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:49:14.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:14.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:15.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:15.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:16.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:16.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:17.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:17.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:18.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:18.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:18.324 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:49:18.326+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:49:19.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:19.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:20.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:20.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:21.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:21.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:22.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:22.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:23.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:23.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:23.325 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:49:23.326+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:49:24.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:24.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:25.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:25.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:26.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:26.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:27.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:27.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:28.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:28.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:28.325 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:49:28.327+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:49:29.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:29.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:30.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:30.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:31.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:31.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:32.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:32.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:33.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:33.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:33.326 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:49:33.328+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:49:34.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:34.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:35.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:35.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:36.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:36.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:37.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:37.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:38.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:38.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:38.327 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:49:38.328+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:49:39.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:39.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:40.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:40.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:41.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:41.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:42.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:42.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:43.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:43.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:43.328 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:49:43.329+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:49:44.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:44.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:45.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:45.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:46.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:46.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:47.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:47.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:48.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:48.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:48.329 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:49:48.331+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:49:49.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:49.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:50.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:50.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:51.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:51.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:52.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:52.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:53.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:53.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:53.330 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:49:53.332+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:49:54.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:54.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:55.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:55.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:56.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:56.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:57.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:57.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:58.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:58.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:49:58.331 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:49:58.332+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:49:59.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:49:59.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:00.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:00.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:01.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:01.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:02.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:02.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:03.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:03.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:03.332 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:50:03.334+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:50:04.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:04.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:05.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:05.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:06.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:06.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:07.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:07.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:08.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:08.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:08.333 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:50:08.334+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:50:09.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:09.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:10.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:10.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:11.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:11.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:12.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:12.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:13.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:13.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:13.334 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:50:13.335+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:50:14.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:14.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:15.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:15.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:16.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:16.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:17.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:17.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:18.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:18.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:18.335 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:50:18.337+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:50:19.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:19.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:20.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:20.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:21.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:21.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:22.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:22.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:23.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:23.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:23.336 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:50:23.337+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:50:24.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:24.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:25.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:25.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:26.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:26.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:27.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:27.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:28.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:28.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:28.337 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:50:28.338+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:50:29.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:29.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:30.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:30.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:31.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:31.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:32.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:32.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:33.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:33.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:33.338 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:50:33.340+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:50:34.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:34.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:35.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:35.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:36.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:36.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:37.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:37.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:38.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:38.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:38.339 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:50:38.340+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:50:39.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:39.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:40.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:40.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:41.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:41.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:42.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:42.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:43.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:43.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:43.340 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:50:43.341+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:50:44.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:44.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:45.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:45.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:46.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:46.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:47.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:47.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:48.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:48.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:48.341 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:50:48.343+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:50:49.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:49.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:50.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:50.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:51.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:51.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:52.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:52.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:53.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:53.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:53.342 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:50:53.344+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:50:54.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:54.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:55.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:55.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:56.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:56.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:57.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:57.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:58.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:58.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:50:58.343 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:50:58.344+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:50:59.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:50:59.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:00.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:00.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:01.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:01.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:02.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:02.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:03.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:03.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:03.344 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:51:03.346+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:51:04.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:04.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:05.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:05.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:06.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:06.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:07.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:07.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:08.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:08.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:08.345 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:51:08.346+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:51:09.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:09.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:10.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:10.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:11.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:11.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:12.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:12.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:13.346 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:51:13.347+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:51:13.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:13.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:14.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:14.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:15.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:15.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:16.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:16.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:17.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:17.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:18.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:18.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:18.346 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:51:18.348+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:51:19.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:19.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:20.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:20.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:21.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:21.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:22.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:22.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:23.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:23.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:23.348 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:51:23.349+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:51:24.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:24.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:25.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:25.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:26.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:26.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:27.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:27.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:28.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:28.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:28.349 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:51:28.350+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:51:29.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:29.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:30.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:30.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:31.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:31.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:32.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:32.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:33.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:33.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:33.350 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:51:33.351+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:51:34.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:34.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:35.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:35.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:36.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:36.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:37.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:37.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:38.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:38.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:38.351 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:51:38.352+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:51:39.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:39.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:40.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:40.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:41.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:41.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:42.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:42.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:43.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:43.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:43.352 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:51:43.354+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:51:44.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:44.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:45.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:45.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:46.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:46.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:47.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:47.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:48.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:48.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:48.353 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:51:48.354+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:51:49.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:49.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:50.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:50.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:51.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:51.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:52.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:52.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:53.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:53.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:53.353 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:51:53.355+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:51:54.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:54.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:55.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:55.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:56.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:56.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:57.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:57.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:58.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:58.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:51:58.354 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:51:58.356+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:51:59.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:51:59.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:00.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:00.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:01.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:01.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:02.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:02.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:03.356 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:52:03.357+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:52:03.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:03.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:04.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:04.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:05.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:05.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:06.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:06.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:07.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:07.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:08.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:08.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:08.356 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:52:08.358+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:52:09.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:09.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:10.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:10.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:11.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:11.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:12.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:12.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:13.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:13.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:13.357 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:52:13.360+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:52:14.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:14.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:15.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:15.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:16.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:16.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:17.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:17.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:18.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:18.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:18.359 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:52:18.361+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:52:19.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:19.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:20.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:20.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:21.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:21.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:22.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:22.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:23.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:23.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:23.359 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:52:23.360+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:52:24.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:24.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:25.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:25.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:26.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:26.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:27.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:27.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:28.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:28.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:28.360 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:52:28.361+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:52:29.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:29.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:30.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:30.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:31.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:31.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:32.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:32.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:33.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:33.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:33.361 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:52:33.362+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:52:34.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:34.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:35.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:35.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:36.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:36.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:37.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:37.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:38.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:38.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:38.362 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:52:38.363+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:52:39.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:39.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:40.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:40.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:41.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:41.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:42.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:42.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:43.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:43.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:43.363 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:52:43.364+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:52:44.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:44.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:45.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:45.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:46.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:46.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:47.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:47.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:48.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:48.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:48.364 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:52:48.366+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:52:49.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:49.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:50.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:50.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:51.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:51.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:52.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:52.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:53.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:53.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:53.365 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:52:53.367+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:52:54.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:54.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:55.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:55.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:56.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:56.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:57.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:57.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:58.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:58.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:52:58.366 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:52:58.368+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:52:59.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:52:59.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:00.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:00.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:01.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:01.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:02.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:02.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:03.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:03.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:03.367 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:53:03.369+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:53:04.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:04.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:05.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:05.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:06.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:06.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:07.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:07.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:08.368 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:53:08.369+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:53:08.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:08.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:09.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:09.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:10.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:10.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:11.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:11.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:12.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:12.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:13.369 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:53:13.370+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:53:13.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:13.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:14.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:14.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:15.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:15.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:16.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:16.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:17.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:17.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:18.370 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:53:18.372+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:53:18.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:18.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:19.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:19.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:20.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:20.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:21.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:21.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:22.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:22.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:23.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:23.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:23.371 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:53:23.372+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:53:24.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:24.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:25.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:25.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:26.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:26.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:27.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:27.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:28.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:28.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:28.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:53:28.373+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:53:29.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:29.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:30.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:30.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:31.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:31.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:32.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:32.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:33.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:33.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:33.373 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:53:33.374+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:53:34.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:34.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:35.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:35.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:36.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:36.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:37.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:37.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:38.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:38.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:38.374 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:53:38.375+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:53:39.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:39.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:40.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:40.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:41.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:41.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:42.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:42.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:43.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:43.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:43.375 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:53:43.377+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:53:44.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:44.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:45.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:45.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:46.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:46.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:47.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:47.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:48.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:48.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:48.376 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:53:48.378+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:53:49.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:49.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:50.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:50.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:51.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:51.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:52.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:52.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:53.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:53.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:53.377 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:53:53.378+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:53:54.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:54.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:55.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:55.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:56.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:56.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:57.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:57.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:58.378 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:53:58.379+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:53:58.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:58.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:53:59.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:53:59.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:00.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:00.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:01.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:01.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:02.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:02.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:03.379 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:54:03.380+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:54:03.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:03.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:04.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:04.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:05.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:05.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:06.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:06.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:07.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:07.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:08.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:54:08.381+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:54:08.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:08.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:09.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:09.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:10.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:10.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:11.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:11.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:12.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:12.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:13.381 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:54:13.382+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:54:13.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:13.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:14.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:14.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:15.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:15.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:16.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:16.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:17.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:17.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:18.383 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:54:18.384+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:54:18.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:18.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:19.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:19.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:20.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:20.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:21.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:21.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:22.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:22.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:23.383 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:54:23.384+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:54:23.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:23.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:24.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:24.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:25.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:25.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:26.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:26.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:27.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:27.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:28.384 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:54:28.385+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:54:28.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:28.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:29.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:29.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:30.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:30.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:31.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:31.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:32.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:32.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:33.385 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:54:33.387+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:54:33.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:33.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:34.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:34.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:35.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:35.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:36.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:36.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:37.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:37.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:38.387 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:54:38.388+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:54:38.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:38.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:39.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:39.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:40.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:40.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:41.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:41.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:42.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:42.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:43.387 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:54:43.389+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:54:43.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:43.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:44.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:44.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:45.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:45.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:46.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:46.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:47.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:47.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:48.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:54:48.389+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:54:48.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:48.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:49.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:49.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:50.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:50.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:51.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:51.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:52.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:52.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:53.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:54:53.390+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:54:53.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:53.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:54.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:54.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:55.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:55.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:56.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:56.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:57.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:57.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:58.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:58.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:54:58.390 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:54:58.391+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:54:59.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:54:59.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:00.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:00.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:01.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:01.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:02.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:02.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:03.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:03.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:03.391 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:55:03.393+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:55:04.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:04.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:05.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:05.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:06.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:06.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:07.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:07.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:08.392 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:55:08.393+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:55:08.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:08.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:09.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:09.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:10.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:10.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:11.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:11.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:12.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:12.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:13.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:13.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:13.393 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:55:13.395+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:55:14.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:14.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:15.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:15.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:16.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:16.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:17.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:17.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:18.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:18.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:18.394 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:55:18.396+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:55:19.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:19.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:20.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:20.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:21.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:21.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:22.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:22.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:23.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:23.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:23.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:55:23.397+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:55:24.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:24.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:25.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:25.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:26.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:26.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:27.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:27.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:28.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:28.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:28.395 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:55:28.396+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:55:29.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:29.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:30.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:30.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:31.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:31.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:32.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:32.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:33.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:33.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:33.396 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:55:33.397+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:55:34.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:34.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:35.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:35.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:36.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:36.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:37.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:37.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:38.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:38.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:38.397 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:55:38.398+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:55:39.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:39.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:40.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:40.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:41.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:41.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:42.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:42.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:43.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:43.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:43.398 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:55:43.399+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:55:44.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:44.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:45.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:45.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:46.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:46.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:47.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:47.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:48.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:48.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:48.399 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:55:48.400+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:55:49.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:49.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:50.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:50.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:51.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:51.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:52.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:52.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:53.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:53.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:53.400 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:55:53.401+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:55:54.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:54.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:55.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:55.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:56.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:56.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:57.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:57.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:58.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:58.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:55:58.401 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:55:58.402+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:55:59.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:55:59.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:00.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:00.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:01.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:01.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:02.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:02.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:03.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:03.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:03.402 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:56:03.403+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:56:04.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:04.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:05.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:05.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:06.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:06.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:07.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:07.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:08.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:08.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:08.403 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:56:08.404+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:56:09.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:09.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:10.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:10.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:11.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:11.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:12.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:12.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:13.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:13.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:13.404 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:56:13.405+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:56:14.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:14.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:15.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:15.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:16.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:16.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:17.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:17.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:18.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:18.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:18.405 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:56:18.406+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:56:19.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:19.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:20.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:20.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:21.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:21.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:22.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:22.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:23.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:23.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:23.406 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:56:23.407+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:56:24.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:24.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:25.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:25.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:26.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:26.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:27.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:27.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:28.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:28.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:28.407 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:56:28.408+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:56:29.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:29.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:30.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:30.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:31.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:31.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:32.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:32.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:33.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:33.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:33.407 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:56:33.409+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:56:34.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:34.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:35.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:35.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:36.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:36.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:37.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:37.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:38.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:38.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:38.408 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:56:38.410+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:56:39.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:39.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:40.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:40.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:41.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:41.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:42.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:42.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:43.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:43.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:43.410 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:56:43.411+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:56:44.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:44.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:45.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:45.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:46.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:46.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:47.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:47.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:48.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:48.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:48.411 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:56:48.412+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:56:49.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:49.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:50.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:50.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:51.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:51.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:52.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:52.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:53.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:53.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:53.412 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:56:53.413+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:56:54.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:54.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:55.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:55.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:56.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:56.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:57.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:57.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:58.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:58.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:56:58.413 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:56:58.414+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:56:59.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:56:59.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:00.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:00.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:01.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:01.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:02.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:02.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:03.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:03.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:03.414 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:57:03.415+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:57:04.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:04.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:05.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:05.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:06.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:06.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:07.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:07.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:08.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:08.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:08.415 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:57:08.416+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:57:09.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:09.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:10.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:10.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:11.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:11.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:12.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:12.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:13.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:13.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:13.416 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:57:13.417+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:57:14.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:14.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:15.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:15.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:16.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:16.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:17.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:17.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:18.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:18.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:18.417 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:57:18.418+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:57:19.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:19.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:20.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:20.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:21.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:21.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:22.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:22.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:23.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:23.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:23.418 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:57:23.419+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:57:24.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:24.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:25.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:25.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:26.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:26.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:27.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:27.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:28.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:28.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:28.419 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:57:28.420+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:57:29.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:29.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:30.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:30.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:31.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:31.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:32.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:32.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:33.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:33.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:33.420 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:57:33.421+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:57:34.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:34.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:35.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:35.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:36.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:36.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:37.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:37.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:38.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:38.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:38.421 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:57:38.422+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:57:39.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:39.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:40.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:40.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:41.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:41.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:42.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:42.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:43.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:43.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:43.422 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:57:43.423+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:57:44.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:44.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:45.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:45.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:46.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:46.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:47.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:47.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:48.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:48.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:48.423 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:57:48.424+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:57:49.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:49.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:50.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:50.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:51.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:51.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:52.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:52.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:53.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:53.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:53.424 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:57:53.425+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:57:54.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:54.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:55.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:55.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:56.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:56.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:57.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:57.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:58.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:58.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:57:58.425 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:57:58.426+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:57:59.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:57:59.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:00.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:00.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:01.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:01.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:02.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:02.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:03.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:03.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:03.426 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:58:03.427+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:58:04.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:04.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:05.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:05.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:06.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:06.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:07.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:07.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:08.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:08.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:08.427 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:58:08.428+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:58:09.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:09.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:10.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:10.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:11.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:11.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:12.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:12.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:13.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:13.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:13.428 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:58:13.429+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:58:14.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:14.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:15.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:15.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:16.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:16.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:17.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:17.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:18.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:18.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:18.429 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:58:18.431+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:58:19.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:19.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:20.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:20.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:21.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:21.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:22.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:22.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:23.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:23.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:23.429 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:58:23.432+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:58:24.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:24.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:25.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:25.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:26.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:26.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:27.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:27.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:28.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:28.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:28.430 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:58:28.433+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:58:29.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:29.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:30.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:30.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:31.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:31.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:32.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:32.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:33.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:33.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:33.432 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:58:33.433+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:58:34.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:34.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:35.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:35.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:36.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:36.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:37.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:37.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:38.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:38.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:38.432 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:58:38.433+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:58:39.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:39.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:40.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:40.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:41.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:41.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:42.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:42.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:43.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:43.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:43.433 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:58:43.434+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:58:44.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:44.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:45.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:45.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:46.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:46.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:47.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:47.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:48.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:48.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:48.434 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:58:48.435+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:58:49.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:49.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:50.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:50.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:51.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:51.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:52.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:52.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:53.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:53.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:53.435 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:58:53.436+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:58:54.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:54.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:55.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:55.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:56.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:56.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:57.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:57.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:58.436 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:58:58.437+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:58:58.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:58.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:58:59.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:58:59.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:00.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:00.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:01.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:01.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:02.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:02.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:03.437 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:59:03.438+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:59:03.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:03.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:04.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:04.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:05.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:05.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:06.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:06.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:07.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:07.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:08.437 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:59:08.439+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:59:08.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:08.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:09.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:09.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:10.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:10.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:11.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:11.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:12.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:12.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:13.439 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:59:13.440+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:59:13.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:13.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:14.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:14.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:15.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:15.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:16.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:16.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:17.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:17.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:18.440 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:59:18.441+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:59:18.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:18.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:19.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:19.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:20.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:20.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:21.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:21.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:22.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:22.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:23.441 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:59:23.442+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:59:23.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:23.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:24.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:24.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:25.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:25.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:26.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:26.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:27.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:27.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:28.441 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:59:28.443+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:59:28.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:28.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:29.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:29.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:30.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:30.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:31.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:31.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:32.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:32.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:33.442 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:59:33.443+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:59:33.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:33.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:34.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:34.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:35.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:35.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:36.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:36.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:37.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:37.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:38.443 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:59:38.445+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:59:38.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:38.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:39.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:39.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:40.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:40.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:41.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:41.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:42.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:42.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:43.444 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:59:43.446+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:59:43.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:43.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:44.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:44.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:45.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:45.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:46.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:46.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:47.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:47.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:48.445 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:59:48.447+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:59:48.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:48.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:49.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:49.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:50.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:50.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:51.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:51.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:52.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:52.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:53.447 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:59:53.448+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:59:53.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:53.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:54.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:54.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:55.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:55.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:56.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:56.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:57.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:57.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:58.448 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T07:59:58.449+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T07:59:58.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:58.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T07:59:59.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T07:59:59.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:00.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:00.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:01.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:01.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:02.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:02.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:03.449 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:00:03.450+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:00:03.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:03.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:04.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:04.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:05.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:05.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:06.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:06.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:07.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:07.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:08.449 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:00:08.451+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:00:08.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:08.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:09.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:09.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:10.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:10.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:11.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:11.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:12.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:12.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:13.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:00:13.452+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:00:13.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:13.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:14.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:14.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:15.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:15.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:16.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:16.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:17.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:17.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:18.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:00:18.453+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:00:18.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:18.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:19.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:19.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:20.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:20.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:21.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:21.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:22.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:22.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:23.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:00:23.454+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:00:23.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:23.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:24.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:24.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:25.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:25.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:26.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:26.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:27.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:27.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:28.453 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:00:28.455+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:00:28.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:28.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:29.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:29.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:30.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:30.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:31.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:31.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:32.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:32.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:33.455 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:00:33.457+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:00:33.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:33.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:34.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:34.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:35.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:35.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:36.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:36.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:37.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:37.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:38.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:00:38.457+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:00:38.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:38.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:39.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:39.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:40.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:40.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:41.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:41.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:42.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:42.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:43.457 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:00:43.458+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:00:43.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:43.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:44.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:44.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:45.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:45.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:46.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:46.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:47.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:47.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:48.458 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:00:48.459+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:00:48.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:48.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:49.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:49.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:50.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:50.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:51.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:51.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:52.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:52.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:53.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:00:53.460+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:00:53.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:53.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:54.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:54.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:55.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:55.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:56.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:56.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:57.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:57.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:58.460 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:00:58.461+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:00:58.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:58.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:00:59.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:00:59.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:00.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:00.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:01.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:01.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:02.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:02.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:03.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:01:03.462+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:01:03.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:03.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:04.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:04.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:05.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:05.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:06.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:06.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:07.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:07.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:08.462 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:01:08.463+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:01:08.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:08.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:09.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:09.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:10.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:10.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:11.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:11.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:12.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:12.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:13.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:01:13.464+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:01:13.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:13.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:14.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:14.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:15.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:15.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:16.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:16.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:17.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:17.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:18.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:01:18.465+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:01:18.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:18.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:19.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:19.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:20.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:20.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:21.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:21.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:22.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:22.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:23.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:01:23.467+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:01:23.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:23.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:24.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:24.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:25.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:25.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:26.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:26.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:27.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:27.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:28.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:01:28.468+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:01:28.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:28.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:29.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:29.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:30.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:30.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:31.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:31.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:32.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:32.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:33.467 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:01:33.468+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:01:33.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:33.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:34.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:34.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:35.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:35.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:36.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:36.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:37.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:37.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:38.468 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:01:38.469+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:01:38.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:38.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:39.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:39.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:40.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:40.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:41.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:41.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:42.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:42.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:43.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:01:43.470+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:01:43.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:43.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:44.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:44.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:45.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:45.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:46.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:46.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:47.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:47.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:48.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:01:48.471+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:01:48.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:48.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:49.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:49.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:50.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:50.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:51.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:51.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:52.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:52.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:53.471 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:01:53.472+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:01:53.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:53.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:54.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:54.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:55.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:55.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:56.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:56.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:57.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:57.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:58.471 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:01:58.472+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:01:58.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:58.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:01:59.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:01:59.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:00.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:00.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:02.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:02.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:03.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:03.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:03.472 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:02:03.474+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:02:04.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:04.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:05.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:05.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:06.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:06.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:06.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:06.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:07.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:07.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:08.474 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:02:08.475+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:02:08.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:08.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:09.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:09.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:10.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:10.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:11.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:11.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:12.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:12.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:13.474 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:02:13.475+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:02:13.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:13.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:14.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:14.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:15.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:15.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:16.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:16.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:17.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:17.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:18.475 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:02:18.476+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:02:18.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:18.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:19.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:19.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:20.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:20.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:21.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:21.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:22.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:22.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:23.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:02:23.477+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:02:23.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:23.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:24.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:24.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:25.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:25.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:26.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:26.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:27.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:27.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:28.478 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:02:28.479+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:02:28.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:28.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:29.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:29.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:30.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:30.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:31.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:31.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:32.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:32.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:33.478 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:02:33.479+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:02:33.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:33.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:34.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:34.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:35.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:35.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:36.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:36.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:37.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:37.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:38.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:02:38.480+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:02:38.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:38.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:39.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:39.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:40.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:40.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:41.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:41.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:42.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:42.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:43.480 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:02:43.481+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:02:43.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:43.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:44.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:44.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:45.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:45.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:46.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:46.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:47.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:47.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:48.481 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:02:48.483+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:02:48.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:48.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:49.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:49.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:50.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:50.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:51.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:51.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:52.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:52.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:53.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:02:53.483+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:02:53.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:53.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:54.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:54.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:55.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:55.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:56.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:56.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:57.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:57.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:58.483 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:02:58.484+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:02:58.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:58.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:02:59.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:02:59.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:00.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:00.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:01.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:01.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:02.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:02.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:03.484 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:03:03.485+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:03:03.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:03.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:04.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:04.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:05.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:05.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:06.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:06.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:07.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:07.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:08.485 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:03:08.486+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:03:08.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:08.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:09.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:09.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:10.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:10.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:11.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:11.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:12.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:12.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:13.486 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:03:13.487+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:03:13.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:13.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:14.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:14.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:15.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:15.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:16.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:16.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:17.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:17.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:18.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:03:18.488+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:03:18.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:18.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:19.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:19.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:20.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:20.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:21.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:21.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:22.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:22.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:23.488 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:03:23.489+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:03:23.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:23.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:24.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:24.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:25.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:25.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:26.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:26.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:27.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:27.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:28.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:03:28.491+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:03:28.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:28.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:29.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:29.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:30.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:30.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:31.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:31.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:32.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:32.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:33.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:03:33.491+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:03:33.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:33.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:34.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:34.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:35.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:35.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:36.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:36.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:37.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:37.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:38.491 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:03:38.493+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:03:38.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:38.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:39.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:39.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:40.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:40.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:41.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:41.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:42.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:42.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:43.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:03:43.493+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:03:43.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:43.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:45.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:45.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:46.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:46.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:47.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:47.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:48.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:48.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:48.493 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:03:48.494+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:03:49.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:49.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:50.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:50.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:51.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:51.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:52.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:52.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:53.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:53.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:53.494 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:03:53.495+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:03:54.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:54.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:55.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:55.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:56.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:56.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:57.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:57.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:58.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:58.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:03:58.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:03:58.496+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:03:59.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:03:59.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:00.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:00.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:01.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:01.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:02.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:02.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:03.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:03.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:03.496 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:04:03.497+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:04:04.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:04.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:05.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:05.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:06.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:06.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:07.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:07.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:08.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:08.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:08.497 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:04:08.498+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:04:09.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:09.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:10.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:10.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:11.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:11.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:12.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:12.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:13.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:13.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:13.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:04:13.500+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:04:14.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:14.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:15.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:15.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:16.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:16.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:17.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:17.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:18.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:18.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:18.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:04:18.500+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:04:19.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:19.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:20.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:20.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:21.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:21.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:22.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:22.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:23.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:23.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:23.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:04:23.502+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:04:24.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:24.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:25.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:25.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:26.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:26.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:27.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:27.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:28.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:28.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:28.501 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:04:28.503+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:04:29.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:29.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:30.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:30.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:31.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:31.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:32.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:32.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:33.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:33.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:33.501 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:04:33.504+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:04:34.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:34.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:35.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:35.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:36.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:36.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:37.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:37.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:38.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:38.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:38.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:04:38.503+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:04:39.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:39.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:40.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:40.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:41.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:41.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:42.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:42.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:43.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:43.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:43.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:04:43.505+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:04:44.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:44.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:45.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:45.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:46.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:46.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:47.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:47.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:48.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:48.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:48.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:04:48.505+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:04:49.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:49.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:50.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:50.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:51.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:51.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:52.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:52.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:53.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:53.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:53.506 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:04:53.507+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:04:54.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:54.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:55.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:55.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:56.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:56.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:57.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:57.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:58.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:58.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:04:58.507 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:04:58.508+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:04:59.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:04:59.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:00.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:00.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:01.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:01.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:02.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:02.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:03.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:03.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:03.507 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:05:03.508+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:05:04.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:04.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:05.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:05.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:06.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:06.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:07.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:07.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:08.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:08.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:08.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:05:08.509+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:05:09.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:09.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:10.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:10.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:11.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:11.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:12.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:12.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:13.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:13.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:13.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:05:13.511+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:05:14.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:14.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:15.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:15.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:16.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:16.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:17.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:17.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:18.510 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:05:18.511+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:05:18.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:18.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:19.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:19.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:20.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:20.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:21.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:21.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:22.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:22.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:23.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:23.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:23.511 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:05:23.512+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:05:24.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:24.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:25.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:25.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:26.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:26.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:27.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:27.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:28.512 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:05:28.513+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:05:28.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:28.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:29.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:29.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:30.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:30.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:31.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:31.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:32.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:32.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:33.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:33.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:33.512 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:05:33.514+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:05:34.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:34.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:35.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:35.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:36.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:36.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:37.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:37.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:38.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:38.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:38.514 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:05:38.515+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:05:39.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:39.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:40.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:40.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:41.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:41.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:42.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:42.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:43.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:43.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:43.515 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:05:43.516+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:05:44.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:44.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:45.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:45.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:46.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:46.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:47.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:47.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:48.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:48.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:48.516 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:05:48.517+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:05:49.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:49.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:50.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:50.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:51.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:51.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:52.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:52.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:53.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:53.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:53.517 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:05:53.518+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:05:54.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:54.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:55.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:55.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:56.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:56.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:57.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:57.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:58.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:58.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:05:58.518 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:05:58.520+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:05:59.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:05:59.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:00.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:00.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:01.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:01.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:02.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:02.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:03.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:03.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:03.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:06:03.520+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:06:04.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:04.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:05.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:05.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:06.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:06.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:07.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:07.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:08.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:08.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:08.520 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:06:08.521+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:06:09.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:09.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:10.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:10.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:11.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:11.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:12.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:12.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:13.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:13.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:13.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:06:13.522+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:06:14.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:14.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:15.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:15.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:16.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:16.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:17.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:17.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:18.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:18.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:18.522 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:06:18.523+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:06:19.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:19.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:20.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:20.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:21.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:21.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:22.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:22.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:23.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:23.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:23.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:06:23.524+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:06:24.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:24.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:25.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:25.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:26.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:26.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:27.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:27.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:28.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:28.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:28.524 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:06:28.525+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:06:29.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:29.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:30.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:30.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:31.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:31.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:32.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:32.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:33.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:33.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:33.525 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:06:33.527+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:06:34.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:34.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:35.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:35.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:36.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:36.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:37.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:37.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:38.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:38.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:38.526 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:06:38.527+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:06:39.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:39.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:40.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:40.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:41.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:41.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:42.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:42.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:43.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:43.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:43.527 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:06:43.528+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:06:44.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:44.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:45.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:45.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:46.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:46.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:47.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:47.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:48.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:48.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:48.528 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:06:48.529+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:06:49.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:49.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:50.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:50.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:51.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:51.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:52.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:52.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:53.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:53.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:53.529 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:06:53.531+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:06:54.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:54.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:55.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:55.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:56.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:56.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:57.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:57.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:58.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:58.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:06:58.530 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:06:58.531+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:06:59.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:06:59.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:00.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:00.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:01.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:01.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:02.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:02.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:03.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:03.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:03.531 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:07:03.533+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:07:04.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:04.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:05.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:05.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:06.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:06.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:07.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:07.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:08.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:08.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:08.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:07:08.533+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:07:09.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:09.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:10.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:10.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:11.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:11.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:12.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:12.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:13.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:13.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:13.533 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:07:13.534+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:07:14.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:14.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:15.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:15.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:16.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:16.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:17.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:17.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:18.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:18.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:18.534 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:07:18.535+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:07:19.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:19.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:20.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:20.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:21.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:21.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:22.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:22.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:23.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:23.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:23.535 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:07:23.537+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:07:24.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:24.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:25.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:25.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:26.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:26.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:27.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:27.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:28.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:28.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:28.536 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:07:28.538+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:07:29.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:29.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:30.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:30.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:31.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:31.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:32.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:32.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:33.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:33.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:33.536 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:07:33.538+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:07:34.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:34.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:35.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:35.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:36.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:36.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:37.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:37.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:38.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:38.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:38.537 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:07:38.538+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:07:39.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:39.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:40.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:40.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:41.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:41.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:42.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:42.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:43.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:43.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:43.537 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:07:43.539+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:07:44.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:44.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:45.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:45.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:46.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:46.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:47.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:47.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:48.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:48.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:48.540 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:07:48.540+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:07:49.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:49.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:50.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:50.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:51.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:51.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:52.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:52.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:53.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:53.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:53.540 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:07:53.541+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:07:54.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:54.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:55.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:55.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:56.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:56.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:57.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:57.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:58.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:58.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:07:58.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:07:58.542+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:07:59.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:07:59.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:00.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:00.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:01.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:01.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:02.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:02.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:03.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:03.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:03.542 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:08:03.543+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:08:04.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:04.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:05.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:05.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:06.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:06.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:07.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:07.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:08.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:08.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:08.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:08:08.544+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:08:09.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:09.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:10.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:10.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:11.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:11.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:12.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:12.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:13.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:13.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:13.544 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:08:13.545+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:08:14.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:14.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:15.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:15.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:16.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:16.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:17.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:17.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:18.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:18.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:18.544 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:08:18.546+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:08:19.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:19.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:20.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:20.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:21.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:21.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:22.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:22.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:23.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:23.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:23.546 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:08:23.547+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:08:24.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:24.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:25.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:25.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:26.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:26.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:27.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:27.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:28.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:28.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:28.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:08:28.548+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:08:29.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:29.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:30.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:30.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:31.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:31.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:32.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:32.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:33.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:33.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:33.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:08:33.549+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:08:34.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:34.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:35.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:35.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:36.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:36.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:37.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:37.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:38.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:38.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:38.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:08:38.550+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:08:39.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:39.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:40.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:40.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:41.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:41.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:42.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:42.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:43.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:43.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:43.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:08:43.551+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:08:44.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:44.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:45.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:45.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:46.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:46.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:47.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:47.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:48.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:48.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:48.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:08:48.552+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:08:49.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:49.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:50.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:50.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:51.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:51.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:52.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:52.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:53.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:53.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:53.552 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:08:53.553+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:08:54.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:54.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:55.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:55.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:56.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:56.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:57.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:57.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:58.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:58.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:08:58.553 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:08:58.554+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:08:59.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:08:59.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:00.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:00.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:01.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:01.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:02.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:02.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:03.555 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:09:03.556+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:09:03.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:03.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:04.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:04.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:05.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:05.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:06.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:06.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:07.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:07.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:08.555 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:09:08.556+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:09:08.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:08.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:09.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:09.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:10.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:10.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:11.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:11.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:12.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:12.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:13.556 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:09:13.557+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:09:13.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:13.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:14.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:14.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:15.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:15.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:16.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:16.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:17.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:17.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:18.558 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:09:18.558+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:09:18.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:18.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:19.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:19.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:20.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:20.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:21.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:21.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:22.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:22.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:23.558 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:09:23.559+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:09:23.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:23.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:24.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:24.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:25.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:25.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:26.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:26.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:27.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:27.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:28.559 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:09:28.560+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:09:28.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:28.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:29.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:29.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:30.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:30.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:31.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:31.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:32.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:32.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:33.560 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:09:33.562+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:09:33.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:33.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:34.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:34.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:35.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:35.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:36.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:36.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:37.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:37.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:38.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:38.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:38.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:09:38.562+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:09:39.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:39.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:40.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:40.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:41.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:41.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:42.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:42.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:43.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:43.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:43.562 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:09:43.563+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:09:44.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:44.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:45.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:45.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:46.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:46.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:47.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:47.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:48.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:48.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:48.563 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:09:48.564+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:09:49.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:49.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:50.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:50.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:51.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:51.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:52.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:52.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:53.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:53.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:53.564 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:09:53.565+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:09:54.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:54.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:55.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:55.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:56.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:56.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:57.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:57.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:58.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:58.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:09:58.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:09:58.566+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:09:59.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:09:59.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:00.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:00.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:01.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:01.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:02.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:02.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:03.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:03.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:03.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:10:03.567+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:10:04.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:04.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:05.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:05.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:06.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:06.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:07.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:07.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:08.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:10:08.568+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:10:08.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:08.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:09.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:09.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:10.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:10.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:11.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:11.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:12.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:12.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:13.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:10:13.569+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:10:13.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:13.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:14.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:14.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:15.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:15.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:16.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:16.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:17.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:17.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:18.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:10:18.571+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:10:18.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:18.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:19.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:19.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:20.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:20.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:21.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:21.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:22.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:22.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:23.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:23.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:23.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:10:23.573+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:10:24.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:24.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:25.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:25.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:26.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:26.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:27.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:27.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:28.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:28.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:28.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:10:28.573+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:10:29.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:29.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:30.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:30.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:31.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:31.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:32.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:32.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:33.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:33.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:34.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:34.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:35.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:35.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:36.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:36.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:37.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:37.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:38.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:38.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:38.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:10:38.574+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:10:39.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:39.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:40.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:40.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:41.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:41.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:42.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:42.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:43.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:43.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:43.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:10:43.574+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:10:44.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:44.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:45.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:45.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:46.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:46.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:47.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:47.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:48.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:48.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:48.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:10:48.575+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:10:49.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:49.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:50.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:50.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:51.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:51.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:52.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:52.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:53.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:53.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:53.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:10:53.577+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:10:54.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:54.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:55.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:55.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:56.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:56.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:57.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:57.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:58.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:58.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:10:58.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:10:58.577+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:10:59.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:10:59.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:00.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:00.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:01.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:01.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:02.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:02.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:03.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:03.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:03.577 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:11:03.578+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:11:04.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:04.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:05.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:05.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:06.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:06.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:07.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:07.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:08.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:08.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:08.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:11:08.580+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:11:09.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:09.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:10.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:10.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:11.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:11.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:12.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:12.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:13.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:13.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:14.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:14.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:15.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:15.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:16.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:16.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:16.823 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:11:16.824+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:11:17.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:17.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:18.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:18.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:19.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:19.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:20.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:20.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:21.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:21.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:21.824 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:11:21.825+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:11:22.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:22.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:23.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:23.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:24.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:24.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:25.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:25.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:26.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:26.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:26.826 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:11:26.827+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:11:27.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:27.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:28.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:28.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:29.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:29.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:30.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:30.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:31.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:31.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:31.827 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:11:31.828+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:11:32.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:32.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:33.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:33.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:34.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:34.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:35.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:35.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:36.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:36.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:36.828 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:11:36.830+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:11:37.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:37.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:38.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:38.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:39.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:39.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:40.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:40.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:41.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:41.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:41.830 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:11:41.831+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:11:42.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:42.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:43.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:43.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:44.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:44.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:45.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:45.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:46.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:46.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:46.831 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:11:46.833+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:11:47.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:47.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:48.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:48.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:49.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:49.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:50.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:50.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:51.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:51.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:51.833 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:11:51.834+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:11:52.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:52.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:53.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:53.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:54.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:54.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:55.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:55.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:56.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:56.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:56.834 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:11:56.835+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:11:57.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:57.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:58.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:58.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:11:59.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:11:59.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:00.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:00.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:01.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:01.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:01.836 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:12:01.836+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:12:02.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:02.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:03.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:03.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:04.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:04.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:05.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:05.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:06.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:06.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:06.837 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:12:06.838+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:12:07.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:07.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:08.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:08.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:09.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:09.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:10.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:10.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:11.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:11.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:11.838 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:12:11.840+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:12:12.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:12.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:13.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:13.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:14.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:14.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:15.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:15.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:16.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:16.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:16.840 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:12:16.841+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:12:17.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:17.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:18.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:18.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:19.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:19.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:20.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:20.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:21.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:21.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:21.842 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:12:21.843+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:12:22.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:22.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:23.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:23.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:24.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:24.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:25.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:25.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:26.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:26.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:26.843 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:12:26.844+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:12:27.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:27.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:28.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:28.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:29.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:29.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:30.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:30.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:31.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:31.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:31.845 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:12:31.846+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:12:32.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:32.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:33.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:33.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:34.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:34.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:35.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:35.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:36.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:36.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:36.846 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:12:36.847+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:12:37.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:37.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:38.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:38.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:39.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:39.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:40.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:40.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:41.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:41.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:41.848 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:12:41.849+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:12:42.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:42.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:43.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:43.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:44.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:44.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:45.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:45.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:46.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:46.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:46.849 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:12:46.850+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:12:47.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:47.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:48.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:48.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:49.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:49.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:50.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:50.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:51.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:51.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:51.851 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:12:51.853+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:12:52.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:52.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:53.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:53.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:54.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:54.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:55.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:55.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:56.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:56.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:56.852 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:12:56.854+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:12:57.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:57.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:58.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:58.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:12:59.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:12:59.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:00.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:00.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:01.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:01.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:01.854 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:13:01.855+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:13:02.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:02.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:03.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:03.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:04.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:04.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:05.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:05.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:06.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:06.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:06.856 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:13:06.857+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:13:07.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:07.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:08.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:08.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:09.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:09.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:10.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:10.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:11.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:11.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:11.857 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:13:11.859+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:13:12.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:12.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:13.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:13.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:14.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:14.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:15.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:15.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:16.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:16.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:16.858 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:13:16.860+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:13:17.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:17.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:18.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:18.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:19.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:19.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:20.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:20.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:21.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:21.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:21.860 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:13:21.862+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:13:22.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:22.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:23.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:23.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:24.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:24.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:25.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:25.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:26.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:26.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:26.861 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:13:26.863+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:13:27.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:27.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:28.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:28.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:29.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:29.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:30.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:30.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:31.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:31.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:31.862 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:13:31.863+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:13:32.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:32.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:33.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:33.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:34.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:34.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:35.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:35.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:36.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:36.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:36.864 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:13:36.865+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:13:37.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:37.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:38.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:38.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:39.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:39.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:40.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:40.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:41.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:41.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:41.865 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:13:41.866+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:13:42.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:42.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:43.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:43.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:44.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:44.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:45.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:45.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:46.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:46.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:46.866 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:13:46.867+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:13:47.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:47.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:48.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:48.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:49.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:49.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:50.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:50.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:51.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:51.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:51.868 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:13:51.869+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:13:52.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:52.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:53.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:53.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:54.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:54.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:54.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:55.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:56.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:56.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:56.869 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:13:56.870+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:13:57.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:57.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:58.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:58.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:13:59.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:13:59.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:00.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:00.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:01.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:01.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:01.870 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:14:01.871+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:14:02.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:02.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:03.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:03.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:04.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:04.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:05.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:05.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:06.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:06.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:06.872 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:14:06.873+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:14:07.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:07.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:08.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:08.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:09.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:09.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:10.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:10.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:11.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:11.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:11.873 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:14:11.874+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:14:12.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:12.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:13.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:13.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:14.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:14.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:15.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:15.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:16.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:16.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:16.874 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:14:16.875+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:14:17.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:17.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:18.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:18.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:19.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:19.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:20.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:20.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:21.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:21.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:21.875 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:14:21.876+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:14:22.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:22.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:23.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:23.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:24.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:24.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:25.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:25.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:26.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:26.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:26.877 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:14:26.878+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:14:27.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:27.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:28.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:28.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:29.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:29.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:30.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:30.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:31.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:31.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:31.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:14:31.879+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:14:32.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:32.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:33.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:33.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:34.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:34.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:35.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:35.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:36.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:36.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:36.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:14:36.880+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:14:37.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:37.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:38.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:38.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:39.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:39.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:40.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:40.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:41.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:41.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:41.881 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:14:41.882+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:14:42.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:42.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:43.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:43.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:44.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:44.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:45.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:45.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:46.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:46.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:46.882 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:14:46.883+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:14:47.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:47.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:48.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:48.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:49.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:49.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:50.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:50.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:51.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:51.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:51.883 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:14:51.884+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:14:51.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:51.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:52.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:52.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:53.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:53.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:54.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:54.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:55.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:56.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:56.884 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:14:56.885+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:14:57.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:57.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:57.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:57.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:58.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:58.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:14:59.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:14:59.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:00.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:00.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:01.885 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:15:01.887+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:15:01.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:01.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:02.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:02.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:03.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:03.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:04.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:04.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:05.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:05.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:06.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:06.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:06.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:15:06.888+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:15:07.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:07.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:08.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:08.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:09.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:09.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:10.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:10.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:11.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:11.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:11.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:15:11.889+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:15:12.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:12.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:13.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:13.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:14.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:14.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:15.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:15.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:16.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:16.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:16.889 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:15:16.890+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:15:17.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:17.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:18.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:18.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:19.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:19.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:20.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:20.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:21.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:21.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:21.890 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:15:21.891+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:15:22.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:22.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:23.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:23.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:24.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:24.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:25.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:25.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:26.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:26.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:26.892 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:15:26.893+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:15:27.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:27.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:28.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:28.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:29.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:29.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:30.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:30.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:31.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:31.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:31.893 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:15:31.894+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:15:32.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:32.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:33.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:33.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:34.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:34.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:35.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:35.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:36.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:36.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:36.895 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:15:36.896+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:15:37.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:37.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:38.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:38.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:39.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:39.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:40.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:40.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:41.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:41.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:41.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:15:41.897+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:15:42.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:42.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:43.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:43.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:44.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:44.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:45.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:45.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:46.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:46.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:46.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:15:46.899+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:15:47.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:47.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:48.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:48.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:49.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:49.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:50.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:50.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:51.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:51.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:51.898 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:15:51.900+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:15:52.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:52.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:53.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:53.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:54.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:54.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:55.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:55.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:56.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:56.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:56.900 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:15:56.901+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:15:57.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:57.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:58.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:58.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:15:59.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:15:59.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:00.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:00.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:01.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:01.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:01.901 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:16:01.902+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:16:02.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:02.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:03.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:03.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:04.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:04.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:05.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:05.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:06.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:06.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:06.940 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:16:06.903+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:16:07.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:07.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:08.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:08.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:09.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:09.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:10.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:10.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:11.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:11.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:11.904 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:16:11.905+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:16:12.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:12.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:13.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:13.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:14.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:14.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:15.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:15.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:16.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:16.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:17.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:17.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:18.639 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:16:18.641+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:16:18.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:18.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:19.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:19.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:20.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:20.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:21.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:21.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:22.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:22.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:23.640 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:16:23.641+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:16:23.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:23.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:24.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:24.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:25.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:25.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:26.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:26.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:27.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:27.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:28.641 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:16:28.642+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:16:28.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:28.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:29.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:29.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:30.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:30.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:31.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:31.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:32.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:32.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:33.642 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:16:33.643+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:16:33.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:33.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:34.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:34.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:35.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:35.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:36.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:36.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:37.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:37.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:38.642 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:16:38.643+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:16:38.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:38.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:39.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:39.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:40.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:40.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:41.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:41.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:42.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:42.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:43.643 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:16:43.644+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:16:43.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:43.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:44.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:44.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:45.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:45.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:46.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:46.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:47.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:47.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:48.644 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:16:48.645+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:16:48.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:48.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:49.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:49.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:50.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:50.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:51.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:51.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:52.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:52.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:53.645 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:16:53.646+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:16:53.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:53.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:54.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:54.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:55.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:55.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:56.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:56.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:57.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:57.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:58.646 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:16:58.648+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:16:58.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:58.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:16:59.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:16:59.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:00.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:00.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:01.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:01.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:02.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:02.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:03.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:17:03.649+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:17:03.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:03.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:04.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:04.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:05.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:05.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:06.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:06.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:07.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:07.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:08.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:17:08.650+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:17:08.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:08.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:09.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:09.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:10.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:10.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:11.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:11.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:12.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:12.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:13.649 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:17:13.650+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:17:13.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:13.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:14.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:14.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:15.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:15.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:16.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:16.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:17.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:17.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:18.650 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:17:18.651+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:17:18.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:18.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:19.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:19.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:20.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:20.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:21.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:21.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:22.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:22.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:23.651 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:17:23.652+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:17:23.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:23.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:24.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:24.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:25.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:25.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:26.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:26.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:27.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:27.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:28.653 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:17:28.653+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:17:28.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:28.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:29.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:29.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:30.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:30.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:31.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:31.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:32.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:32.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:33.653 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:17:33.654+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:17:33.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:33.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:34.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:34.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:35.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:35.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:36.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:36.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:37.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:37.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:38.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:38.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:38.654 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:17:38.655+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:17:39.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:39.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:40.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:40.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:41.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:41.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:42.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:42.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:43.656 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:17:43.656+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:17:43.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:43.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:44.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:44.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:45.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:45.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:46.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:46.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:47.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:47.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:48.656 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:17:48.657+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:17:48.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:48.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:49.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:49.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:50.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:50.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:51.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:51.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:52.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:52.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:53.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:53.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:53.657 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:17:53.658+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:17:54.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:54.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:55.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:55.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:56.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:56.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:57.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:57.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:58.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:58.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:17:58.658 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:17:58.659+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:17:59.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:17:59.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:00.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:00.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:01.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:01.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:02.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:02.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:03.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:03.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:03.659 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:18:03.660+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:18:04.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:04.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:05.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:05.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:06.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:06.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:07.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:07.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:08.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:08.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:08.660 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:18:08.661+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:18:09.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:09.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:10.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:10.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:11.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:11.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:12.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:12.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:13.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:13.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:13.661 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:18:13.662+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:18:14.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:14.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:15.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:15.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:16.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:16.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:17.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:17.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:18.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:18.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:18.662 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:18:18.663+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:18:19.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:19.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:20.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:20.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:21.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:21.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:22.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:22.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:23.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:23.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:23.663 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:18:23.664+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:18:24.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:24.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:25.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:25.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:26.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:26.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:27.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:27.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:28.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:28.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:28.664 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:18:28.665+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:18:29.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:29.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:30.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:30.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:31.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:31.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:32.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:32.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:33.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:33.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:33.665 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:18:33.666+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:18:34.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:34.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:35.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:35.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:36.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:36.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:37.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:37.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:38.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:38.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:38.666 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:18:38.667+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:18:39.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:39.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:40.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:40.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:41.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:41.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:42.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:42.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:43.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:43.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:43.668 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:18:43.669+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:18:44.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:44.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:45.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:45.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:46.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:46.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:47.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:47.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:48.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:48.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:48.668 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:18:48.669+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:18:49.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:49.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:50.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:50.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:51.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:51.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:52.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:52.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:53.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:53.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:53.669 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:18:53.670+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:18:54.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:54.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:55.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:55.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:56.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:56.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:57.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:57.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:58.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:58.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:18:58.670 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:18:58.671+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:18:59.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:18:59.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:00.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:00.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:01.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:01.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:02.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:02.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:03.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:03.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:03.671 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:19:03.673+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:19:04.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:04.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:05.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:05.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:06.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:06.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:07.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:07.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:08.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:08.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:08.672 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:19:08.674+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:19:09.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:09.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:10.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:10.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:11.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:11.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:12.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:12.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:13.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:13.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:13.672 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:19:13.673+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:19:14.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:14.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:15.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:15.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:16.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:16.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:17.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:17.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:18.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:18.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:18.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:19:18.674+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:19:19.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:19.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:20.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:20.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:21.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:21.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:22.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:22.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:23.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:23.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:23.674 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:19:23.675+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:19:24.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:24.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:25.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:25.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:26.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:26.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:27.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:27.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:28.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:28.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:28.675 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:19:28.676+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:19:29.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:29.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:30.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:30.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:31.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:31.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:32.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:32.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:33.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:33.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:33.676 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:19:33.677+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:19:34.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:34.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:35.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:35.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:36.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:36.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:37.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:37.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:38.677 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:19:38.678+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:19:38.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:38.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:39.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:39.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:40.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:40.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:41.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:41.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:42.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:42.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:43.678 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:19:43.679+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:19:43.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:43.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:44.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:44.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:45.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:45.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:46.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:46.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:47.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:47.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:48.679 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:19:48.680+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:19:48.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:48.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:49.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:49.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:50.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:50.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:51.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:51.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:52.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:52.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:53.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:53.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:54.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:54.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:55.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:55.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:56.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:56.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:57.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:57.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:58.681 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:19:58.682+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:19:58.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:58.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:19:59.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:19:59.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:00.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:00.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:01.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:01.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:02.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:02.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:03.683 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:20:03.684+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:20:03.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:03.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:04.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:04.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:05.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:05.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:06.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:06.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:07.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:07.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:08.683 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:20:08.684+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:20:08.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:08.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:09.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:09.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:10.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:10.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:11.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:11.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:12.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:12.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:13.684 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:20:13.685+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:20:13.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:13.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:14.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:14.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:15.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:15.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:16.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:16.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:17.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:17.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:18.686 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:20:18.687+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:20:18.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:18.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:19.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:19.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:20.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:20.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:21.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:21.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:22.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:22.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:23.686 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:20:23.687+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:20:23.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:23.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:24.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:24.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:25.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:25.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:26.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:26.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:27.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:27.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:28.687 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:20:28.688+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:20:28.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:28.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:29.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:29.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:30.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:30.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:31.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:31.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:32.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:32.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:33.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:20:33.689+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:20:33.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:33.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:34.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:34.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:35.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:35.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:36.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:36.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:37.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:37.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:38.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:38.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:38.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:20:38.690+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:20:39.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:39.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:40.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:40.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:41.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:41.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:42.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:42.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:43.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:43.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:43.690 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:20:43.691+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:20:44.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:44.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:45.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:45.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:46.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:46.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:47.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:47.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:48.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:48.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:48.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:20:48.693+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:20:49.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:49.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:50.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:50.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:51.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:51.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:52.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:52.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:53.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:53.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:53.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:20:53.693+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:20:54.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:54.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:55.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:55.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:56.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:56.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:57.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:57.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:58.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:58.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:20:58.694 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:20:58.695+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:20:59.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:20:59.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:00.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:00.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:01.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:01.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:02.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:02.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:03.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:03.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:03.695 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:21:03.696+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:21:04.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:04.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:05.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:05.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:06.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:06.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:07.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:07.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:08.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:08.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:08.695 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:21:08.696+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:21:09.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:09.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:10.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:10.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:11.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:11.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:12.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:12.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:13.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:13.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:13.697 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:21:13.697+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:21:14.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:14.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:15.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:15.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:16.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:16.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:17.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:17.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:18.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:18.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:18.698 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:21:18.699+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:21:19.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:19.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:20.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:20.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:21.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:21.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:22.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:22.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:23.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:23.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:23.699 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:21:23.699+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:21:24.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:24.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:25.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:25.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:26.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:26.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:27.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:27.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:28.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:28.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:28.700 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:21:28.701+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:21:29.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:29.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:30.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:30.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:31.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:31.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:32.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:32.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:33.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:33.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:33.701 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:21:33.702+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:21:34.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:34.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:35.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:35.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:36.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:36.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:37.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:37.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:38.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:38.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:38.701 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:21:38.702+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:21:39.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:39.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:40.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:40.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:41.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:41.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:42.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:42.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:43.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:43.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:43.702 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:21:43.703+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:21:44.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:44.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:45.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:45.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:46.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:46.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:47.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:47.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:48.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:48.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:48.703 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:21:48.704+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:21:49.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:49.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:50.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:50.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:51.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:51.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:52.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:52.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:53.704 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:21:53.706+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:21:53.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:53.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:54.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:54.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:55.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:55.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:56.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:56.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:57.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:57.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:58.705 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:21:58.707+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:21:58.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:58.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:21:59.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:21:59.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:00.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:00.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:01.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:01.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:02.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:02.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:03.706 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:22:03.707+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:22:03.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:03.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:04.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:04.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:05.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:05.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:06.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:06.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:07.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:07.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:08.707 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:22:08.708+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:22:08.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:08.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:09.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:09.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:10.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:10.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:11.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:11.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:12.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:12.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:13.708 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:22:13.709+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:22:13.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:13.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:14.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:14.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:15.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:15.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:16.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:16.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:17.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:17.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:18.709 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:22:18.710+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:22:18.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:18.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:19.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:19.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:20.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:20.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:21.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:21.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:22.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:22.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:23.709 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:22:23.710+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:22:23.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:23.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:24.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:24.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:25.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:25.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:26.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:26.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:27.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:27.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:28.710 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:22:28.711+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:22:28.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:28.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:29.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:29.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:30.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:30.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:31.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:31.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:32.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:32.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:33.711 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:22:33.712+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:22:33.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:33.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:34.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:34.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:35.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:35.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:36.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:36.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:38.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:38.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:38.712 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:22:38.713+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:22:39.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:39.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:40.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:40.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:41.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:41.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:42.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:42.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:43.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:43.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:43.713 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:22:43.714+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:22:44.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:44.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:45.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:45.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:46.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:46.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:47.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:47.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:48.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:48.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:48.715 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:22:48.716+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:22:49.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:49.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:50.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:50.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:51.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:51.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:52.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:52.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:53.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:53.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:53.716 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:22:53.717+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:22:54.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:54.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:55.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:55.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:56.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:56.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:57.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:57.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:58.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:58.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:22:58.717 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:22:58.717+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:22:59.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:22:59.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:00.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:00.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:01.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:01.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:02.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:02.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:03.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:03.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:03.717 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:23:03.718+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:23:04.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:04.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:05.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:05.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:06.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:06.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:07.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:07.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:08.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:08.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:08.718 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:23:08.719+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:23:09.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:09.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:10.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:10.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:11.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:11.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:12.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:12.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:13.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:13.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:13.719 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:23:13.720+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:23:14.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:14.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:15.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:15.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:16.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:16.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:17.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:17.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:18.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:18.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:18.720 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:23:18.721+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:23:19.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:19.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:20.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:20.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:21.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:21.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:22.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:22.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:23.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:23.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:23.721 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:23:23.722+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:23:24.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:24.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:25.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:25.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:26.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:26.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:27.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:27.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:28.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:28.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:28.722 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:23:28.723+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:23:29.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:29.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:30.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:30.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:31.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:31.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:32.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:32.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:33.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:33.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:33.723 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:23:33.724+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:23:34.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:34.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:35.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:35.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:36.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:36.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:37.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:37.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:38.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:38.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:38.725 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:23:38.726+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:23:39.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:39.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:40.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:40.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:41.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:41.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:42.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:42.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:43.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:43.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:43.726 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:23:43.727+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:23:44.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:44.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:45.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:45.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:46.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:46.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:47.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:47.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:48.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:48.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:48.726 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:23:48.727+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:23:49.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:49.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:50.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:50.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:51.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:51.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:52.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:52.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:53.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:53.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:53.728 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:23:53.729+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:23:54.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:54.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:55.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:55.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:56.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:56.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:57.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:57.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:58.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:58.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:23:58.728 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:23:58.729+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:23:59.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:23:59.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:00.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:00.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:01.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:01.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:02.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:02.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:03.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:03.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:03.729 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:24:03.730+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:24:04.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:04.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:05.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:05.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:06.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:06.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:07.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:07.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:08.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:08.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:08.730 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:24:08.731+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:24:09.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:09.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:10.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:10.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:11.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:11.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:12.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:12.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:13.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:13.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:13.731 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:24:13.732+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:24:14.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:14.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:15.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:15.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:16.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:16.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:17.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:17.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:18.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:18.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:18.732 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:24:18.733+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:24:19.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:19.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:20.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:20.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:21.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:21.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:22.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:22.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:23.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:23.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:23.733 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:24:23.734+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:24:24.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:24.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:25.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:25.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:26.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:26.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:27.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:27.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:28.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:28.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:28.734 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:24:28.735+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:24:29.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:29.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:30.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:30.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:31.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:31.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:32.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:32.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:33.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:33.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:33.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:24:33.736+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:24:34.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:34.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:35.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:35.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:36.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:36.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:37.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:37.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:38.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:38.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:38.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:24:38.737+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:24:39.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:39.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:40.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:40.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:41.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:41.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:42.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:42.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:43.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:43.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:43.737 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:24:43.738+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:24:44.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:44.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:45.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:45.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:46.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:46.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:47.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:47.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:48.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:48.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:48.738 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:24:48.740+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:24:49.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:49.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:50.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:50.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:51.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:51.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:52.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:52.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:53.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:53.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:53.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:24:53.741+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:24:54.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:54.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:55.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:55.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:56.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:56.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:57.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:57.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:58.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:58.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:24:58.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:24:58.740+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:24:59.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:24:59.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:00.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:00.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:01.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:01.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:02.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:02.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:03.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:25:03.741+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:25:03.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:03.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:04.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:04.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:05.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:05.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:06.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:06.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:07.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:07.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:08.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:25:08.742+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:25:08.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:08.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:09.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:09.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:10.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:10.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:11.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:11.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:12.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:12.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:13.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:13.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:13.743 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:25:13.744+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:25:14.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:14.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:15.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:15.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:16.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:16.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:17.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:17.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:18.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:18.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:18.744 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:25:18.745+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:25:19.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:19.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:20.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:20.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:21.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:21.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:22.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:22.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:23.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:23.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:23.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:25:23.746+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:25:24.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:24.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:25.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:25.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:26.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:26.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:27.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:27.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:28.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:28.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:28.746 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:25:28.746+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:25:29.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:29.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:30.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:30.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:31.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:31.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:32.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:32.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:33.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:33.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:33.747 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:25:33.747+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:25:34.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:34.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:35.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:35.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:36.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:36.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:37.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:37.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:38.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:38.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:38.747 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:25:38.748+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:25:39.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:39.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:40.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:40.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:41.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:41.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:42.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:42.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:43.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:43.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:43.749 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:25:43.749+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:25:44.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:44.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:45.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:45.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:46.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:46.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:47.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:47.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:48.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:48.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:48.749 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:25:48.750+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:25:49.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:49.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:50.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:50.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:51.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:51.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:52.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:52.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:53.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:53.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:53.750 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:25:53.751+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:25:54.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:54.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:55.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:55.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:56.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:56.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:57.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:57.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:58.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:58.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:25:58.751 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:25:58.752+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:25:59.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:25:59.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:00.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:00.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:01.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:01.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:02.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:02.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:03.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:03.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:03.752 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:26:03.753+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:26:04.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:04.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:05.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:05.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:06.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:06.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:07.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:07.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:08.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:08.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:08.754 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:26:08.754+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:26:09.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:09.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:10.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:10.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:11.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:11.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:12.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:12.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:13.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:13.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:13.755 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:26:13.756+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:26:14.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:14.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:15.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:15.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:16.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:16.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:17.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:17.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:18.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:18.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:18.756 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:26:18.756+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:26:19.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:19.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:20.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:20.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:21.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:21.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:22.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:22.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:23.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:23.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:23.756 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:26:23.757+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:26:24.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:24.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:25.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:25.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:26.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:26.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:27.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:27.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:28.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:28.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:28.757 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:26:28.758+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:26:29.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:29.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:30.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:30.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:31.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:31.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:32.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:32.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:33.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:33.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:33.758 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:26:33.759+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:26:34.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:34.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:35.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:35.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:36.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:36.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:37.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:37.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:38.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:38.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:38.759 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:26:38.760+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:26:39.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:39.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:40.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:40.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:41.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:41.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:42.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:42.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:43.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:43.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:43.761 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:26:43.761+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:26:44.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:44.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:45.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:45.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:46.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:46.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:47.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:47.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:48.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:48.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:48.761 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:26:48.762+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:26:49.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:49.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:50.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:50.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:51.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:51.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:52.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:52.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:53.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:53.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:53.762 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:26:53.763+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:26:54.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:54.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:55.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:55.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:56.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:56.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:57.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:57.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:58.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:58.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:26:58.763 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:26:58.764+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:26:59.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:26:59.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:00.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:00.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:01.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:01.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:02.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:02.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:03.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:03.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:03.764 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:27:03.765+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:27:04.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:04.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:05.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:05.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:06.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:06.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:07.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:07.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:08.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:08.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:08.765 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:27:08.766+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:27:09.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:09.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:10.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:10.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:11.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:11.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:12.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:12.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:13.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:13.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:13.767 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:27:13.767+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:27:14.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:14.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:15.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:15.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:16.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:16.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:17.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:17.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:18.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:18.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:18.767 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:27:18.768+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:27:19.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:19.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:20.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:20.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:21.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:21.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:22.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:22.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:23.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:23.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:23.768 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:27:23.769+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:27:24.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:24.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:25.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:25.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:26.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:26.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:27.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:27.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:28.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:28.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:28.769 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:27:28.770+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:27:29.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:29.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:30.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:30.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:31.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:31.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:32.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:32.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:33.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:33.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:33.782 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:27:33.772+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:27:34.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:34.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:35.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:35.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:36.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:36.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:37.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:37.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:38.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:38.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:38.772 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:27:38.772+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:27:39.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:39.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:40.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:40.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:41.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:41.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:42.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:42.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:43.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:43.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:43.772 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:27:43.773+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:27:44.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:44.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:45.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:45.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:46.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:46.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:47.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:47.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:48.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:48.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:48.773 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:27:48.775+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:27:49.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:49.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:50.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:50.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:51.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:51.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:52.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:52.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:53.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:53.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:53.774 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:27:53.775+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:27:54.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:54.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:55.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:55.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:56.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:56.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:57.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:57.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:58.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:58.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:27:58.775 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:27:58.775+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:27:59.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:27:59.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:00.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:00.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:01.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:01.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:02.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:02.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:03.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:03.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:03.776 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:28:03.777+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:28:04.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:04.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:05.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:05.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:06.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:06.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:07.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:07.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:08.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:08.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:08.777 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:28:08.777+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:28:09.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:09.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:10.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:10.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:11.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:11.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:12.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:12.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:13.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:13.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:13.778 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:28:13.778+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:28:14.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:14.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:15.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:15.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:16.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:16.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:17.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:17.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:18.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:18.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:18.779 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:28:18.780+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:28:19.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:19.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:20.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:20.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:21.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:21.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:22.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:22.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:23.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:23.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:23.780 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:28:23.780+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:28:24.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:24.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:25.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:25.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:26.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:26.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:27.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:27.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:28.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:28.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:28.781 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:28:28.781+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:28:29.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:29.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:30.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:30.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:31.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:31.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:32.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:32.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:33.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:33.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:33.782 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:28:33.782+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:28:34.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:34.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:35.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:35.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:36.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:36.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:37.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:37.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:38.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:38.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:38.782 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:28:38.783+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:28:39.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:39.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:40.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:40.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:41.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:41.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:42.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:42.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:43.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:43.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:43.783 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:28:43.784+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:28:44.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:44.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:45.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:45.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:46.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:46.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:47.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:47.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:48.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:48.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:48.785 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:28:48.785+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:28:49.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:49.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:50.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:50.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:51.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:51.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:52.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:52.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:53.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:53.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:53.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:28:53.786+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:28:54.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:54.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:55.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:55.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:56.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:56.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:57.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:57.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:58.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:58.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:28:58.787 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:28:58.788+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:28:59.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:28:59.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:00.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:00.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:01.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:01.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:02.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:02.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:03.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:03.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:03.789 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:29:03.790+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:29:04.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:04.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:05.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:05.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:06.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:06.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:07.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:07.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:08.790 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:29:08.791+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:29:08.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:08.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:09.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:09.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:10.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:10.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:11.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:11.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:12.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:12.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:13.791 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:29:13.792+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:29:13.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:13.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:14.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:14.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:15.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:15.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:16.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:16.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:17.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:17.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:18.792 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:29:18.793+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:29:18.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:18.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:19.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:19.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:20.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:20.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:21.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:21.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:22.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:22.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:23.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:23.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:23.793 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:29:23.794+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:29:24.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:24.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:25.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:25.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:26.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:26.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:27.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:27.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:28.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:28.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:28.793 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:29:28.794+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:29:29.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:29.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:30.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:30.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:31.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:31.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:32.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:32.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:33.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:33.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:33.794 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:29:33.795+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:29:34.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:34.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:35.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:35.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:36.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:36.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:37.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:37.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:38.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:38.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:38.794 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:29:38.795+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:29:39.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:39.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:40.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:40.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:41.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:41.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:42.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:42.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:43.795 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:29:43.796+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:29:43.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:43.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:44.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:44.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:45.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:45.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:46.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:46.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:47.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:47.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:48.797 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:29:48.797+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:29:48.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:48.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:49.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:49.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:50.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:50.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:51.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:51.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:52.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:52.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:53.798 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:29:53.798+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:29:53.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:53.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:54.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:54.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:55.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:55.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:56.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:56.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:57.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:57.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:58.799 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:29:58.800+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:29:58.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:58.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:29:59.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:29:59.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:00.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:00.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:01.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:01.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:02.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:02.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:03.800 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:30:03.800+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:30:03.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:03.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:04.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:04.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:05.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:05.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:06.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:06.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:07.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:07.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:08.801 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:30:08.801+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:30:08.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:08.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:09.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:09.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:10.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:10.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:11.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:11.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:12.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:12.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:13.802 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:30:13.803+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:30:13.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:13.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:14.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:14.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:15.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:15.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:16.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:16.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:18.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:18.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:18.803 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:30:18.803+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:30:19.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:19.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:20.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:20.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:20.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:20.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:21.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:21.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:22.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:22.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:23.804 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:30:23.805+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:30:23.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:23.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:24.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:24.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:25.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:25.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:26.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:26.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:27.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:27.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:28.805 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:30:28.805+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:30:28.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:28.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:30.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:30.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:30.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:30.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:31.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:31.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:32.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:32.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:33.806 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:30:33.806+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:30:33.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:34.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:34.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:34.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:35.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:35.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:37.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:37.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:38.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:38.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:38.807 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:30:38.807+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:30:39.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:39.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:40.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:40.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:41.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:41.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:42.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:42.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:42.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:42.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:43.808 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:30:43.810+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:30:43.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:43.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:44.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:44.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:46.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:46.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:47.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:47.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:48.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:48.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:48.809 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:30:48.811+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:30:49.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:49.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:49.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:49.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:50.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:51.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:51.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:51.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:52.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:52.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:53.810 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:30:53.811+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:30:53.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:53.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:54.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:54.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:55.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:55.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:56.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:56.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:57.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:57.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:58.811 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:30:58.812+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:30:58.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:58.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:30:59.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:30:59.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:01.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:01.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:01.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:01.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:03.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:03.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:03.812 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:31:03.812+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:31:04.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:04.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:05.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:05.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:06.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:06.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:07.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:07.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:08.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:08.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:08.812 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:31:08.813+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:31:09.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:09.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:10.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:10.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:11.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:11.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:12.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:12.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:13.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:13.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:13.814 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:31:13.814+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:31:14.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:14.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:15.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:15.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:16.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:16.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:17.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:17.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:18.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:18.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:18.815 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:31:18.816+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:31:19.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:19.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:20.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:20.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:21.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:21.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:22.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:22.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:23.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:23.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:23.816 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:31:23.816+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:31:24.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:24.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:25.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:25.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:26.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:26.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:27.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:27.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:28.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:28.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:28.817 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:31:28.817+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:31:29.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:29.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:30.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:30.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:31.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:31.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:32.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:32.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:33.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:33.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:33.817 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:31:33.818+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:31:34.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:34.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:35.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:35.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:36.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:36.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:37.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:37.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:38.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:38.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:38.818 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:31:38.819+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:31:39.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:39.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:40.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:40.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:41.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:41.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:42.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:42.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:43.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:43.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:43.820 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:31:43.820+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:31:44.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:44.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:45.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:45.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:46.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:46.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:47.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:47.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:48.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:48.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:48.821 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:31:48.822+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:31:49.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:49.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:50.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:50.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:51.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:51.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:52.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:52.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:53.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:53.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:53.822 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:31:53.822+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:31:54.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:54.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:55.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:55.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:56.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:56.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:57.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:57.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:58.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:58.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:31:58.823 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:31:58.824+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:31:59.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:31:59.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:00.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:00.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:01.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:01.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:02.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:02.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:03.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:03.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:03.824 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:32:03.824+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:32:04.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:04.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:05.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:05.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:06.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:06.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:07.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:07.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:08.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:08.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:08.824 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:32:08.825+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:32:09.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:09.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:10.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:10.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:11.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:11.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:12.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:12.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:13.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:13.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:13.825 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:32:13.826+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:32:14.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:14.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:15.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:15.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:16.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:16.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:17.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:17.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:18.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:18.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:18.827 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:32:18.827+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:32:19.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:19.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:20.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:20.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:21.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:21.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:22.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:22.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:23.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:23.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:23.827 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:32:23.828+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:32:24.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:24.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:25.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:25.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:26.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:26.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:27.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:27.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:28.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:28.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:28.828 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:32:28.829+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:32:29.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:29.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:30.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:30.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:31.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:31.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:32.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:32.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:33.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:33.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:33.829 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:32:33.830+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:32:34.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:34.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:35.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:35.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:36.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:36.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:37.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:37.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:38.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:38.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:38.831 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:32:38.831+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:32:39.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:39.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:40.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:40.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:41.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:41.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:42.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:42.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:43.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:43.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:43.832 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:32:43.832+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:32:44.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:44.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:45.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:45.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:46.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:46.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:47.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:47.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:48.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:48.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:48.832 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:32:48.833+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:32:49.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:49.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:50.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:50.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:51.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:51.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:52.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:52.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:53.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:53.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:53.833 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:32:53.834+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:32:54.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:54.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:55.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:55.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:56.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:56.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:57.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:57.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:58.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:58.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:32:58.834 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:32:58.835+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:32:59.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:32:59.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:00.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:00.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:01.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:01.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:02.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:02.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:03.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:03.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:03.835 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:33:03.836+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:33:04.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:04.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:05.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:05.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:06.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:06.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:07.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:07.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:08.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:08.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:08.836 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:33:08.837+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:33:09.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:09.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:10.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:10.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:11.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:11.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:12.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:12.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:13.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:13.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:13.838 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:33:13.838+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:33:14.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:14.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:15.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:15.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:16.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:16.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:17.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:17.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:18.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:18.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:18.838 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:33:18.839+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:33:19.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:19.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:20.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:20.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:21.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:21.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:22.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:22.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:23.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:23.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:23.839 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:33:23.840+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:33:24.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:24.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:25.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:25.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:26.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:26.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:27.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:27.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:28.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:28.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:28.840 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:33:28.841+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:33:29.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:29.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:30.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:30.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:31.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:31.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:32.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:32.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:33.842 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:33:33.842+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:33:33.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:33.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:34.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:34.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:35.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:35.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:36.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:36.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:37.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:37.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:38.843 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:33:38.844+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:33:38.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:38.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:39.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:39.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:40.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:40.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:41.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:41.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:42.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:42.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:43.843 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:33:43.845+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:33:43.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:43.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:44.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:44.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:45.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:45.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:46.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:46.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:47.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:47.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:48.844 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:33:48.846+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:33:48.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:48.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:49.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:49.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:50.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:50.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:51.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:51.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:52.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:52.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:53.845 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:33:53.845+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:33:53.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:53.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:54.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:54.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:55.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:55.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:56.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:56.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:57.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:57.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:58.846 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:33:58.846+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:33:58.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:58.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:33:59.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:33:59.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:00.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:00.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:01.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:01.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:02.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:02.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:03.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:03.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:04.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:04.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:05.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:05.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:06.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:06.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:07.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:07.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:08.848 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:34:08.849+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:34:08.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:08.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:09.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:09.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:10.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:10.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:11.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:11.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:12.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:12.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:13.849 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:34:13.849+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:34:13.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:13.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:14.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:14.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:15.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:15.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:16.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:16.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:17.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:17.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:18.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:18.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:18.850 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:34:18.851+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:34:19.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:19.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:20.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:20.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:21.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:21.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:22.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:22.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:23.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:23.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:23.851 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:34:23.852+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:34:24.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:24.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:25.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:25.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:26.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:26.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:27.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:27.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:28.852 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:34:28.852+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:34:28.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:28.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:29.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:29.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:30.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:30.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:31.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:31.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:32.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:32.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:33.853 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:34:33.853+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:34:33.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:33.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:34.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:34.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:35.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:35.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:36.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:36.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:37.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:37.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:38.854 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:34:38.854+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:34:38.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:38.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:39.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:39.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:40.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:40.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:41.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:41.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:42.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:42.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:43.855 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:34:43.855+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:34:43.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:43.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:44.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:44.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:45.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:45.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:46.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:46.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:47.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:47.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:48.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:48.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:48.856 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:34:48.856+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:34:49.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:49.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:50.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:50.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:51.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:51.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:52.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:52.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:53.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:53.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:53.856 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:34:53.857+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:34:54.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:54.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:55.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:55.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:56.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:56.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:57.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:57.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:58.858 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:34:58.858+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:34:58.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:58.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:34:59.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:34:59.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:00.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:00.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:01.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:01.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:02.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:02.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:03.859 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:35:03.859+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:35:03.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:03.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:04.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:04.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:05.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:05.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:06.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:06.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:07.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:07.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:08.860 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:35:08.860+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:35:08.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:08.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:09.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:09.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:10.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:10.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:11.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:11.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:12.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:12.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:13.861 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:35:13.862+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:35:13.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:13.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:14.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:14.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:15.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:15.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:16.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:16.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:17.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:17.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:18.862 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:35:18.862+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:35:18.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:18.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:19.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:19.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:20.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:20.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:21.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:21.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:22.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:22.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:23.862 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:35:23.863+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:35:23.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:23.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:24.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:24.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:25.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:25.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:26.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:26.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:27.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:27.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:28.864 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:35:28.864+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:35:28.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:28.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:29.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:29.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:30.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:30.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:31.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:31.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:32.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:32.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:33.865 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:35:33.865+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:35:33.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:33.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:34.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:34.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:35.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:35.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:36.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:36.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:37.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:37.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:38.866 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:35:38.866+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:35:38.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:38.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:39.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:39.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:40.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:40.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:41.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:41.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:42.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:42.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:43.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:43.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:43.866 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:35:43.867+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:35:44.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:44.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:45.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:45.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:46.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:46.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:47.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:47.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:48.868 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:35:48.868+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:35:48.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:48.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:49.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:49.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:50.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:50.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:51.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:51.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:52.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:52.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:53.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:53.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:53.868 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:35:53.869+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:35:54.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:54.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:55.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:55.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:56.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:56.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:57.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:57.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:58.870 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:35:58.870+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:35:58.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:58.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:35:59.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:35:59.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:00.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:00.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:01.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:01.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:02.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:02.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:03.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:03.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:03.871 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:36:03.871+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:36:04.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:04.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:05.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:05.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:06.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:06.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:07.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:07.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:08.871 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:36:08.872+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:36:08.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:08.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:09.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:09.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:10.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:10.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:11.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:11.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:12.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:12.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:13.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:13.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:13.873 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:36:13.873+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:36:14.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:14.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:15.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:15.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:16.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:16.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:17.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:17.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:18.874 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:36:18.875+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:36:18.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:18.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:19.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:19.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:20.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:20.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:21.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:21.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:22.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:22.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:23.875 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:36:23.876+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:36:23.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:23.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:24.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:24.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:25.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:25.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:26.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:26.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:27.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:27.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:28.876 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:36:28.876+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:36:28.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:28.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:29.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:29.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:30.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:30.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:31.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:31.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:32.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:32.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:33.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:33.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:34.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:34.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:35.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:35.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:36.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:36.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:37.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:37.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:38.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:36:38.880+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:36:38.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:38.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:39.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:39.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:40.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:40.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:41.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:41.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:42.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:42.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:43.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:43.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:43.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:36:43.880+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:36:44.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:44.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:45.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:45.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:46.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:46.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:47.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:47.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:48.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:48.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:48.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:36:48.880+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:36:49.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:49.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:50.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:50.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:51.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:51.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:52.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:52.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:53.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:53.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:53.880 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:36:53.880+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:36:54.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:54.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:55.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:55.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:56.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:56.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:57.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:57.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:58.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:58.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:36:58.881 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:36:58.882+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:36:59.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:36:59.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:00.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:00.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:01.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:01.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:02.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:02.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:03.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:03.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:03.882 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:37:03.883+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:37:04.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:04.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:05.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:05.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:06.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:06.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:07.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:07.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:08.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:08.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:08.882 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:37:08.883+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:37:09.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:09.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:10.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:10.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:11.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:11.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:12.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:12.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:13.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:13.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:13.883 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:37:13.884+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:37:14.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:14.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:15.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:15.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:16.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:16.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:17.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:17.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:18.885 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:37:18.885+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:37:18.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:18.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:19.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:19.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:21.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:21.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:22.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:22.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:23.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:23.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:23.886 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:37:23.886+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:37:24.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:24.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:25.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:25.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:26.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:26.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:27.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:27.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:28.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:28.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:28.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:37:28.887+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:37:29.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:29.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:30.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:30.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:31.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:31.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:32.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:32.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:33.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:33.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:33.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:37:33.888+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:37:34.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:34.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:35.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:35.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:36.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:36.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:37.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:37.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:38.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:38.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:38.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:37:38.889+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:37:39.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:39.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:40.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:40.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:41.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:41.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:42.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:42.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:43.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:43.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:43.890 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:37:43.890+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:37:44.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:44.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:45.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:45.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:46.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:46.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:47.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:47.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:48.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:48.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:48.891 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:37:48.891+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:37:49.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:49.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:50.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:50.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:51.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:51.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:52.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:52.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:53.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:53.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:53.892 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:37:53.892+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:37:54.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:54.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:55.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:55.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:56.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:56.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:57.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:57.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:58.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:58.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:37:58.893 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:37:58.894+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:37:59.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:37:59.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:00.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:00.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:01.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:01.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:02.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:02.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:03.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:03.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:03.894 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:38:03.894+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:38:04.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:04.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:05.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:05.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:06.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:06.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:07.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:07.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:08.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:08.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:08.895 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:38:08.895+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:38:09.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:09.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:10.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:10.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:11.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:11.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:12.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:12.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:13.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:13.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:13.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:38:13.896+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:38:14.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:14.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:15.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:15.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:16.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:16.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:17.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:17.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:18.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:18.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:18.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:38:18.898+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:38:19.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:19.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:20.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:20.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:21.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:21.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:22.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:22.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:23.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:23.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:23.898 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:38:23.898+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:38:24.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:24.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:25.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:25.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:26.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:26.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:27.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:27.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:28.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:28.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:28.899 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:38:28.899+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:38:29.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:29.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:30.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:30.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:31.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:31.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:32.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:32.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:33.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:33.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:33.899 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:38:33.900+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:38:34.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:34.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:35.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:35.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:36.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:36.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:37.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:37.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:38.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:38.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:38.901 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:38:38.901+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:38:39.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:39.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:40.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:40.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:41.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:41.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:42.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:42.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:43.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:43.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:43.902 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:38:43.902+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:38:44.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:44.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:45.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:45.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:46.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:46.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:47.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:47.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:48.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:48.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:48.903 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:38:48.903+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:38:49.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:49.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:50.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:50.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:51.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:51.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:52.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:52.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:53.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:53.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:53.903 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:38:53.904+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:38:54.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:54.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:55.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:55.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:56.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:56.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:57.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:57.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:58.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:58.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:38:58.904 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:38:58.905+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:38:59.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:38:59.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:00.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:00.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:01.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:01.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:02.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:02.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:03.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:03.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:03.905 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:39:03.906+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:39:04.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:04.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:05.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:05.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:06.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:06.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:07.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:07.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:08.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:08.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:08.906 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:39:08.907+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:39:09.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:09.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:10.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:10.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:11.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:11.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:12.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:12.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:13.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:13.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:13.907 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:39:13.907+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:39:14.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:14.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:15.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:15.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:16.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:16.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:17.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:17.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:18.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:18.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:18.908 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:39:18.908+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:39:19.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:19.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:20.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:20.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:21.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:21.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:22.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:22.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:23.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:23.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:23.908 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:39:23.909+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:39:24.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:24.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:25.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:25.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:26.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:26.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:27.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:27.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:28.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:28.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:28.910 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:39:28.910+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:39:29.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:29.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:30.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:30.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:31.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:31.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:32.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:32.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:33.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:33.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:33.911 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:39:33.913+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:39:34.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:34.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:35.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:35.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:36.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:36.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:37.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:37.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:38.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:38.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:38.912 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:39:38.914+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:39:39.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:39.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:40.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:40.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:41.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:41.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:42.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:42.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:43.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:43.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:43.913 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:39:43.914+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:39:44.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:44.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:45.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:45.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:46.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:46.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:47.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:47.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:48.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:48.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:48.914 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:39:48.914+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:39:49.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:49.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:50.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:50.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:51.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:51.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:52.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:52.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:53.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:53.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:53.915 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:39:53.915+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:39:54.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:54.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:55.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:55.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:56.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:56.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:57.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:57.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:58.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:58.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:39:58.916 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:39:58.916+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:39:59.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:39:59.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:00.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:00.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:01.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:01.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:02.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:02.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:03.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:03.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:03.917 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:40:03.918+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:40:04.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:04.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:05.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:05.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:06.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:06.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:07.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:07.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:08.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:08.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:08.918 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:40:08.918+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:40:09.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:09.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:10.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:10.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:11.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:11.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:12.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:12.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:13.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:13.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:13.919 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:40:13.919+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:40:14.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:14.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:15.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:15.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:16.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:16.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:17.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:17.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:18.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:18.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:18.920 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:40:18.920+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:40:19.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:19.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:20.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:20.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:21.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:21.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:22.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:22.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:23.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:23.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:23.921 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:40:23.921+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:40:24.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:24.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:25.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:25.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:26.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:26.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:27.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:27.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:28.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:28.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:28.922 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:40:28.923+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:40:29.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:29.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:30.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:30.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:31.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:31.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:32.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:32.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:33.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:33.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:33.923 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:40:33.923+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:40:34.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:34.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:35.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:35.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:36.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:36.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:37.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:37.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:38.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:38.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:38.924 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:40:38.924+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:40:39.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:39.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:40.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:40.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:41.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:41.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:42.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:42.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:43.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:43.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:43.925 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:40:43.925+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:40:44.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:44.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:45.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:45.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:46.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:46.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:47.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:47.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:48.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:48.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:48.926 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:40:48.926+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:40:49.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:49.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:50.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:50.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:51.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:51.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:52.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:52.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:53.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:53.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:53.927 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:40:53.927+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:40:54.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:54.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:55.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:55.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:56.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:56.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:57.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:57.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:58.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:58.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:40:58.928 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:40:58.928+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:40:59.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:40:59.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:00.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:00.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:01.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:01.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:02.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:02.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:03.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:03.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:03.929 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:41:03.929+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:41:04.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:04.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:05.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:05.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:06.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:06.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:07.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:07.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:08.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:08.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:08.930 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:41:08.930+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:41:09.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:09.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:10.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:10.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:11.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:11.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:12.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:12.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:13.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:13.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:13.931 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:41:13.931+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:41:14.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:14.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:15.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:15.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:16.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:16.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:17.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:17.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:18.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:18.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:18.932 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:41:18.932+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:41:19.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:19.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:20.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:20.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:21.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:21.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:22.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:22.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:23.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:23.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:23.933 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:41:23.933+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:41:24.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:24.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:25.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:25.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:26.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:26.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:27.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:27.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:28.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:28.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:28.933 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:41:28.934+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:41:29.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:29.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:30.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:30.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:31.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:31.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:32.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:32.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:33.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:33.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:33.934 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:41:33.935+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:41:33.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:33.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:34.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:34.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:36.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:36.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:37.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:37.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:37.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:37.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:38.935 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:41:38.935+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:41:38.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:38.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:39.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:39.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:40.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:40.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:41.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:41.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:42.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:42.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:43.936 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:41:43.937+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:41:43.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:43.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:44.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:44.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:45.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:45.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:47.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:47.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:47.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:47.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:48.938 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:41:48.938+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:41:48.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:48.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:50.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:50.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:51.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:51.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:52.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:52.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:53.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:53.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:53.939 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:41:53.939+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:41:54.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:54.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:54.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:54.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:55.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:55.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:56.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:56.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:57.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:57.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:41:58.940 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:41:58.940+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:41:58.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:41:58.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:00.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:00.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:00.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:00.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:01.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:01.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:02.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:02.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:03.941 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:42:03.941+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:42:03.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:03.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:04.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:04.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:05.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:05.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:06.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:06.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:07.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:07.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:08.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:08.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:08.942 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:42:08.942+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:42:09.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:09.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:10.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:10.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:11.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:11.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:12.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:12.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:13.943 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:42:13.944+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:42:13.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:13.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:14.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:14.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:15.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:15.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:16.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:16.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:17.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:17.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:18.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:18.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:18.943 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:42:18.944+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:42:19.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:19.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:21.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:21.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:22.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:22.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:23.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:23.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:23.945 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:42:23.945+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:42:24.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:24.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:25.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:25.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:26.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:26.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:26.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:26.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:27.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:27.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:28.946 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:42:28.947+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:42:29.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:29.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:30.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:30.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:31.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:31.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:32.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:32.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:33.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:33.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:33.946 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:42:33.948+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:42:34.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:34.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:35.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:35.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:36.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:36.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:36.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:36.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:38.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:38.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:38.947 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:42:38.948+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:42:38.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:38.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:39.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:39.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:40.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:40.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:41.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:41.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:42.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:42.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:43.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:43.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:43.948 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:42:43.948+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:42:44.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:44.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:46.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:46.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:46.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:46.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:47.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:47.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:48.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:48.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:48.949 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:42:48.950+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:42:49.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:49.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:50.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:50.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:51.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:51.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:52.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:52.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:53.950 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:42:53.950+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:42:53.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:53.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:54.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:54.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:55.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:55.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:56.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:56.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:57.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:57.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:58.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:42:58.951+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:42:58.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:58.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:42:59.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:42:59.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:00.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:00.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:01.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:01.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:03.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:03.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:03.952 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:43:03.952+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:43:03.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:03.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:04.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:04.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:05.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:05.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:06.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:06.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:07.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:07.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:08.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:08.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:09.178 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:43:08.953+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:43:09.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:09.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:10.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:10.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:11.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:11.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:13.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:13.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:13.954 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:43:13.954+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:43:13.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:13.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:14.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:14.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:15.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:15.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:16.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:16.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:17.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:17.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:18.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:18.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:18.955 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:43:18.956+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:43:19.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:19.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:20.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:20.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:21.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:21.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:23.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:23.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:23.956 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:43:23.956+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:43:23.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:23.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:24.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:24.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:25.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:25.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:26.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:26.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:27.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:27.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:28.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:28.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:28.957 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:43:28.958+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:43:29.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:29.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:30.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:30.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:31.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:31.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:33.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:33.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:33.958 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:43:33.959+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:43:34.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:34.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:35.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:35.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:36.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:36.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:37.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:37.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:38.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:38.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:38.959 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:43:38.960+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:43:39.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:39.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:40.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:40.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:41.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:41.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:42.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:42.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:43.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:43.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:43.960 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:43:43.960+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:43:44.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:44.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:45.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:45.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:46.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:46.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:47.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:47.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:48.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:48.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:48.961 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:43:48.961+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:43:49.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:49.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:50.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:50.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:51.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:51.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:52.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:52.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:53.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:53.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:53.962 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:43:53.962+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:43:54.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:54.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:55.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:55.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:56.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:56.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:57.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:57.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:58.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:58.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:43:58.963 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:43:58.964+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:43:59.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:43:59.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:00.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:00.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:01.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:01.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:02.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:02.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:03.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:03.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:03.964 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:44:03.964+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:44:04.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:04.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:05.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:05.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:06.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:06.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:07.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:07.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:08.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:08.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:08.965 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:44:08.966+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:44:09.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:09.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:10.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:10.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:11.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:11.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:12.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:12.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:13.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:13.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:13.966 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:44:13.967+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:44:14.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:14.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:15.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:15.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:16.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:16.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:17.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:17.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:18.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:18.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:18.967 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:44:18.967+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:44:19.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:19.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:20.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:20.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:21.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:21.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:22.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:22.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:23.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:23.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:23.968 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:44:23.968+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:44:24.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:24.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:25.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:25.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:26.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:26.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:27.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:27.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:28.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:28.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:28.969 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:44:28.970+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:44:29.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:29.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:30.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:30.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:31.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:31.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:32.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:32.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:33.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:33.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:33.970 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:44:33.970+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:44:34.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:34.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:35.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:35.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:36.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:36.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:37.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:37.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:38.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:38.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:38.971 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:44:38.971+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:44:39.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:39.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:40.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:40.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:41.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:41.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:42.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:42.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:43.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:43.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:43.972 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:44:43.972+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:44:44.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:44.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:45.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:45.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:46.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:46.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:47.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:47.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:48.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:48.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:48.973 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:44:48.973+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:44:49.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:49.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:50.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:50.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:51.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:51.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:52.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:52.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:53.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:53.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:53.974 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:44:53.974+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:44:54.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:54.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:55.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:55.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:56.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:56.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:57.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:57.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:58.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:58.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:44:58.975 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:44:58.976+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:44:59.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:44:59.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:00.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:00.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:01.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:01.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:02.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:02.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:03.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:03.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:03.976 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:45:03.976+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:45:04.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:04.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:05.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:05.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:06.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:06.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:07.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:07.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:08.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:08.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:08.977 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:45:08.977+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:45:09.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:09.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:10.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:10.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:11.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:11.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:12.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:12.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:13.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:13.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:13.978 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:45:13.978+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:45:14.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:14.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:15.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:15.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:16.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:16.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:17.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:17.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:18.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:18.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:18.978 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:45:18.980+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:45:19.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:19.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:20.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:20.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:21.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:21.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:22.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:22.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:23.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:23.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:23.979 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:45:23.981+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:45:24.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:24.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:25.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:25.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:26.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:26.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:27.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:27.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:28.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:28.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:28.980 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:45:28.981+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:45:29.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:29.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:30.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:30.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:31.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:31.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:32.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:32.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:33.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:33.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:33.981 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:45:33.981+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:45:34.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:34.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:35.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:35.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:36.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:36.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:37.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:37.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:38.982 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:45:38.982+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:45:39.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:39.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:39.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:39.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:41.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:41.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:42.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:42.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:43.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:43.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:43.983 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:45:43.983+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:45:44.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:44.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:44.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:44.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:45.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:45.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:46.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:46.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:47.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:47.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:48.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:48.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:48.985 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:45:48.985+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:45:49.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:49.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:50.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:50.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:51.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:51.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:52.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:52.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:53.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:53.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:53.985 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:45:53.986+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:45:54.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:54.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:55.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:55.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:56.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:56.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:57.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:57.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:58.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:58.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:45:58.986 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:45:58.987+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:45:59.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:45:59.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:00.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:00.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:01.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:01.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:02.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:02.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:03.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:03.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:03.987 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:46:03.987+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:46:04.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:04.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:05.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:05.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:06.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:06.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:07.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:07.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:08.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:08.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:08.988 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:46:08.988+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:46:09.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:09.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:10.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:10.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:11.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:11.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:12.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:12.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:13.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:13.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:13.989 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:46:13.990+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:46:14.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:14.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:15.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:15.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:16.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:16.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:17.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:17.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:18.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:18.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:18.992 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:46:18.992+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:46:19.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:19.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:20.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:20.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:21.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:21.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:22.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:22.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:23.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:23.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:23.992 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:46:23.993+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:46:24.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:24.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:25.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:25.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:26.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:26.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:27.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:27.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:28.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:28.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:28.993 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:46:28.994+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:46:29.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:29.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:30.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:30.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:31.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:31.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:32.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:32.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:33.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:33.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:33.994 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:46:33.994+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:46:34.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:34.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:35.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:35.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:36.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:36.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:37.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:37.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:38.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:38.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:38.994 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:46:38.995+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:46:39.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:39.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:40.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:40.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:41.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:41.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:42.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:42.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:43.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:43.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:43.995 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:46:43.996+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:46:44.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:44.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:45.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:45.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:46.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:46.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:47.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:47.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:48.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:48.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:49.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:46:48.997+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:46:49.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:49.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:50.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:50.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:51.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:51.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:52.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:52.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:53.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:53.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:53.997 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:46:53.997+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:46:54.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:54.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:55.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:55.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:56.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:56.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:57.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:57.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:58.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:58.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:46:58.999 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:46:58.999+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:46:59.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:46:59.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:00.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:00.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:01.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:01.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:02.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:02.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:03.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:03.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:03.999 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:47:03.999+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:47:04.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:04.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:05.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:05.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:06.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:06.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:07.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:07.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:08.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:08.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:08.999 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:47:09.000+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:47:09.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:09.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:10.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:10.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:11.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:11.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:12.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:12.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:13.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:13.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:14.001 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:47:14.001+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:47:14.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:14.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:15.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:15.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:16.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:16.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:17.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:17.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:18.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:18.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:19.002 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:47:19.002+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:47:19.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:19.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:20.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:20.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:21.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:21.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:22.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:22.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:23.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:23.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:24.003 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:47:24.003+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:47:24.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:24.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:25.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:25.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:26.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:26.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:27.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:27.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:28.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:28.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:29.003 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:47:29.004+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:47:29.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:29.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:30.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:30.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:31.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:31.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:32.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:32.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:33.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:33.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:34.005 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:47:34.005+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:47:34.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:34.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:35.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:35.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:36.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:36.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:37.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:37.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:38.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:38.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:39.005 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:47:39.006+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:47:39.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:39.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:40.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:40.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:41.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:41.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:42.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:42.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:43.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:43.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:44.007 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:47:44.007+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:47:44.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:44.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:45.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:45.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:46.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:46.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:47.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:47.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:48.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:48.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:49.008 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:47:49.008+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:47:49.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:49.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:50.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:50.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:51.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:51.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:52.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:52.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:53.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:53.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:54.009 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:47:54.010+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:47:54.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:54.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:55.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:55.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:56.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:56.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:57.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:57.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:58.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:58.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:47:59.010 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:47:59.010+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:47:59.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:47:59.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:00.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:00.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:01.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:01.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:02.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:02.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:03.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:03.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:04.011 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:48:04.011+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:48:04.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:04.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:05.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:05.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:06.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:06.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:07.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:07.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:08.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:08.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:09.012 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:48:09.013+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:48:09.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:09.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:10.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:10.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:11.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:11.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:12.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:12.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:13.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:13.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:14.012 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:48:14.014+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:48:14.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:14.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:15.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:15.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:16.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:16.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:18.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:18.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:19.013 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:48:19.014+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:48:19.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:19.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:20.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:20.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:21.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:21.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:22.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:22.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:23.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:23.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:24.014 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:48:24.015+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:48:24.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:24.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:25.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:25.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:26.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:26.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:27.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:27.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:28.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:28.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:29.015 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:48:29.015+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:48:29.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:29.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:30.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:30.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:31.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:31.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:32.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:32.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:33.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:33.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:34.016 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:48:34.016+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:48:34.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:34.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:35.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:35.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:36.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:36.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:37.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:37.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:38.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:38.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:39.017 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:48:39.018+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:48:39.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:39.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:40.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:40.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:41.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:41.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:42.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:42.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:43.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:43.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:44.018 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:48:44.018+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:48:44.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:44.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:45.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:45.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:46.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:46.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:47.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:47.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:48.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:48.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:49.019 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:48:49.019+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:48:49.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:49.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:50.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:50.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:51.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:51.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:52.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:52.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:53.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:53.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:54.020 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:48:54.020+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:48:54.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:54.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:55.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:55.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:56.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:56.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:57.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:57.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:58.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:58.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:48:59.021 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:48:59.022+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:48:59.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:48:59.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:00.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:00.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:01.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:01.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:02.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:02.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:03.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:03.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:04.022 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:49:04.022+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:49:04.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:04.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:05.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:05.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:06.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:06.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:07.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:07.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:08.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:08.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:09.023 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:49:09.023+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:49:09.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:09.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:10.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:10.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:11.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:11.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:12.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:12.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:13.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:13.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:14.025 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:49:14.024+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:49:14.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:14.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:15.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:15.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:16.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:16.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:17.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:17.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:17.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:17.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:19.025 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:49:19.025+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:49:19.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:19.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:20.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:20.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:21.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:21.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:22.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:22.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:22.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:22.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:24.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:24.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:24.026 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:49:24.026+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:49:24.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:24.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:25.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:25.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:26.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:26.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:27.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:27.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:28.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:28.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:29.026 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:49:29.027+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:49:29.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:29.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:30.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:30.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:31.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:31.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:32.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:32.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:33.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:33.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:34.028 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:49:34.029+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:49:34.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:34.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:35.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:35.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:36.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:36.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:37.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:37.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:38.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:38.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:39.029 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:49:39.029+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:49:39.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:39.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:40.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:40.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:41.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:41.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:42.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:42.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:43.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:43.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:44.030 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:49:44.030+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:49:44.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:44.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:45.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:45.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:46.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:46.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:47.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:47.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:48.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:48.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:49.031 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:49:49.031+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:49:49.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:49.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:50.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:50.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:51.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:51.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:52.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:52.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:53.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:53.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:54.032 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:49:54.032+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:49:54.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:54.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:55.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:55.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:56.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:56.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:57.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:57.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:58.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:58.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:49:59.033 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:49:59.033+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:49:59.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:49:59.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:00.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:00.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:01.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:01.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:02.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:02.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:03.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:03.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:04.034 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:50:04.034+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:50:04.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:04.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:05.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:05.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:06.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:06.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:07.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:07.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:08.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:08.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:09.035 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:50:09.035+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:50:09.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:09.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:10.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:10.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:11.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:11.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:12.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:12.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:13.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:13.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:14.036 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:50:14.036+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:50:14.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:14.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:15.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:15.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:16.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:16.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:17.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:17.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:18.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:18.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:19.037 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:50:19.037+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:50:19.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:19.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:20.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:20.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:21.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:21.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:22.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:22.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:23.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:23.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:24.038 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:50:24.038+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:50:24.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:24.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:25.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:25.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:26.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:26.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:27.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:27.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:28.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:28.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:29.039 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:50:29.039+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:50:29.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:29.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:30.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:30.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:31.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:31.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:32.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:32.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:33.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:33.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:34.040 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:50:34.040+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:50:34.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:34.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:35.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:35.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:36.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:36.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:37.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:37.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:38.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:38.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:39.041 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:50:39.041+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:50:39.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:39.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:40.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:40.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:41.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:41.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:42.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:42.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:43.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:43.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:44.042 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:50:44.043+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:50:44.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:44.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:45.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:45.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:46.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:46.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:47.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:47.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:48.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:48.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:49.043 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:50:49.043+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:50:49.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:49.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:50.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:50.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:51.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:51.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:52.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:52.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:53.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:53.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:54.044 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:50:54.044+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:50:54.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:54.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:55.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:55.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:56.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:56.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:57.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:57.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:58.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:58.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:50:59.044 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:50:59.045+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:50:59.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:50:59.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:00.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:00.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:01.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:01.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:02.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:02.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:03.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:03.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:04.045 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:51:04.046+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:51:04.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:04.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:05.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:05.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:06.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:06.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:07.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:07.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:08.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:08.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:09.046 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:51:09.047+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:51:09.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:09.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:10.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:10.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:11.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:11.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:12.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:12.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:13.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:13.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:14.047 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:51:14.047+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:51:14.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:14.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:15.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:15.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:16.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:16.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:17.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:17.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:18.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:18.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:19.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:51:19.048+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:51:19.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:19.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:20.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:20.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:21.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:21.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:22.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:22.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:23.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:23.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:24.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:51:24.049+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:51:24.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:24.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:25.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:25.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:26.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:26.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:27.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:27.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:28.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:28.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:29.050 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:51:29.051+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:51:29.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:29.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:30.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:30.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:31.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:31.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:32.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:32.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:33.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:33.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:34.051 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:51:34.051+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:51:34.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:34.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:35.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:35.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:36.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:36.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:37.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:37.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:38.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:38.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:39.058 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:51:39.052+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:51:39.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:39.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:40.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:40.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:41.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:41.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:42.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:42.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:43.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:43.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:44.053 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:51:44.053+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:51:44.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:44.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:45.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:45.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:46.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:46.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:47.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:47.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:48.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:48.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:49.054 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:51:49.054+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:51:49.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:49.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:50.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:50.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:51.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:51.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:52.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:52.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:53.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:53.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:54.055 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:51:54.055+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:51:54.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:54.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:55.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:55.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:56.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:56.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:57.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:57.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:58.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:58.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:51:59.056 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:51:59.056+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:51:59.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:51:59.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:00.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:00.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:01.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:01.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:02.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:02.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:03.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:03.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:04.057 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:52:04.057+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:52:04.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:04.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:05.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:05.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:06.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:06.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:07.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:07.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:08.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:08.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:09.058 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:52:09.059+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:52:09.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:09.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:10.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:10.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:11.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:11.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:12.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:12.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:13.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:13.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:14.059 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:52:14.059+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:52:14.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:14.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:15.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:15.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:16.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:16.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:17.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:17.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:18.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:18.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:19.060 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:52:19.061+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:52:19.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:19.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:20.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:20.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:21.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:21.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:22.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:22.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:23.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:23.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:24.061 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:52:24.061+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:52:24.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:24.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:25.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:25.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:26.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:26.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:27.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:27.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:28.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:28.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:29.062 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:52:29.062+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:52:29.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:29.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:30.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:30.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:31.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:31.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:32.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:32.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:33.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:33.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:34.063 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:52:34.063+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:52:34.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:34.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:35.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:35.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:36.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:36.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:37.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:37.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:38.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:38.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:39.064 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:52:39.065+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:52:39.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:39.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:40.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:40.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:41.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:41.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:42.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:42.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:43.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:43.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:44.065 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:52:44.066+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:52:44.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:44.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:45.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:45.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:46.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:46.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:47.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:47.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:48.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:48.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:49.066 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:52:49.066+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:52:49.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:49.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:50.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:50.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:51.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:51.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:52.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:52.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:53.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:53.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:54.067 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:52:54.067+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:52:54.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:54.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:55.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:55.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:56.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:56.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:57.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:57.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:58.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:58.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:52:59.068 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:52:59.069+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:52:59.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:52:59.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:00.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:00.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:01.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:01.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:02.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:02.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:03.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:03.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:04.069 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:53:04.070+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:53:04.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:04.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:05.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:05.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:06.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:06.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:07.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:07.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:08.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:08.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:09.070 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:53:09.070+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:53:09.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:09.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:10.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:10.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:11.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:11.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:12.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:12.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:13.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:13.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:14.071 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:53:14.071+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:53:14.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:14.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:15.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:15.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:16.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:16.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:17.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:17.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:18.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:18.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:19.072 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:53:19.072+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:53:19.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:19.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:20.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:20.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:21.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:21.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:22.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:22.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:23.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:23.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:24.073 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:53:24.073+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:53:24.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:24.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:25.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:25.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:26.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:26.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:27.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:27.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:28.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:28.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:29.074 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:53:29.074+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:53:29.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:29.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:30.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:30.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:31.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:31.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:32.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:32.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:33.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:33.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:34.075 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:53:34.075+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:53:34.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:34.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:35.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:35.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:36.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:36.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:37.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:37.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:38.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:38.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:39.076 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:53:39.076+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:53:39.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:39.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:40.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:40.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:41.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:41.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:42.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:42.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:43.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:43.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:44.082 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:53:44.077+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:53:44.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:44.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:45.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:45.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:46.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:46.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:47.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:47.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:48.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:48.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:49.078 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:53:49.079+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:53:49.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:49.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:50.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:50.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:51.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:51.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:52.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:52.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:53.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:53.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:54.078 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:53:54.079+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:53:54.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:54.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:55.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:55.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:56.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:56.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:57.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:57.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:58.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:58.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:53:59.079 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:53:59.081+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:53:59.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:53:59.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:00.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:00.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:01.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:01.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:02.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:02.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:03.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:03.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:04.080 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:54:04.080+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:54:04.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:04.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:05.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:05.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:06.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:06.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:07.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:07.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:08.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:08.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:09.081 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:54:09.081+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:54:09.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:09.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:10.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:10.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:11.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:11.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:12.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:12.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:13.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:13.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:14.082 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:54:14.083+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:54:14.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:14.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:15.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:15.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:16.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:16.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:17.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:17.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:18.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:18.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:19.083 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:54:19.083+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:54:19.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:19.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:20.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:20.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:21.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:21.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:22.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:22.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:23.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:23.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:24.084 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:54:24.084+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:54:24.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:24.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:25.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:25.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:26.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:26.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:27.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:27.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:28.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:28.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:29.085 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:54:29.086+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:54:29.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:29.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:30.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:30.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:31.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:31.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:32.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:32.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:33.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:33.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:34.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:54:34.086+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:54:34.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:34.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:35.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:35.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:36.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:36.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:37.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:37.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:38.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:38.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:39.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:54:39.087+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:54:39.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:39.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:40.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:40.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:41.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:41.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:42.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:42.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:43.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:43.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:44.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:54:44.089+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:54:44.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:44.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:45.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:45.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:46.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:46.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:47.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:47.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:48.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:48.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:49.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:54:49.089+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:54:49.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:49.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:50.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:50.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:51.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:51.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:52.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:52.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:53.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:53.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:54.090 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:54:54.090+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:54:54.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:54.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:55.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:55.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:56.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:56.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:57.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:57.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:58.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:58.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:54:59.091 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:54:59.091+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:54:59.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:54:59.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:00.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:00.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:01.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:01.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:02.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:02.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:03.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:03.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:04.092 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:55:04.092+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:55:04.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:04.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:05.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:05.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:06.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:06.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:07.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:07.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:08.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:08.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:09.093 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:55:09.094+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:55:09.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:09.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:10.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:10.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:11.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:11.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:12.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:12.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:13.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:13.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:14.094 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:55:14.094+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:55:14.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:14.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:15.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:15.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:16.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:16.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:17.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:17.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:18.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:18.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:19.095 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:55:19.096+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:55:19.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:19.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:20.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:20.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:21.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:21.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:22.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:22.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:23.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:23.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:24.096 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:55:24.096+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:55:24.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:24.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:25.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:25.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:26.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:26.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:27.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:27.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:28.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:28.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:29.097 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:55:29.097+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:55:29.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:29.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:30.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:30.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:31.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:31.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:32.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:32.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:33.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:33.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:34.098 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:55:34.098+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:55:34.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:34.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:35.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:35.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:36.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:36.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:37.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:37.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:38.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:38.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:39.099 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:55:39.099+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:55:39.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:39.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:40.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:40.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:41.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:41.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:42.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:42.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:43.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:43.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:44.100 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:55:44.100+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:55:44.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:44.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:45.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:45.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:46.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:46.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:47.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:47.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:48.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:48.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:49.101 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:55:49.101+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:55:49.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:49.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:50.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:50.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:51.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:51.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:52.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:52.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:53.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:53.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:54.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:55:54.102+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:55:54.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:54.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:55.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:55.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:56.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:56.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:57.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:57.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:58.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:58.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:55:59.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:55:59.103+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:55:59.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:55:59.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:00.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:00.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:01.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:01.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:02.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:02.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:03.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:03.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:04.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:56:04.104+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:56:04.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:04.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:05.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:05.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:06.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:06.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:07.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:07.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:08.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:08.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:09.106 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:56:09.106+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:56:09.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:09.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:10.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:10.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:11.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:11.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:12.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:12.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:13.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:13.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:14.106 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:56:14.106+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:56:14.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:14.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:15.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:15.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:16.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:16.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:17.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:17.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:18.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:18.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:19.108 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:56:19.108+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:56:19.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:19.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:20.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:20.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:21.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:21.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:22.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:22.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:23.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:23.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:24.108 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:56:24.109+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:56:24.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:24.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:25.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:25.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:26.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:26.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:27.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:27.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:28.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:28.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:29.109 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:56:29.109+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:56:29.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:29.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:30.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:30.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:31.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:31.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:32.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:32.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:33.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:33.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:34.110 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:56:34.110+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:56:34.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:34.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:35.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:35.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:36.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:36.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:37.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:37.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:38.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:38.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:39.111 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:56:39.111+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:56:39.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:39.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:40.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:40.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:41.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:41.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:42.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:42.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:43.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:43.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:44.112 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:56:44.113+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:56:44.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:44.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:45.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:45.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:46.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:46.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:47.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:47.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:48.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:48.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:49.113 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:56:49.114+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:56:49.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:49.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:50.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:50.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:51.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:51.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:52.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:52.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:53.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:53.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:54.114 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:56:54.115+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:56:54.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:54.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:55.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:55.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:56.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:56.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:57.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:57.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:58.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:58.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:56:59.115 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:56:59.115+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:56:59.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:56:59.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:00.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:00.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:01.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:01.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:02.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:02.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:03.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:03.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:04.116 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:57:04.116+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:57:04.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:04.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:05.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:05.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:06.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:06.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:07.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:07.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:08.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:08.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:09.117 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:57:09.118+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:57:09.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:09.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:10.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:10.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:11.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:11.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:12.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:12.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:13.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:13.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:14.118 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:57:14.118+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:57:14.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:14.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:15.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:15.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:16.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:16.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:17.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:17.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:18.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:18.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:19.119 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:57:19.119+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:57:19.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:19.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:20.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:20.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:21.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:21.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:22.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:22.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:23.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:23.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:24.120 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:57:24.121+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:57:24.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:24.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:25.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:25.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:26.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:26.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:27.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:27.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:28.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:28.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:29.121 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:57:29.122+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:57:29.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:29.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:30.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:30.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:31.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:31.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:32.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:32.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:33.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:33.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:34.122 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:57:34.122+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:57:34.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:34.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:35.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:35.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:36.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:36.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:37.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:37.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:38.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:38.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:39.123 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:57:39.124+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:57:39.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:39.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:40.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:40.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:41.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:41.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:42.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:42.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:43.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:43.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:44.124 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:57:44.124+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:57:44.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:44.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:45.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:45.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:46.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:46.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:47.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:47.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:48.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:48.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:49.125 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:57:49.126+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:57:49.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:49.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:50.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:50.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:51.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:51.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:52.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:52.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:53.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:53.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:54.126 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:57:54.126+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:57:54.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:54.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:55.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:55.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:56.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:56.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:57.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:57.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:58.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:58.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:57:59.127 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:57:59.127+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:57:59.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:57:59.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:00.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:00.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:01.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:01.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:02.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:02.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:03.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:03.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:04.128 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:58:04.128+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:58:04.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:04.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:05.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:05.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:06.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:06.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:07.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:07.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:08.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:08.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:09.129 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:58:09.130+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:58:09.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:09.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:10.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:10.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:11.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:11.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:12.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:12.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:13.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:13.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:14.130 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:58:14.130+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:58:14.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:14.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:15.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:15.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:16.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:16.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:17.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:17.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:18.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:18.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:19.131 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:58:19.131+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:58:19.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:19.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:20.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:20.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:21.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:21.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:22.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:22.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:23.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:23.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:24.132 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:58:24.132+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:58:24.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:24.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:25.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:25.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:26.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:26.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:27.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:27.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:28.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:28.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:29.133 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:58:29.133+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:58:29.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:29.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:30.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:30.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:31.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:31.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:32.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:32.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:33.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:33.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:34.134 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:58:34.134+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:58:34.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:34.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:35.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:35.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:36.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:36.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:37.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:37.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:38.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:38.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:39.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:58:39.135+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:58:39.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:39.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:40.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:40.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:41.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:41.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:42.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:42.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:43.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:43.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:44.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:58:44.137+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:58:44.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:44.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:45.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:45.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:46.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:46.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:47.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:47.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:48.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:48.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:49.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:58:49.137+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:58:49.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:49.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:50.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:50.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:51.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:51.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:52.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:52.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:53.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:53.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:54.138 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:58:54.138+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:58:54.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:54.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:55.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:55.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:56.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:56.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:57.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:57.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:58.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:58.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:58:59.139 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:58:59.139+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:58:59.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:58:59.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:00.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:00.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:01.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:01.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:02.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:02.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:03.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:03.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:04.140 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:59:04.140+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:59:04.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:04.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:05.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:05.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:06.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:06.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:07.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:07.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:08.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:08.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:09.141 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:59:09.141+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:59:09.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:09.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:10.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:10.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:11.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:11.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:12.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:12.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:13.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:13.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:14.142 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:59:14.143+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:59:14.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:14.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:15.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:15.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:16.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:16.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:17.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:17.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:18.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:18.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:19.143 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:59:19.143+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:59:19.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:19.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:20.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:20.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:21.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:21.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:22.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:22.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:23.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:23.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:24.144 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:59:24.144+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:59:24.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:24.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:25.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:25.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:26.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:26.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:27.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:27.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:28.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:28.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:29.145 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:59:29.145+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:59:29.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:29.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:30.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:30.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:31.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:31.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:32.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:32.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:33.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:33.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:34.146 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:59:34.146+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:59:34.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:34.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:35.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:35.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:36.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:36.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:37.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:37.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:38.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:38.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:39.147 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:59:39.148+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:59:39.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:39.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:40.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:40.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:41.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:41.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:42.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:42.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:43.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:43.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:44.148 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:59:44.149+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:59:44.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:44.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:45.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:45.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:46.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:46.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:47.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:47.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:48.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:48.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:49.148 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:59:49.148+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:59:49.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:49.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:50.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:50.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:51.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:51.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:52.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:52.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:53.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:53.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:54.149 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:59:54.150+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:59:54.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:54.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:55.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:55.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:56.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:56.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:57.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:57.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:58.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:58.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T08:59:59.150 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T08:59:59.151+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T08:59:59.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T08:59:59.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:00.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:00.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:01.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:01.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:02.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:02.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:03.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:03.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:04.151 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:00:04.151+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:00:04.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:04.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:05.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:05.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:06.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:06.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:07.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:07.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:08.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:08.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:09.152 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:00:09.153+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:00:09.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:09.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:10.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:10.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:11.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:11.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:12.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:12.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:13.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:13.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:14.153 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:00:14.153+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:00:14.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:14.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:15.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:15.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:16.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:16.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:17.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:17.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:18.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:18.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:19.154 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:00:19.155+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:00:19.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:19.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:20.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:20.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:21.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:21.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:22.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:22.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:23.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:23.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:24.155 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:00:24.155+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:00:24.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:24.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:25.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:25.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:26.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:26.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:27.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:27.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:28.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:28.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:29.156 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:00:29.156+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:00:29.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:29.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:30.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:30.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:31.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:31.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:32.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:32.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:33.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:33.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:34.157 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:00:34.158+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:00:34.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:34.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:35.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:35.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:36.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:36.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:37.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:37.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:38.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:38.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:39.159 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:00:39.159+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:00:39.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:39.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:40.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:40.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:41.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:41.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:42.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:42.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:43.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:43.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:44.159 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:00:44.160+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:00:44.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:44.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:45.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:45.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:46.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:46.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:47.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:47.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:48.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:48.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:49.161 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:00:49.161+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:00:49.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:49.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:50.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:50.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:51.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:51.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:52.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:52.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:53.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:53.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:54.161 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:00:54.162+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:00:54.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:54.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:55.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:55.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:56.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:56.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:57.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:57.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:58.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:58.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:00:59.162 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:00:59.162+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:00:59.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:00:59.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:00.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:00.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:01.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:01.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:02.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:02.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:03.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:03.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:04.163 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:01:04.163+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:01:04.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:04.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:05.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:05.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:06.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:06.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:07.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:07.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:08.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:08.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:09.164 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:01:09.165+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:01:09.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:09.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:10.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:10.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:11.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:11.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:12.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:12.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:13.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:13.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:14.165 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:01:14.165+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:01:14.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:14.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:15.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:15.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:16.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:16.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:17.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:17.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:18.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:18.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:19.166 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:01:19.166+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:01:19.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:19.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:20.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:20.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:21.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:21.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:22.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:22.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:23.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:23.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:24.167 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:01:24.167+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:01:24.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:24.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:25.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:25.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:26.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:26.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:27.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:27.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:28.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:28.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:29.168 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:01:29.168+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:01:29.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:29.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:30.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:30.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:31.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:31.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:32.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:32.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:33.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:33.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:34.169 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:01:34.169+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:01:34.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:34.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:35.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:35.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:36.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:36.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:37.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:37.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:38.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:38.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:39.170 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:01:39.170+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:01:39.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:39.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:40.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:40.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:41.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:41.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:42.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:42.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:43.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:43.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:44.171 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:01:44.171+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:01:44.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:44.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:45.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:45.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:46.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:46.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:47.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:47.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:48.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:48.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:49.172 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:01:49.172+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:01:49.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:49.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:50.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:50.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:51.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:51.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:52.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:52.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:53.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:53.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:54.173 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:01:54.173+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:01:54.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:54.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:55.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:55.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:56.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:56.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:57.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:57.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:58.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:58.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:01:59.174 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:01:59.174+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:01:59.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:01:59.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:00.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:00.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:01.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:01.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:02.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:02.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:03.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:03.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:04.175 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:02:04.175+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:02:04.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:04.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:05.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:05.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:06.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:06.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:07.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:07.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:08.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:08.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:09.176 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:02:09.176+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:02:09.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:09.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:10.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:10.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:11.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:11.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:12.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:12.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:13.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:13.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:14.177 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:02:14.177+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:02:14.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:14.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:15.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:15.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:16.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:16.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:17.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:17.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:18.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:18.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:19.178 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:02:19.179+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:02:19.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:19.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:20.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:20.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:21.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:21.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:22.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:22.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:23.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:23.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:24.179 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:02:24.179+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:02:24.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:24.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:25.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:25.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:26.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:26.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:27.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:27.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:28.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:28.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:29.180 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:02:29.181+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:02:29.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:29.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:30.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:30.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:31.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:31.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:32.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:32.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:33.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:33.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:34.181 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:02:34.182+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:02:34.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:34.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:35.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:35.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:36.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:36.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:37.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:37.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:38.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:38.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:39.182 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:02:39.183+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:02:39.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:39.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:40.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:40.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:41.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:41.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:42.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:42.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:43.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:43.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:44.183 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:02:44.183+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:02:44.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:44.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:46.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:46.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:47.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:47.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:48.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:48.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:49.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:49.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:49.184 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:02:49.184+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:02:50.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:50.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:50.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:50.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:51.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:51.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:53.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:53.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:53.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:53.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:54.184 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:02:54.184+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:02:55.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:55.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:55.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:55.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:57.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:57.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:57.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:57.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:58.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:02:58.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:02:59.185 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:02:59.185+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:03:00.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:00.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:00.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:00.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:01.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:01.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:02.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:02.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:03.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:03.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:04.186 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:03:04.186+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:03:04.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:04.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:05.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:05.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:06.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:06.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:07.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:07.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:08.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:08.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:09.187 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:03:09.187+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:03:09.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:09.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:11.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:11.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:11.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:11.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:13.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:13.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:13.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:13.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:14.188 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:03:14.189+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:03:14.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:14.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:15.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:15.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:17.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:17.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:18.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:18.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:19.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:19.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:19.189 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:03:19.189+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:03:20.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:20.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:21.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:21.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:22.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:22.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:23.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:23.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:24.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:24.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:24.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:03:24.190+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:03:24.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:24.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:25.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:25.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:26.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:26.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:27.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:27.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:28.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:28.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:29.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:03:29.191+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:03:30.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:30.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:31.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:31.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:32.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:32.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:32.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:32.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:33.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:33.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:34.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:03:34.192+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:03:35.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:35.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:36.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:36.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:37.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:37.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:38.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:38.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:39.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:39.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:39.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:03:39.193+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:03:40.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:40.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:40.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:40.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:41.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:41.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:42.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:42.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:43.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:43.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:44.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:03:44.194+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:03:44.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:44.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:45.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:45.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:46.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:46.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:47.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:47.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:48.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:48.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:49.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:03:49.195+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:03:49.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:49.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:50.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:50.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:51.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:51.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:52.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:52.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:53.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:53.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:54.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:03:54.196+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:03:54.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:54.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:55.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:55.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:56.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:56.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:57.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:57.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:58.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:58.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:03:59.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:03:59.197+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:03:59.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:03:59.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:00.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:00.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:01.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:01.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:02.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:02.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:03.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:03.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:04.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:04:04.198+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:04:04.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:04.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:05.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:05.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:06.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:06.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:07.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:07.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:08.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:08.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:09.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:09.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:10.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:10.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:11.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:11.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:12.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:12.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:13.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:13.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:14.200 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:04:14.201+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:04:14.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:14.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:15.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:15.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:16.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:16.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:17.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:17.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:18.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:18.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:19.202 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:04:19.202+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:04:19.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:19.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:20.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:20.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:21.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:21.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:22.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:22.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:23.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:23.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:24.202 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:04:24.202+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:04:24.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:24.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:25.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:25.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:26.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:26.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:27.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:27.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:28.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:28.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:29.203 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:04:29.203+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:04:29.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:29.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:30.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:30.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:31.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:31.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:32.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:32.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:33.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:33.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:34.204 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:04:34.204+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:04:34.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:34.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:35.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:35.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:36.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:36.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:37.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:37.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:38.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:38.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:39.205 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:04:39.205+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:04:39.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:39.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:40.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:40.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:41.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:41.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:42.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:42.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:43.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:43.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:44.206 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:04:44.206+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:04:44.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:44.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:45.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:45.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:46.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:46.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:47.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:47.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:48.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:48.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:49.207 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:04:49.207+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:04:49.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:49.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:50.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:50.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:51.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:51.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:52.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:52.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:53.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:53.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:54.208 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:04:54.208+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:04:54.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:54.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:55.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:55.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:56.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:56.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:57.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:57.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:58.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:58.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:04:59.209 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:04:59.209+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:04:59.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:04:59.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:00.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:00.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:01.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:01.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:02.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:02.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:03.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:03.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:04.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:05:04.210+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:05:04.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:04.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:05.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:05.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:06.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:06.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:07.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:07.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:08.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:08.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:09.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:05:09.211+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:05:09.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:09.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:10.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:10.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:11.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:11.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:12.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:12.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:13.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:13.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:14.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:05:14.212+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:05:14.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:14.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:15.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:15.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:16.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:16.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:17.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:17.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:18.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:18.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:19.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:05:19.213+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:05:19.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:19.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:20.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:20.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:21.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:21.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:22.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:22.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:23.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:23.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:24.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:05:24.214+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:05:24.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:24.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:25.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:25.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:26.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:26.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:27.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:27.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:28.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:28.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:29.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:05:29.215+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:05:29.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:29.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:30.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:30.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:31.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:31.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:32.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:32.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:33.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:33.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:34.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:05:34.217+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:05:34.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:34.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:35.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:35.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:36.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:36.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:37.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:37.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:38.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:38.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:39.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:05:39.218+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:05:39.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:39.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:40.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:40.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:41.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:41.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:42.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:42.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:43.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:43.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:44.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:05:44.217+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:05:44.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:44.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:45.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:45.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:46.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:46.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:47.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:47.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:48.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:48.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:49.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:05:49.219+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:05:49.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:49.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:50.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:50.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:51.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:51.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:52.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:52.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:53.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:53.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:54.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:05:54.220+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:05:54.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:54.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:55.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:55.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:56.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:56.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:57.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:57.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:58.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:58.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:05:59.221 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:05:59.221+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:05:59.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:05:59.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:00.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:00.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:01.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:01.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:02.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:02.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:03.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:03.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:04.221 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:06:04.221+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:06:04.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:04.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:05.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:05.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:06.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:06.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:07.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:07.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:08.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:08.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:09.222 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:06:09.222+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:06:09.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:09.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:10.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:10.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:11.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:11.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:12.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:12.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:13.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:13.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:14.223 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:06:14.223+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:06:14.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:14.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:15.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:15.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:16.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:16.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:17.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:17.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:18.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:18.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:19.224 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:06:19.224+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:06:19.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:19.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:20.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:20.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:21.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:21.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:22.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:22.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:23.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:23.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:24.225 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:06:24.225+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:06:24.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:24.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:25.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:25.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:26.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:26.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:27.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:27.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:28.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:28.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:29.225 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:06:29.226+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:06:29.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:29.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:30.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:30.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:31.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:31.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:32.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:32.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:33.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:33.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:34.226 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:06:34.226+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:06:34.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:34.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:35.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:35.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:36.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:36.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:37.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:37.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:38.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:38.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:39.227 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:06:39.228+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:06:39.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:39.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:40.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:40.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:41.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:41.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:42.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:42.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:43.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:43.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:44.229 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:06:44.229+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:06:44.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:44.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:45.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:45.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:46.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:46.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:47.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:47.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:48.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:48.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:49.230 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:06:49.230+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:06:49.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:49.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:50.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:50.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:51.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:51.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:52.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:52.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:53.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:53.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:54.230 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:06:54.230+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:06:54.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:54.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:55.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:55.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:56.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:56.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:57.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:57.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:58.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:58.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:06:59.231 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:06:59.231+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:06:59.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:06:59.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:00.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:00.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:01.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:01.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:02.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:02.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:03.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:03.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:04.233 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:07:04.233+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:07:04.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:04.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:05.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:05.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:06.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:06.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:07.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:07.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:08.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:08.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:09.234 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:07:09.234+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:07:09.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:09.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:10.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:10.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:11.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:11.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:12.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:12.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:13.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:13.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:14.235 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:07:14.235+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:07:14.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:14.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:15.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:15.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:16.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:16.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:17.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:17.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:18.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:18.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:19.236 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:07:19.236+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:07:19.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:19.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:20.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:20.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:21.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:21.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:22.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:22.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:23.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:23.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:24.237 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:07:24.237+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:07:24.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:24.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:25.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:25.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:26.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:26.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:27.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:27.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:28.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:28.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:29.238 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:07:29.238+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:07:29.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:29.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:30.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:30.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:31.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:31.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:32.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:32.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:33.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:33.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:34.239 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:07:34.239+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:07:34.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:34.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:35.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:35.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:36.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:36.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:37.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:37.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:38.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:38.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:39.240 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:07:39.240+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:07:39.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:39.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:40.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:40.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:41.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:41.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:42.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:42.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:43.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:43.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:44.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:07:44.241+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:07:44.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:44.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:45.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:45.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:46.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:46.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:47.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:47.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:48.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:48.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:49.242 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:07:49.242+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:07:49.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:49.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:50.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:50.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:51.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:51.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:52.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:52.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:53.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:53.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:54.243 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:07:54.243+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:07:55.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:55.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:56.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:56.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:57.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:57.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:57.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:57.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:59.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:07:59.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:07:59.244 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:07:59.244+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:08:00.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:00.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:01.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:01.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:02.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:02.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:03.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:03.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:04.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:04.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:04.245 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:08:04.245+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:08:04.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:04.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:06.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:06.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:07.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:07.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:08.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:08.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:09.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:09.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:09.246 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:08:09.246+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:08:10.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:10.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:11.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:11.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:12.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:12.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:13.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:13.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:14.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:14.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:14.247 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:08:14.247+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:08:15.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:15.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:16.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:16.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:17.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:17.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:18.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:18.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:19.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:19.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:19.248 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:08:19.248+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:08:20.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:20.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:21.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:21.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:22.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:22.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:23.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:23.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:24.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:24.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:24.249 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:08:24.250+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:08:25.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:25.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:26.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:26.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:27.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:27.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:28.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:28.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:29.250 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:08:29.251+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:08:29.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:29.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:30.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:30.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:31.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:31.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:32.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:32.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:33.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:33.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:34.250 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:08:34.251+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:08:34.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:34.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:35.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:35.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:36.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:36.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:37.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:37.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:38.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:38.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:39.251 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:08:39.251+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:08:39.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:39.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:40.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:40.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:41.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:41.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:42.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:42.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:43.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:43.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:44.252 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:08:44.252+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:08:44.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:44.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:45.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:45.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:46.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:46.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:47.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:47.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:48.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:48.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:49.253 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:08:49.253+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:08:49.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:49.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:50.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:50.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:51.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:51.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:52.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:52.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:53.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:53.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:54.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:54.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:54.254 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:08:54.254+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:08:55.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:55.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:56.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:56.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:57.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:57.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:58.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:58.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:08:59.255 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:08:59.255+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:08:59.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:08:59.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:00.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:00.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:01.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:01.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:02.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:02.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:03.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:03.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:04.256 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:09:04.256+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:09:04.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:04.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:05.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:05.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:06.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:06.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:07.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:07.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:08.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:08.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:09.257 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:09:09.258+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:09:09.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:09.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:10.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:10.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:11.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:11.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:12.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:12.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:13.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:13.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:14.258 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:09:14.258+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:09:14.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:14.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:15.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:15.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:16.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:16.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:17.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:17.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:18.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:18.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:19.260 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:09:19.260+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:09:19.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:19.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:20.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:20.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:21.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:21.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:22.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:22.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:23.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:23.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:24.261 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:09:24.261+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:09:24.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:24.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:25.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:25.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:26.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:26.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:27.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:27.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:28.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:28.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:29.261 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:09:29.261+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:09:29.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:29.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:30.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:30.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:31.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:31.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:32.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:32.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:33.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:33.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:34.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:34.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:34.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:09:34.262+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:09:35.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:35.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:36.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:36.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:37.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:37.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:38.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:38.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:39.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:39.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:39.263 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:09:39.263+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:09:40.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:40.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:41.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:41.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:42.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:42.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:43.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:43.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:44.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:44.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:44.264 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:09:44.265+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:09:45.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:45.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:46.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:46.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:47.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:47.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:48.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:48.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:49.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:49.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:49.265 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:09:49.266+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:09:50.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:50.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:51.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:51.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:52.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:52.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:53.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:53.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:54.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:54.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:54.266 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:09:54.266+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:09:55.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:55.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:56.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:56.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:57.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:57.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:58.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:58.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:59.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:09:59.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:09:59.267 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:09:59.267+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:10:00.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:00.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:01.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:01.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:02.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:02.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:03.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:03.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:04.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:04.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:04.268 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:10:04.268+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:10:05.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:05.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:06.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:06.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:07.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:07.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:08.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:08.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:09.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:09.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:09.269 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:10:09.269+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:10:10.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:10.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:11.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:11.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:12.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:12.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:13.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:13.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:13.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:13.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:14.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:10:14.271+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:10:14.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:14.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:15.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:15.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:16.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:16.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:17.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:17.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:18.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:18.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:19.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:10:19.271+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:10:19.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:19.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:20.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:20.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:21.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:21.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:22.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:22.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:23.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:23.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:24.272 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:10:24.272+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:10:24.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:24.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:25.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:25.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:26.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:26.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:27.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:27.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:28.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:28.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:29.273 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:10:29.273+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:10:29.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:29.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:30.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:30.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:31.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:31.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:32.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:32.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:33.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:33.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:34.274 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:10:34.274+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:10:34.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:34.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:35.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:35.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:36.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:36.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:37.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:37.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:38.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:38.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:39.275 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:10:39.275+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:10:39.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:39.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:40.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:40.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:41.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:41.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:42.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:42.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:43.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:43.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:44.276 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:10:44.276+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:10:44.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:44.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:45.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:45.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:46.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:46.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:47.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:47.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:48.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:48.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:49.277 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:10:49.277+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:10:49.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:49.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:51.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:51.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:52.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:52.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:52.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:52.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:54.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:54.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:54.278 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:10:54.278+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:10:55.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:55.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:56.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:56.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:57.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:57.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:57.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:57.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:58.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:58.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:10:59.279 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:10:59.280+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:10:59.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:10:59.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:00.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:00.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:01.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:01.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:03.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:03.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:04.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:04.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:04.281 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:11:04.281+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:11:05.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:05.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:06.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:06.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:07.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:07.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:08.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:08.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:09.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:09.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:09.282 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:11:09.282+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:11:10.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:10.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:11.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:11.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:12.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:12.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:12.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:12.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:13.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:13.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:14.283 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:11:14.283+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:11:15.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:15.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:15.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:15.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:16.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:16.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:17.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:17.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:18.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:18.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:19.283 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:11:19.283+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:11:19.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:19.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:20.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:20.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:21.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:21.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:22.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:23.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:24.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:24.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:24.284 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:11:24.285+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:11:25.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:25.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:26.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:26.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:27.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:27.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:27.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:27.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:28.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:28.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:29.285 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:11:29.286+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:11:29.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:29.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:30.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:30.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:31.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:31.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:32.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:32.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:34.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:34.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:34.286 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:11:34.286+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:11:35.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:35.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:36.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:36.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:37.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:37.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:38.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:38.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:39.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:39.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:39.287 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:11:39.287+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:11:40.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:40.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:41.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:41.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:42.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:42.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:43.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:43.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:44.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:44.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:44.288 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:11:44.288+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:11:45.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:45.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:46.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:46.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:47.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:47.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:48.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:48.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:49.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:49.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:49.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:11:49.289+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:11:50.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:50.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:51.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:51.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:52.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:52.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:52.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:52.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:54.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:54.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:54.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:11:54.290+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:11:55.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:55.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:55.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:55.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:56.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:56.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:57.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:57.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:59.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:11:59.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:11:59.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:11:59.290+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:12:00.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:00.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:01.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:01.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:02.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:02.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:03.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:03.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:04.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:04.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:04.291 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:12:04.291+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:12:05.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:05.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:06.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:06.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:07.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:07.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:08.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:08.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:09.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:09.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:09.292 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:12:09.292+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:12:10.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:10.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:11.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:11.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:12.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:12.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:13.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:13.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:14.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:14.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:14.293 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:12:14.293+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:12:15.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:15.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:16.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:16.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:17.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:17.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:18.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:18.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:19.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:19.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:19.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:12:19.295+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:12:20.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:20.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:21.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:21.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:22.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:22.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:23.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:23.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:24.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:24.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:24.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:12:24.296+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:12:25.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:25.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:26.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:26.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:27.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:27.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:28.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:28.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:29.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:29.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:29.296 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:12:29.297+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:12:30.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:30.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:31.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:31.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:32.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:32.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:33.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:33.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:34.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:12:34.298+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:12:34.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:34.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:35.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:35.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:36.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:36.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:37.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:37.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:38.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:38.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:39.299 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:12:39.299+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:12:39.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:39.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:40.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:40.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:41.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:41.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:42.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:42.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:43.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:43.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:44.300 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:12:44.300+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:12:44.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:44.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:45.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:45.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:46.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:46.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:47.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:47.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:48.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:48.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:49.301 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:12:49.301+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:12:49.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:49.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:50.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:50.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:51.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:51.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:52.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:52.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:53.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:53.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:54.302 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:12:54.302+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:12:54.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:54.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:55.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:55.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:56.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:56.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:57.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:57.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:58.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:58.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:12:59.302 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:12:59.303+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:12:59.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:12:59.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:00.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:00.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:01.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:01.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:02.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:02.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:03.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:03.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:04.305 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:13:04.304+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:13:04.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:04.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:05.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:05.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:06.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:06.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:07.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:07.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:08.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:08.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:09.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:09.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:09.304 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:13:09.305+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:13:10.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:10.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:11.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:11.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:12.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:12.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:13.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:13.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:14.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:14.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:14.305 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:13:14.306+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:13:15.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:15.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:16.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:16.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:17.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:17.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:18.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:18.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:19.306 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:13:19.306+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:13:19.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:19.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:20.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:20.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:21.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:21.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:22.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:22.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:23.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:23.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:24.307 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:13:24.307+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:13:24.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:24.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:25.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:25.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:26.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:26.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:27.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:27.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:28.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:28.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:29.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:29.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:29.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:13:29.309+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:13:30.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:30.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:31.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:31.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:32.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:32.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:33.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:33.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:34.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:13:34.310+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:13:34.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:34.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:35.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:35.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:36.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:36.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:37.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:37.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:38.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:38.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:39.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:39.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:39.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:13:39.311+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:13:40.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:40.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:41.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:41.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:42.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:42.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:43.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:43.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:44.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:44.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:44.311 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:13:44.312+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:13:45.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:45.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:46.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:46.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:47.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:47.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:48.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:48.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:49.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:49.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:49.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:13:49.313+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:13:50.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:50.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:51.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:51.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:52.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:52.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:53.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:53.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:54.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:54.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:54.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:13:54.313+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:13:55.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:55.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:56.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:56.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:57.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:57.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:58.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:58.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:59.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:13:59.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:13:59.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:13:59.315+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:14:00.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:00.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:01.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:01.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:02.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:02.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:03.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:03.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:04.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:04.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:04.315 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:14:04.315+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:14:05.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:05.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:06.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:06.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:07.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:07.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:08.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:08.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:09.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:09.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:09.316 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:14:09.316+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:14:10.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:10.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:11.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:11.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:12.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:12.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:13.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:13.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:14.316 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:14:14.316+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:14:14.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:14.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:15.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:15.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:16.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:16.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:17.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:17.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:18.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:18.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:19.317 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:14:19.318+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:14:19.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:19.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:20.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:20.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:21.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:21.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:22.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:22.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:23.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:23.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:24.318 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:14:24.319+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:14:24.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:24.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:25.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:25.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:26.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:26.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:27.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:27.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:28.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:28.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:29.319 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:14:29.319+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:14:29.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:29.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:30.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:30.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:31.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:31.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:32.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:32.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:33.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:33.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:34.320 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:14:34.320+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:14:34.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:34.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:35.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:35.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:36.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:36.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:37.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:37.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:38.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:38.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:39.322 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:14:39.322+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:14:39.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:39.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:40.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:40.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:41.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:41.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:42.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:42.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:43.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:43.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:44.322 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:14:44.322+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:14:44.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:44.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:45.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:45.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:46.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:46.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:47.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:47.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:48.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:48.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:49.323 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:14:49.323+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:14:49.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:49.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:50.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:50.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:51.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:51.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:52.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:52.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:53.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:53.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:54.324 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:14:54.324+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:14:54.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:54.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:55.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:55.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:56.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:56.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:57.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:57.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:58.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:58.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:14:59.325 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:14:59.325+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:14:59.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:14:59.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:00.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:00.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:01.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:01.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:02.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:02.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:03.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:03.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:04.326 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:15:04.326+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:15:04.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:04.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:05.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:05.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:06.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:06.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:07.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:07.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:08.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:08.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:09.327 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:15:09.327+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:15:09.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:09.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:10.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:10.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:11.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:11.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:12.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:12.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:13.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:13.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:14.328 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:15:14.328+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:15:14.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:14.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:15.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:15.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:16.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:16.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:17.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:17.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:18.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:18.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:19.329 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:15:19.329+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:15:19.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:19.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:20.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:20.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:21.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:21.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:22.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:22.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:23.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:23.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:24.330 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:15:24.330+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:15:24.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:24.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:25.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:25.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:26.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:26.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:27.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:27.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:28.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:28.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:29.331 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:15:29.331+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:15:29.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:29.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:30.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:30.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:31.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:31.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:32.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:32.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:33.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:33.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:34.332 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:15:34.332+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:15:34.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:34.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:35.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:35.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:36.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:36.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:37.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:37.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:38.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:38.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:39.333 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:15:39.333+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:15:39.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:39.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:40.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:40.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:41.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:41.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:42.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:42.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:43.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:43.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:44.334 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:15:44.334+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:15:44.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:44.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:45.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:45.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:46.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:46.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:47.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:47.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:48.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:48.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:49.335 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:15:49.335+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:15:49.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:49.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:50.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:50.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:51.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:51.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:52.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:52.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:53.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:53.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:54.336 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:15:54.336+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:15:54.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:54.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:55.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:55.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:56.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:56.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:57.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:57.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:58.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:58.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:15:59.337 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:15:59.337+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:15:59.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:15:59.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:00.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:00.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:01.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:01.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:02.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:02.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:03.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:03.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:04.338 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:16:04.338+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:16:04.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:04.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:05.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:05.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:06.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:06.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:07.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:07.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:08.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:08.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:09.339 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:16:09.339+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:16:09.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:09.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:10.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:10.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:11.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:11.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:12.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:12.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:13.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:13.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:14.341 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:16:14.341+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:16:14.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:14.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:15.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:15.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:16.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:16.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:17.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:17.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:18.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:18.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:19.342 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:16:19.342+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:16:19.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:19.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:20.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:20.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:21.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:21.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:22.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:22.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:23.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:23.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:24.342 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:16:24.342+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:16:24.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:24.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:25.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:25.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:26.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:26.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:27.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:27.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:28.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:28.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:29.343 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:16:29.343+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:16:29.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:29.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:30.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:30.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:31.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:31.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:32.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:32.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:33.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:33.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:34.344 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:16:34.344+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:16:34.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:34.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:35.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:35.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:36.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:36.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:37.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:37.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:38.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:38.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:39.345 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:16:39.345+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:16:39.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:39.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:40.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:40.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:41.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:41.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:42.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:42.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:43.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:43.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:44.346 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:16:44.346+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:16:44.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:44.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:45.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:45.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:46.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:46.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:47.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:47.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:48.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:48.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:49.348 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:16:49.348+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:16:49.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:49.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:50.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:50.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:51.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:51.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:52.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:52.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:53.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:53.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:54.348 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:16:54.348+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:16:54.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:54.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:55.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:55.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:56.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:56.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:57.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:57.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:58.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:58.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:16:59.349 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:16:59.349+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:16:59.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:16:59.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:00.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:00.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:01.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:01.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:02.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:02.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:03.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:03.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:04.351 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:17:04.351+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:17:04.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:04.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:05.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:05.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:06.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:06.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:07.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:07.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:08.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:08.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:09.352 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:17:09.352+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:17:09.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:09.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:10.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:10.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:11.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:11.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:12.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:12.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:13.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:13.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:14.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:14.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:15.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:15.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:16.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:16.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:17.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:17.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:18.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:18.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:19.354 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:17:19.355+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:17:19.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:19.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:20.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:20.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:21.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:21.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:22.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:22.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:23.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:23.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:24.355 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:17:24.355+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:17:24.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:24.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:25.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:25.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:26.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:26.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:27.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:27.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:28.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:28.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:29.356 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:17:29.356+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:17:29.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:29.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:30.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:30.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:31.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:31.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:32.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:32.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:33.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:33.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:34.356 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:17:34.356+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:17:34.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:34.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:35.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:35.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:36.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:36.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:37.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:37.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:38.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:38.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:39.357 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:17:39.357+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:17:39.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:39.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:40.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:40.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:41.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:41.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:42.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:42.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:43.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:43.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:44.358 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:17:44.358+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:17:44.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:44.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:45.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:45.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:46.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:46.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:47.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:47.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:48.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:48.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:49.358 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:17:49.358+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:17:49.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:49.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:50.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:50.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:51.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:51.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:52.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:52.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:53.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:53.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:54.359 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:17:54.359+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:17:54.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:54.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:55.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:55.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:56.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:56.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:57.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:57.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:58.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:17:58.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:17:59.360 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:17:59.360+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:18:00.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:00.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:00.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:00.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:01.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:01.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:02.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:02.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:03.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:03.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:04.361 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:18:04.361+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:18:04.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:04.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:05.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:05.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:06.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:06.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:07.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:07.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:08.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:08.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:09.363 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:18:09.363+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:18:09.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:09.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:10.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:10.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:11.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:11.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:12.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:12.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:13.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:13.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:14.363 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:18:14.363+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:18:14.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:14.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:15.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:15.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:16.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:16.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:17.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:17.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:18.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:18.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:19.364 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:18:19.364+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:18:19.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:19.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:20.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:20.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:21.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:21.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:22.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:22.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:23.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:23.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:24.365 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:18:24.365+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:18:24.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:24.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:25.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:25.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:26.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:26.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:27.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:27.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:28.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:28.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:29.367 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:18:29.367+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:18:29.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:29.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:30.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:30.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:31.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:31.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:32.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:32.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:33.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:33.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:34.367 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:18:34.367+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:18:34.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:34.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:35.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:35.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:36.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:36.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:37.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:37.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:38.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:38.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:39.369 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:18:39.369+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:18:39.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:39.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:40.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:40.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:41.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:41.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:42.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:42.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:43.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:43.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:44.370 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:18:44.370+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:18:44.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:44.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:45.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:45.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:46.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:46.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:47.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:47.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:48.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:48.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:49.370 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:18:49.371+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:18:49.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:49.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:50.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:50.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:51.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:51.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:52.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:52.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:53.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:53.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:54.371 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:18:54.371+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:18:54.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:54.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:55.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:55.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:56.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:56.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:57.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:57.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:58.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:58.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:18:59.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:18:59.372+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:18:59.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:18:59.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:00.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:00.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:01.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:01.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:02.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:02.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:03.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:03.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:04.374 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:19:04.373+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:19:04.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:04.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:05.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:05.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:06.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:06.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:07.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:07.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:08.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:08.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:09.374 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:19:09.374+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:19:09.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:09.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:10.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:10.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:11.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:11.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:12.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:12.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:13.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:13.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:14.375 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:19:14.375+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:19:15.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:15.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:16.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:16.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:17.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:17.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:18.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:18.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:19.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:19.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:19.376 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:19:19.376+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:19:20.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:20.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:21.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:21.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:22.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:22.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:23.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:23.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:24.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:24.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:24.377 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:19:24.378+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:19:25.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:25.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:26.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:26.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:27.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:27.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:28.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:28.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:29.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:29.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:29.378 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:19:29.378+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:19:30.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:30.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:31.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:31.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:32.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:32.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:33.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:33.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:34.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:34.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:34.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:19:34.379+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:19:35.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:35.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:36.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:36.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:37.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:37.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:38.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:38.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:39.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:39.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:39.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:19:39.380+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:19:40.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:40.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:41.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:41.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:42.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:42.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:43.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:43.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:44.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:44.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:44.381 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:19:44.381+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:19:45.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:45.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:46.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:46.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:47.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:47.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:48.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:48.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:49.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:49.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:49.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:19:49.382+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:19:50.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:50.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:51.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:51.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:52.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:52.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:53.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:53.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:54.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:54.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:54.383 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:19:54.383+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:19:55.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:55.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:56.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:56.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:57.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:57.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:58.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:58.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:59.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:19:59.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:19:59.384 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:19:59.384+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:20:00.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:00.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:01.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:01.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:02.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:02.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:03.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:03.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:04.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:04.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:04.386 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:20:04.386+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:20:05.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:05.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:06.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:06.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:07.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:07.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:08.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:08.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:09.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:09.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:09.386 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:20:09.387+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:20:10.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:10.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:11.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:11.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:12.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:12.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:13.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:13.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:14.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:14.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:14.387 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:20:14.388+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:20:15.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:15.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:16.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:16.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:17.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:17.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:18.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:18.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:19.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:19.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:19.387 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:20:19.387+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:20:20.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:20.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:21.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:21.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:22.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:22.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:23.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:23.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:24.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:24.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:24.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:20:24.388+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:20:25.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:25.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:26.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:26.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:27.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:27.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:28.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:28.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:29.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:29.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:29.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:20:29.389+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:20:30.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:30.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:31.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:31.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:32.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:32.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:33.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:33.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:34.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:34.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:34.390 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:20:34.390+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:20:35.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:35.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:36.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:36.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:37.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:37.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:38.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:38.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:39.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:39.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:39.392 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:20:39.391+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:20:40.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:40.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:41.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:41.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:42.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:42.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:43.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:43.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:44.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:44.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:44.392 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:20:44.393+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:20:45.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:45.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:46.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:46.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:47.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:47.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:48.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:48.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:49.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:49.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:49.393 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:20:49.393+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:20:50.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:50.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:51.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:51.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:52.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:52.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:53.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:53.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:54.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:54.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:54.394 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:20:54.394+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:20:55.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:55.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:56.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:56.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:57.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:57.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:58.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:58.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:20:59.394 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:20:59.394+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:20:59.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:20:59.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:00.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:00.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:01.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:01.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:02.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:02.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:03.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:03.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:04.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:04.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:04.395 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:21:04.395+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:21:05.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:05.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:06.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:06.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:07.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:07.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:08.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:08.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:09.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:09.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:09.396 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:21:09.396+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:21:10.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:10.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:11.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:11.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:12.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:12.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:13.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:13.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:14.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:14.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:14.398 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:21:14.398+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:21:15.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:15.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:16.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:16.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:17.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:17.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:18.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:18.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:19.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:19.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:19.399 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:21:19.399+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:21:20.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:20.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:21.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:21.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:22.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:22.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:23.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:23.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:24.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:24.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:24.400 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:21:24.400+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:21:25.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:25.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:26.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:26.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:27.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:27.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:28.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:28.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:29.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:29.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:29.401 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:21:29.401+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:21:30.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:30.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:31.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:31.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:32.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:32.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:33.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:33.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:34.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:34.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:34.403 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:21:34.403+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:21:35.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:35.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:36.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:36.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:37.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:37.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:38.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:38.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:39.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:39.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:39.403 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:21:39.403+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:21:40.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:40.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:41.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:41.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:42.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:42.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:43.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:43.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:44.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:44.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:44.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:21:44.404+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:21:45.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:45.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:46.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:46.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:47.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:47.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:48.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:48.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:49.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:49.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:49.405 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:21:49.406+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:21:50.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:50.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:51.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:51.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:52.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:52.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:53.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:53.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:54.406 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:21:54.406+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:21:54.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:54.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:55.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:55.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:56.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:56.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:57.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:57.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:58.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:58.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:59.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:21:59.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:21:59.407 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:21:59.407+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:22:00.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:00.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:01.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:01.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:02.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:02.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:03.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:03.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:04.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:04.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:04.408 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:22:04.408+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:22:05.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:05.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:06.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:06.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:07.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:07.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:08.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:08.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:09.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:09.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:10.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:10.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:11.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:11.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:12.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:12.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:13.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:13.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:14.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:14.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:14.411 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:22:14.411+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:22:15.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:15.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:16.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:16.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:17.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:17.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:18.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:18.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:19.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:19.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:19.412 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:22:19.412+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:22:20.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:20.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:21.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:21.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:22.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:22.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:23.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:23.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:24.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:24.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:24.413 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:22:24.413+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:22:25.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:25.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:26.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:26.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:27.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:27.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:28.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:28.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:29.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:29.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:29.414 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:22:29.414+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:22:30.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:30.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:31.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:31.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:32.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:32.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:33.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:33.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:34.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:34.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:34.415 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:22:34.415+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:22:35.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:35.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:36.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:36.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:37.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:37.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:38.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:38.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:39.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:39.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:40.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:40.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:41.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:41.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:42.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:42.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:43.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:43.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:44.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:44.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:44.417 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:22:44.417+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:22:45.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:45.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:46.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:46.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:47.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:47.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:48.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:48.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:49.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:49.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:49.417 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:22:49.417+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:22:50.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:50.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:51.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:51.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:52.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:52.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:53.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:53.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:54.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:54.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:54.419 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:22:54.419+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:22:55.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:55.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:56.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:56.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:57.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:57.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:58.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:58.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:59.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:22:59.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:22:59.420 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:22:59.420+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:23:00.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:00.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:01.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:01.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:02.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:02.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:03.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:03.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:04.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:04.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:04.420 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:23:04.421+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:23:05.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:05.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:06.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:06.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:07.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:07.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:08.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:08.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:09.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:09.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:09.421 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:23:09.422+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:23:10.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:10.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:11.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:11.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:12.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:12.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:13.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:13.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:14.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:14.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:14.422 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:23:14.422+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:23:15.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:15.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:16.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:16.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:17.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:17.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:18.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:18.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:19.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:19.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:19.422 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:23:19.422+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:23:20.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:20.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:21.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:21.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:22.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:22.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:23.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:23.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:24.424 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:23:24.423+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:23:24.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:24.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:25.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:25.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:26.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:26.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:27.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:27.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:28.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:28.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:29.424 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:23:29.424+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:23:29.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:29.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:30.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:30.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:31.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:31.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:32.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:32.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:33.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:33.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:34.425 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:23:34.425+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:23:34.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:34.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:35.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:35.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:36.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:36.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:37.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:37.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:38.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:38.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:39.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:39.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:39.426 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:23:39.426+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:23:40.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:40.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:41.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:41.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:42.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:42.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:43.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:43.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:44.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:44.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:44.427 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:23:44.427+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:23:45.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:45.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:46.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:46.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:47.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:47.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:48.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:48.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:49.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:49.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:49.428 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:23:49.428+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:23:50.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:50.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:51.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:51.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:52.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:52.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:53.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:53.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:54.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:54.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:54.430 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:23:54.430+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:23:55.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:55.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:56.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:56.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:57.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:57.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:58.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:58.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:59.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:23:59.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:23:59.430 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:23:59.430+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:24:00.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:00.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:01.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:01.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:02.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:02.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:03.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:03.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:04.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:04.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:04.431 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:24:04.431+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:24:05.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:05.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:06.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:06.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:07.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:07.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:08.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:08.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:09.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:09.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:09.432 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:24:09.432+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:24:10.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:10.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:11.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:11.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:12.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:12.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:13.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:13.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:14.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:14.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:14.434 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:24:14.434+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:24:15.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:15.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:16.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:16.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:17.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:17.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:18.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:18.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:19.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:19.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:19.434 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:24:19.434+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:24:20.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:20.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:21.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:21.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:22.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:22.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:23.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:23.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:24.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:24.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:24.435 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:24:24.435+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:24:25.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:25.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:26.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:26.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:27.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:27.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:28.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:28.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:29.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:29.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:29.437 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:24:29.437+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:24:30.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:30.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:31.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:31.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:32.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:32.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:33.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:33.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:34.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:34.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:34.437 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:24:34.437+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:24:35.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:35.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:36.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:36.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:37.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:37.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:38.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:38.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:39.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:39.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:39.438 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:24:39.438+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:24:40.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:40.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:41.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:41.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:42.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:42.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:43.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:43.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:44.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:44.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:44.439 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:24:44.439+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:24:45.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:45.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:46.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:46.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:47.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:47.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:48.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:48.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:49.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:49.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:49.440 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:24:49.440+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:24:50.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:50.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:51.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:51.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:52.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:52.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:53.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:53.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:54.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:54.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:54.441 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:24:54.441+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:24:55.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:55.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:56.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:56.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:57.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:57.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:58.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:58.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:59.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:24:59.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:24:59.442 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:24:59.442+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:25:00.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:00.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:01.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:01.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:02.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:02.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:03.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:03.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:04.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:04.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:04.443 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:25:04.443+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:25:05.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:05.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:06.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:06.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:07.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:07.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:08.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:08.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:09.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:09.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:09.444 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:25:09.444+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:25:10.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:10.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:11.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:11.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:12.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:12.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:13.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:13.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:14.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:14.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:14.444 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:25:14.445+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:25:15.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:15.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:16.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:16.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:17.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:17.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:18.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:18.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:19.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:19.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:19.446 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:25:19.446+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:25:20.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:20.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:21.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:21.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:22.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:22.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:23.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:23.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:24.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:24.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:24.447 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:25:24.447+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:25:25.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:25.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:26.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:26.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:27.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:27.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:28.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:28.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:29.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:29.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:29.448 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:25:29.448+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:25:30.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:30.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:31.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:31.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:32.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:32.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:33.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:33.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:34.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:34.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:35.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:35.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:36.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:36.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:37.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:37.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:38.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:38.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:39.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:25:39.451+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:25:39.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:39.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:40.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:40.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:41.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:41.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:42.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:42.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:43.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:43.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:44.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:25:44.452+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:25:44.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:44.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:45.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:45.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:46.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:46.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:47.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:47.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:48.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:48.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:49.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:25:49.452+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:25:49.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:49.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:50.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:50.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:51.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:51.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:52.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:52.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:53.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:53.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:54.453 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:25:54.454+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:25:54.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:54.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:55.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:55.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:56.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:56.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:57.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:57.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:58.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:58.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:25:59.455 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:25:59.456+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:25:59.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:25:59.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:00.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:00.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:01.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:01.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:02.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:02.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:03.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:03.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:04.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:26:04.457+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:26:04.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:04.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:05.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:05.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:06.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:06.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:07.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:07.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:08.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:08.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:09.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:26:09.457+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:26:09.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:09.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:10.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:10.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:11.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:11.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:12.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:12.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:13.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:13.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:14.457 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:26:14.457+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:26:14.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:14.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:15.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:15.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:16.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:16.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:17.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:17.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:18.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:18.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:19.458 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:26:19.458+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:26:19.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:19.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:20.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:20.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:21.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:21.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:22.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:22.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:23.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:23.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:24.458 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:26:24.458+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:26:24.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:24.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:25.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:25.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:26.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:26.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:27.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:27.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:28.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:28.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:29.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:26:29.459+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:26:29.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:29.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:30.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:30.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:31.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:31.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:32.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:32.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:33.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:33.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:34.460 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:26:34.460+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:26:34.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:34.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:35.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:35.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:36.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:36.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:37.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:37.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:38.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:38.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:39.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:26:39.461+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:26:39.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:39.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:40.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:40.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:41.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:41.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:42.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:42.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:43.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:43.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:44.462 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:26:44.462+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:26:44.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:44.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:45.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:45.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:46.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:46.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:47.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:47.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:48.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:48.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:49.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:26:49.463+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:26:49.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:49.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:51.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:51.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:52.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:52.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:53.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:53.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:54.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:54.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:54.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:26:54.464+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:26:55.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:55.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:56.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:56.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:57.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:57.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:58.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:58.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:59.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:26:59.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:26:59.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:26:59.465+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:27:00.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:00.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:01.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:01.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:02.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:02.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:03.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:03.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:04.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:04.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:04.467 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:27:04.467+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:27:05.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:05.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:06.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:06.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:07.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:07.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:08.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:08.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:09.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:09.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:10.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:10.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:11.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:11.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:12.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:12.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:13.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:13.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:14.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:14.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:14.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:27:14.469+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:27:15.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:15.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:16.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:16.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:16.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:16.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:18.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:18.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:18.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:18.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:19.470 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:27:19.470+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:27:20.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:20.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:21.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:21.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:22.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:22.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:23.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:23.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:24.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:24.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:24.471 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:27:24.471+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:27:24.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:24.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:25.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:25.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:26.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:26.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:27.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:27.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:28.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:28.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:29.471 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:27:29.472+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:27:29.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:29.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:30.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:30.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:31.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:31.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:32.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:32.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:33.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:33.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:34.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:27:34.473+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:27:34.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:34.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:35.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:35.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:37.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:37.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:38.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:38.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:38.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:38.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:39.474 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:27:39.474+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:27:39.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:39.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:41.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:41.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:41.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:41.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:42.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:42.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:43.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:43.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:44.475 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:27:44.475+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:27:44.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:44.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:45.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:45.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:46.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:46.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:47.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:47.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:48.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:48.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:49.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:27:49.476+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:27:49.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:49.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:50.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:50.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:51.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:51.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:52.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:52.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:53.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:53.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:54.477 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:27:54.476+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:27:54.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:54.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:55.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:55.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:56.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:56.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:57.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:57.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:58.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:58.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:27:59.477 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:27:59.477+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:27:59.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:27:59.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:00.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:00.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:01.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:01.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:02.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:02.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:03.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:03.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:04.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:28:04.478+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:28:04.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:04.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:05.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:05.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:06.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:06.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:07.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:07.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:08.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:08.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:09.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:28:09.479+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:28:09.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:09.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:10.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:10.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:12.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:12.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:13.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:13.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:14.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:14.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:14.480 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:28:14.480+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:28:15.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:15.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:16.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:16.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:16.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:16.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:17.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:17.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:18.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:18.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:19.481 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:28:19.481+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:28:20.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:20.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:20.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:20.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:21.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:21.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:22.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:22.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:23.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:23.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:24.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:28:24.482+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:28:24.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:24.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:25.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:25.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:26.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:26.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:27.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:27.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:28.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:28.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:29.483 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:28:29.483+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:28:29.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:29.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:30.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:30.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:31.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:31.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:32.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:32.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:33.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:33.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:34.484 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:28:34.484+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:28:34.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:34.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:35.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:35.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:36.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:36.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:37.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:37.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:38.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:38.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:39.485 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:28:39.485+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:28:39.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:39.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:40.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:40.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:41.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:41.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:42.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:42.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:43.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:43.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:44.486 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:28:44.486+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:28:44.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:44.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:45.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:45.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:46.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:46.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:47.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:47.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:48.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:48.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:49.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:28:49.487+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:28:50.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:50.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:50.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:50.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:51.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:51.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:52.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:52.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:53.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:53.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:54.488 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:28:54.488+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:28:54.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:54.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:55.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:55.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:56.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:56.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:57.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:57.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:58.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:58.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:28:59.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:28:59.490+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:28:59.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:28:59.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:00.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:00.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:01.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:01.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:02.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:02.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:03.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:03.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:04.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:29:04.490+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:29:04.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:04.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:05.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:05.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:06.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:06.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:07.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:07.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:08.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:08.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:09.491 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:29:09.491+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:29:09.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:09.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:10.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:10.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:11.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:11.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:12.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:12.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:13.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:13.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:14.491 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:29:14.491+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:29:14.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:14.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:15.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:15.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:16.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:16.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:17.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:17.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:18.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:18.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:19.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:29:19.492+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:29:19.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:19.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:20.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:20.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:21.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:21.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:23.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:23.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:23.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:23.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:24.493 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:29:24.493+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:29:24.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:24.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:25.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:25.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:26.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:26.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:27.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:27.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:28.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:28.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:29.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:29:29.494+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:29:29.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:29.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:30.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:30.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:31.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:31.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:32.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:32.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:33.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:33.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:34.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:29:34.495+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:29:34.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:34.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:35.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:35.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:36.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:36.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:37.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:37.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:38.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:38.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:39.497 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:29:39.497+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:29:39.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:39.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:40.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:40.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:41.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:41.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:42.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:42.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:43.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:43.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:44.497 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:29:44.498+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:29:44.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:44.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:45.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:45.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:46.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:46.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:47.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:47.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:48.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:48.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:49.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:29:49.498+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:29:49.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:49.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:50.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:50.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:51.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:51.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:52.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:52.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:53.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:53.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:54.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:29:54.499+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:29:54.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:54.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:55.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:55.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:56.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:56.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:57.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:57.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:58.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:58.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:29:59.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:29:59.500+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:29:59.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:29:59.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:00.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:00.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:01.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:01.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:02.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:02.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:03.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:03.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:04.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:30:04.501+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:30:04.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:04.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:05.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:05.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:06.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:06.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:07.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:07.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:08.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:08.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:09.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:30:09.502+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:30:09.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:09.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:10.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:10.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:11.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:11.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:12.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:12.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:13.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:13.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:14.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:30:14.503+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:30:14.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:14.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:15.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:15.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:16.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:16.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:18.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:18.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:18.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:18.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:19.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:30:19.504+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:30:19.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:19.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:20.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:20.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:21.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:21.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:22.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:22.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:23.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:23.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:24.505 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:30:24.505+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:30:24.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:24.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:25.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:25.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:26.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:26.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:27.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:27.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:28.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:28.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:29.506 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:30:29.506+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:30:29.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:29.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:30.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:30.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:31.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:31.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:32.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:32.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:33.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:33.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:34.507 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:30:34.507+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:30:34.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:34.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:35.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:35.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:36.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:36.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:37.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:37.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:38.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:38.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:39.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:30:39.508+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:30:39.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:39.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:40.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:40.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:41.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:41.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:42.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:42.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:43.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:43.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:44.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:30:44.509+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:30:44.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:44.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:45.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:45.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:46.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:46.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:47.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:47.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:48.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:48.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:49.511 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:30:49.510+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:30:49.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:49.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:50.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:50.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:51.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:51.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:52.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:52.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:53.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:53.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:54.512 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:30:54.511+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:30:54.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:54.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:55.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:55.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:56.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:56.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:57.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:57.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:58.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:58.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:30:59.512 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:30:59.512+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:30:59.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:30:59.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:00.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:00.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:01.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:01.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:02.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:02.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:03.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:03.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:04.513 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:31:04.513+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:31:04.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:04.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:05.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:05.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:06.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:06.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:07.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:07.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:08.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:08.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:09.514 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:31:09.514+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:31:09.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:09.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:10.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:10.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:11.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:11.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:12.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:12.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:13.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:13.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:14.515 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:31:14.515+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:31:14.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:14.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:15.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:15.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:16.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:16.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:17.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:17.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:18.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:18.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:19.516 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:31:19.516+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:31:19.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:19.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:20.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:20.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:21.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:21.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:22.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:22.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:23.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:23.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:24.517 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:31:24.517+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:31:24.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:24.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:25.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:25.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:26.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:26.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:27.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:27.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:28.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:28.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:29.518 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:31:29.518+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:31:29.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:29.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:30.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:30.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:31.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:31.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:32.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:32.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:33.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:33.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:34.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:31:34.519+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:31:34.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:34.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:35.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:35.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:36.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:36.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:37.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:37.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:38.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:38.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:39.520 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:31:39.520+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:31:39.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:39.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:40.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:40.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:41.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:41.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:42.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:42.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:43.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:43.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:44.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:31:44.521+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:31:44.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:44.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:45.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:45.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:46.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:46.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:47.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:47.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:48.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:48.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:49.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:31:49.521+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:31:49.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:49.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:50.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:50.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:51.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:51.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:52.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:52.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:53.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:53.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:54.522 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:31:54.522+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:31:54.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:54.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:55.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:55.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:56.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:56.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:57.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:57.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:58.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:58.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:31:59.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:31:59.524+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:31:59.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:31:59.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:00.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:00.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:01.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:01.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:02.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:02.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:03.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:03.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:04.524 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:32:04.525+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:32:04.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:04.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:05.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:05.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:06.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:06.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:07.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:07.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:08.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:08.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:09.525 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:32:09.525+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:32:09.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:09.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:10.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:10.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:11.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:11.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:12.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:12.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:13.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:13.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:14.526 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:32:14.526+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:32:14.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:14.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:15.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:15.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:16.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:16.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:17.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:17.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:18.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:18.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:19.528 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:32:19.527+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:32:19.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:19.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:20.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:20.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:21.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:21.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:22.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:22.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:23.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:23.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:24.529 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:32:24.529+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:32:24.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:24.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:25.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:25.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:26.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:26.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:27.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:27.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:28.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:28.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:29.530 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:32:29.530+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:32:29.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:29.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:30.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:30.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:31.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:31.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:32.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:32.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:33.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:33.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:34.531 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:32:34.531+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:32:34.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:34.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:35.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:35.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:36.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:36.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:37.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:37.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:38.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:38.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:39.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:32:39.531+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:32:39.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:39.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:40.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:40.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:41.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:41.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:42.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:42.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:43.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:43.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:44.533 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:32:44.533+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:32:44.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:44.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:45.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:45.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:46.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:46.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:47.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:47.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:48.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:48.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:49.534 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:32:49.534+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:32:49.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:49.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:50.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:50.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:51.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:51.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:52.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:52.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:53.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:53.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:54.535 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:32:54.535+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:32:54.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:54.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:55.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:55.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:56.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:56.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:57.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:57.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:58.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:58.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:32:59.535 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:32:59.535+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:32:59.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:32:59.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:00.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:00.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:01.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:01.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:02.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:02.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:03.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:03.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:04.536 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:33:04.536+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:33:04.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:04.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:05.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:05.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:06.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:06.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:07.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:07.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:08.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:08.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:09.538 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:33:09.537+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:33:09.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:09.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:10.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:10.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:11.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:11.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:12.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:12.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:13.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:13.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:14.538 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:33:14.538+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:33:14.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:14.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:15.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:15.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:16.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:16.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:17.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:17.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:18.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:18.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:19.539 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:33:19.539+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:33:19.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:19.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:20.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:20.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:21.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:21.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:22.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:22.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:23.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:23.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:24.540 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:33:24.540+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:33:24.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:24.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:25.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:25.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:26.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:26.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:27.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:27.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:28.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:28.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:29.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:33:29.541+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:33:29.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:29.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:30.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:30.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:31.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:31.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:32.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:32.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:33.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:33.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:34.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:33:34.542+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:33:34.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:34.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:35.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:35.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:36.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:36.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:37.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:37.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:38.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:38.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:39.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:33:39.543+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:33:39.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:39.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:40.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:40.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:41.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:41.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:42.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:42.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:43.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:43.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:44.544 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:33:44.544+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:33:44.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:44.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:45.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:45.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:46.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:46.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:47.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:47.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:48.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:48.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:49.545 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:33:49.545+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:33:49.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:49.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:50.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:50.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:51.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:51.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:52.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:52.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:53.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:53.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:54.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:33:54.547+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:33:54.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:54.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:55.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:55.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:56.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:56.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:57.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:57.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:58.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:58.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:33:59.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:33:59.548+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:33:59.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:33:59.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:00.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:00.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:01.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:01.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:02.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:02.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:03.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:03.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:04.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:34:04.548+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:34:04.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:04.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:05.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:05.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:06.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:06.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:07.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:07.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:08.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:08.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:09.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:34:09.549+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:34:09.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:09.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:10.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:10.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:11.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:11.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:12.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:12.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:13.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:13.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:14.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:14.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:15.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:15.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:16.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:16.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:17.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:34:17.217+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:34:17.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:17.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:18.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:18.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:19.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:19.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:20.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:20.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:21.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:21.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:22.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:34:22.218+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:34:22.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:22.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:23.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:23.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:24.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:24.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:25.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:25.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:26.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:26.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:27.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:34:27.219+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:34:27.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:27.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:28.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:28.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:29.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:29.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:30.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:30.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:31.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:31.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:32.221 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:34:32.221+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:34:32.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:32.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:33.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:33.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:34.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:34.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:35.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:35.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:36.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:36.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:37.222 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:34:37.222+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:34:37.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:37.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:38.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:38.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:39.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:39.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:40.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:40.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:41.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:41.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:42.223 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:34:42.223+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:34:42.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:42.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:43.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:43.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:44.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:44.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:45.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:45.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:46.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:46.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:47.224 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:34:47.224+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:34:47.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:47.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:48.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:48.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:49.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:49.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:51.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:51.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:52.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:52.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:52.226 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:34:52.227+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:34:53.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:53.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:54.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:54.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:55.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:55.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:56.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:56.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:57.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:57.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:57.228 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:34:57.228+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:34:58.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:58.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:34:59.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:34:59.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:00.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:00.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:01.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:01.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:02.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:02.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:02.228 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:35:02.228+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:35:03.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:03.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:04.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:04.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:05.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:05.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:06.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:06.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:07.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:07.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:08.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:08.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:09.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:09.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:09.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:35:09.561+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:35:10.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:10.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:11.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:11.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:12.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:12.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:13.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:13.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:14.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:14.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:14.562 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:35:14.562+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:35:15.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:15.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:16.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:16.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:17.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:17.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:18.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:18.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:19.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:19.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:19.563 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:35:19.562+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:35:20.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:20.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:21.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:21.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:22.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:22.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:23.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:23.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:24.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:24.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:24.564 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:35:24.563+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:35:25.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:25.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:26.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:26.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:27.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:27.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:28.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:28.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:29.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:29.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:29.565 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:35:29.564+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:35:30.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:30.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:31.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:31.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:32.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:32.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:33.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:33.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:34.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:34.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:34.565 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:35:34.565+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:35:35.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:35.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:36.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:36.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:37.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:37.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:38.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:38.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:39.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:39.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:39.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:35:39.566+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:35:40.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:40.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:41.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:41.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:42.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:42.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:43.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:43.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:44.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:44.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:44.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:35:44.567+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:35:45.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:45.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:46.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:46.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:47.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:47.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:48.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:48.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:49.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:49.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:49.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:35:49.568+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:35:50.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:50.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:51.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:51.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:52.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:52.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:53.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:53.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:54.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:54.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:54.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:35:54.569+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:35:55.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:55.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:56.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:56.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:57.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:57.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:58.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:58.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:59.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:35:59.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:35:59.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:35:59.570+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:36:00.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:00.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:01.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:01.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:02.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:02.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:03.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:03.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:04.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:04.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:04.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:36:04.571+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:36:05.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:05.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:06.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:06.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:07.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:07.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:08.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:08.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:09.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:09.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:09.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:36:09.572+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:36:10.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:10.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:11.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:11.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:12.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:12.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:13.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:13.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:14.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:14.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:14.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:36:14.573+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:36:15.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:15.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:16.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:16.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:17.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:17.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:18.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:18.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:19.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:19.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:19.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:36:19.574+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:36:20.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:20.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:21.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:21.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:22.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:22.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:23.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:23.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:24.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:24.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:24.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:36:24.575+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:36:25.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:25.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:26.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:26.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:27.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:27.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:28.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:28.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:29.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:29.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:29.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:36:29.576+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:36:30.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:30.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:31.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:31.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:32.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:32.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:33.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:33.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:34.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:34.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:34.577 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:36:34.577+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:36:35.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:35.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:36.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:36.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:37.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:37.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:38.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:38.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:39.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:39.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:39.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:36:39.578+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:36:40.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:40.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:41.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:41.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:42.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:42.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:43.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:43.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:44.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:44.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:44.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:36:44.578+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:36:45.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:45.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:46.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:46.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:47.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:47.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:48.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:48.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:49.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:49.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:49.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:36:49.581+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:36:50.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:50.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:51.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:51.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:52.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:52.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:53.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:53.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:54.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:54.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:54.582 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:36:54.581+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:36:55.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:55.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:56.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:56.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:57.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:57.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:58.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:58.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:59.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:36:59.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:36:59.582 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:36:59.582+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:37:00.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:00.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:01.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:01.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:02.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:02.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:03.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:03.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:04.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:04.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:04.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:37:04.583+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:37:05.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:05.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:06.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:06.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:07.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:07.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:08.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:08.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:09.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:09.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:09.584 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:37:09.584+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:37:10.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:10.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:11.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:11.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:12.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:12.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:13.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:13.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:14.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:14.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:14.585 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:37:14.585+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:37:15.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:15.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:16.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:16.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:17.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:17.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:18.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:18.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:19.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:19.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:19.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:37:19.586+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:37:20.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:20.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:21.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:21.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:22.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:22.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:23.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:23.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:24.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:24.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:24.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:37:24.587+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:37:25.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:25.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:26.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:26.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:27.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:27.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:28.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:28.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:29.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:29.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:29.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:37:29.588+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:37:30.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:30.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:31.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:31.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:32.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:32.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:33.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:33.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:34.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:34.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:34.589 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:37:34.589+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:37:35.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:35.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:36.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:36.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:37.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:37.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:38.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:38.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:39.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:39.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:39.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:37:39.590+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:37:40.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:40.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:41.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:41.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:42.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:42.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:43.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:43.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:44.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:44.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:44.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:37:44.591+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:37:45.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:45.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:46.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:46.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:47.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:47.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:48.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:48.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:49.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:49.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:49.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:37:49.593+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:37:50.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:50.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:51.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:51.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:52.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:52.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:53.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:53.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:54.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:54.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:54.593 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:37:54.594+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:37:55.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:55.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:56.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:56.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:57.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:57.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:58.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:58.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:59.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:37:59.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:37:59.593 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:37:59.593+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:38:00.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:00.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:01.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:01.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:02.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:02.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:03.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:03.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:04.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:04.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:04.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:38:04.594+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:38:05.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:05.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:06.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:06.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:07.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:07.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:08.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:08.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:09.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:09.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:09.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:38:09.595+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:38:10.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:10.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:11.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:11.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:12.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:12.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:13.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:13.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:14.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:14.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:14.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:38:14.596+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:38:15.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:15.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:16.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:16.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:17.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:17.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:18.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:18.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:19.598 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:38:19.597+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:38:19.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:19.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:20.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:20.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:21.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:21.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:22.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:22.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:23.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:23.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:24.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:24.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:24.599 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:38:24.598+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:38:25.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:25.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:26.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:26.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:27.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:27.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:28.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:28.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:29.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:29.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:29.599 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:38:29.599+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:38:30.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:30.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:31.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:31.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:32.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:32.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:33.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:33.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:34.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:34.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:34.601 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:38:34.601+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:38:35.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:35.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:36.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:36.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:37.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:37.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:38.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:38.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:39.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:39.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:39.602 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:38:39.601+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:38:40.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:40.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:41.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:41.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:42.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:42.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:43.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:43.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:44.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:44.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:44.603 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:38:44.603+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:38:45.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:45.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:46.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:46.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:47.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:47.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:48.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:48.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:49.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:49.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:49.604 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:38:49.603+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:38:50.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:50.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:51.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:51.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:52.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:52.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:53.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:53.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:54.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:54.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:54.605 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:38:54.605+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:38:55.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:55.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:56.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:56.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:57.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:57.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:58.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:58.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:59.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:38:59.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:38:59.606 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:38:59.605+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:39:00.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:00.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:01.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:01.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:02.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:02.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:03.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:03.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:04.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:04.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:04.606 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:39:04.606+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:39:05.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:05.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:06.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:06.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:07.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:07.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:08.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:08.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:09.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:09.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:09.608 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:39:09.607+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:39:10.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:10.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:11.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:11.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:12.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:12.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:13.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:13.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:14.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:14.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:14.609 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:39:14.608+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:39:15.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:15.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:16.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:16.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:17.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:17.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:18.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:18.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:19.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:19.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:19.610 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:39:19.609+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:39:20.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:20.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:21.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:21.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:22.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:22.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:23.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:23.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:24.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:24.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:24.611 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:39:24.611+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:39:25.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:25.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:26.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:26.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:27.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:27.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:28.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:28.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:29.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:29.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:29.611 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:39:29.611+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:39:30.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:30.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:31.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:31.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:32.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:32.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:33.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:33.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:34.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:34.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:34.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:39:34.612+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:39:35.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:35.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:36.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:36.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:37.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:37.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:38.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:38.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:39.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:39.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:39.613 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:39:39.613+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:39:40.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:40.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:41.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:41.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:42.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:42.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:43.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:43.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:44.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:44.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:44.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:39:44.614+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:39:45.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:45.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:46.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:46.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:47.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:47.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:48.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:48.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:49.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:49.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:49.616 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:39:49.615+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:39:50.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:50.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:51.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:51.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:52.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:52.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:53.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:53.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:54.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:54.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:54.616 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:39:54.616+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:39:55.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:55.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:56.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:56.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:57.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:57.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:58.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:58.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:59.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:39:59.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:39:59.617 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:39:59.617+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:40:00.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:00.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:01.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:01.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:02.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:02.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:03.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:03.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:04.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:04.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:04.619 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:40:04.618+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:40:05.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:05.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:06.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:06.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:07.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:07.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:08.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:08.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:09.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:09.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:09.620 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:40:09.619+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:40:10.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:10.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:11.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:11.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:12.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:12.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:13.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:13.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:14.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:14.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:14.620 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:40:14.620+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:40:15.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:15.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:16.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:16.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:17.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:17.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:18.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:18.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:19.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:19.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:19.621 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:40:19.621+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:40:20.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:20.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:21.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:21.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:22.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:22.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:23.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:23.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:24.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:24.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:24.622 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:40:24.622+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:40:25.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:25.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:26.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:26.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:27.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:27.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:28.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:28.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:29.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:29.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:29.623 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:40:29.623+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:40:30.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:30.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:31.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:31.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:32.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:32.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:33.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:33.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:34.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:34.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:34.625 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:40:34.625+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:40:35.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:35.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:36.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:36.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:37.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:37.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:38.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:38.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:39.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:39.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:39.626 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:40:39.625+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:40:40.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:40.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:41.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:41.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:42.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:42.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:43.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:43.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:44.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:44.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:45.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:45.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:46.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:46.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:47.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:47.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:48.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:48.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:49.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:49.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:49.628 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:40:49.629+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:40:50.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:50.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:51.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:51.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:52.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:52.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:53.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:53.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:54.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:54.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:54.629 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:40:54.629+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:40:55.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:55.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:56.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:56.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:57.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:57.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:58.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:58.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:59.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:40:59.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:40:59.629 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:40:59.629+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:41:00.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:00.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:01.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:01.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:02.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:02.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:03.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:03.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:04.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:04.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:04.630 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:41:04.630+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:41:05.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:05.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:06.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:06.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:07.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:07.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:08.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:08.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:09.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:09.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:09.631 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:41:09.631+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:41:10.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:10.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:11.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:11.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:12.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:12.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:13.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:13.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:14.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:14.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:14.632 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:41:14.632+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:41:15.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:15.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:16.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:16.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:17.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:17.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:18.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:18.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:19.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:19.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:19.633 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:41:19.632+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:41:20.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:20.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:21.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:21.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:22.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:22.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:23.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:23.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:24.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:24.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:24.633 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:41:24.633+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:41:25.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:25.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:26.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:26.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:27.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:27.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:28.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:28.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:29.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:29.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:29.635 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:41:29.635+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:41:29.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:29.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:30.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:30.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:31.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:31.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:32.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:32.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:33.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:33.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:34.636 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:41:34.636+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:41:35.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:35.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:35.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:35.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:37.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:37.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:38.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:38.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:39.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:39.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:39.637 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:41:39.636+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:41:40.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:40.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:41.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:41.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:41.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:41.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:42.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:42.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:44.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:44.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:44.638 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:41:44.638+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:41:44.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:44.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:46.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:46.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:47.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:47.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:48.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:48.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:48.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:48.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:49.639 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:41:49.639+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:41:50.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:50.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:51.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:51.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:51.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:51.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:53.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:53.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:54.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:54.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:54.640 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:41:54.639+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:41:55.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:55.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:56.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:56.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:57.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:57.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:58.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:58.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:59.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:41:59.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:41:59.640 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:41:59.640+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:42:00.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:00.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:01.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:01.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:02.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:02.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:03.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:03.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:04.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:04.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:04.641 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:42:04.641+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:42:05.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:05.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:06.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:06.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:07.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:07.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:08.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:08.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:09.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:09.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:09.642 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:42:09.642+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:42:10.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:10.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:11.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:11.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:12.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:12.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:13.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:13.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:14.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:14.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:14.643 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:42:14.643+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:42:15.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:15.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:16.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:16.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:17.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:17.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:18.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:18.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:19.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:19.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:19.644 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:42:19.644+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:42:20.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:20.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:21.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:21.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:22.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:22.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:23.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:23.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:24.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:24.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:24.645 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:42:24.645+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:42:25.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:25.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:26.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:26.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:27.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:27.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:28.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:28.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:29.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:29.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:29.646 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:42:29.646+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:42:30.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:30.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:31.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:31.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:32.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:32.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:33.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:33.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:34.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:34.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:34.647 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:42:34.647+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:42:35.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:35.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:36.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:36.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:37.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:37.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:38.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:38.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:39.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:39.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:39.649 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:42:39.648+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:42:40.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:40.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:41.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:41.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:42.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:42.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:43.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:43.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:44.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:44.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:44.649 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:42:44.649+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:42:45.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:45.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:46.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:46.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:47.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:47.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:48.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:48.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:49.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:49.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:49.650 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:42:49.650+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:42:50.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:50.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:51.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:51.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:52.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:52.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:53.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:53.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:54.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:54.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:54.651 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:42:54.650+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:42:55.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:55.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:56.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:56.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:57.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:57.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:58.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:58.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:59.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:42:59.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:42:59.651 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:42:59.651+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:43:00.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:00.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:01.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:01.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:02.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:02.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:03.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:03.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:04.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:04.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:04.652 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:43:04.652+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:43:05.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:05.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:06.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:06.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:07.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:07.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:08.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:08.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:09.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:09.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:09.653 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:43:09.653+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:43:10.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:10.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:11.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:11.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:12.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:12.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:13.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:13.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:14.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:14.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:14.655 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:43:14.654+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:43:15.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:15.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:16.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:16.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:17.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:17.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:18.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:18.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:19.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:19.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:19.656 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:43:19.656+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:43:20.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:20.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:21.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:21.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:22.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:22.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:23.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:23.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:24.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:24.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:24.658 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:43:24.657+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:43:25.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:25.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:26.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:26.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:27.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:27.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:28.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:28.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:29.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:29.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:29.658 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:43:29.658+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:43:30.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:30.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:31.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:31.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:32.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:32.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:33.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:33.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:34.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:34.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:34.659 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:43:34.659+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:43:35.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:35.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:36.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:36.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:37.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:37.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:38.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:38.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:39.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:39.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:39.661 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:43:39.660+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:43:40.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:40.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:41.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:41.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:42.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:42.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:43.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:43.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:44.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:44.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:44.661 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:43:44.661+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:43:45.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:45.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:46.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:46.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:47.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:47.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:48.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:48.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:49.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:49.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:49.662 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:43:49.662+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:43:50.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:50.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:51.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:51.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:52.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:52.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:53.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:53.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:54.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:54.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:54.662 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:43:54.663+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:43:55.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:55.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:56.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:56.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:57.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:57.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:58.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:58.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:59.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:43:59.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:43:59.663 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:43:59.663+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:44:00.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:00.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:01.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:01.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:02.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:02.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:03.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:03.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:04.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:04.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:04.664 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:44:04.664+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:44:05.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:05.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:06.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:06.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:07.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:07.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:08.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:08.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:09.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:09.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:09.665 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:44:09.665+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:44:10.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:10.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:11.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:11.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:12.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:12.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:13.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:13.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:14.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:14.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:14.667 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:44:14.666+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:44:15.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:15.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:16.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:16.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:17.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:17.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:18.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:18.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:19.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:19.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:19.668 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:44:19.667+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:44:20.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:20.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:21.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:21.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:22.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:22.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:23.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:23.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:24.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:24.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:24.669 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:44:24.668+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:44:25.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:25.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:26.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:26.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:27.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:27.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:28.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:28.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:29.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:29.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:29.670 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:44:29.669+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:44:30.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:30.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:31.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:31.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:32.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:32.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:33.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:33.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:34.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:34.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:34.671 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:44:34.670+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:44:35.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:35.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:36.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:36.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:37.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:37.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:38.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:38.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:39.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:39.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:39.671 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:44:39.671+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:44:40.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:40.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:41.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:41.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:42.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:42.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:43.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:43.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:44.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:44.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:44.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:44:44.672+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:44:45.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:45.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:46.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:46.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:47.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:47.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:48.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:48.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:49.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:49.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:49.674 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:44:49.674+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:44:50.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:50.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:51.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:51.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:52.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:52.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:53.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:53.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:54.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:54.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:54.675 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:44:54.674+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:44:55.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:55.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:56.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:56.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:57.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:57.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:58.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:58.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:59.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:44:59.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:44:59.676 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:44:59.675+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:45:00.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:00.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:01.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:01.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:02.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:02.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:03.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:03.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:04.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:04.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:04.676 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:45:04.676+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:45:05.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:05.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:06.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:06.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:07.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:07.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:08.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:08.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:09.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:09.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:09.677 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:45:09.677+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:45:10.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:10.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:11.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:11.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:12.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:12.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:13.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:13.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:14.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:14.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:14.678 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:45:14.677+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:45:15.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:15.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:16.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:16.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:17.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:17.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:18.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:18.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:19.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:19.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:19.678 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:45:19.678+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:45:20.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:20.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:21.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:21.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:22.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:22.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:23.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:23.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:24.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:24.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:24.679 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:45:24.679+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:45:25.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:25.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:26.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:26.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:27.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:27.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:28.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:28.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:29.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:29.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:29.679 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:45:29.679+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:45:30.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:30.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:31.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:31.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:32.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:32.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:33.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:33.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:34.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:34.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:34.680 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:45:34.680+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:45:35.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:35.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:36.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:36.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:37.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:37.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:38.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:38.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:39.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:39.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:39.682 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:45:39.682+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:45:40.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:40.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:41.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:41.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:42.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:42.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:43.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:43.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:44.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:44.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:44.683 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:45:44.683+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:45:45.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:45.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:46.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:46.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:47.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:47.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:48.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:48.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:49.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:49.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:49.685 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:45:49.684+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:45:50.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:50.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:51.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:51.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:52.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:52.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:53.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:53.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:54.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:54.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:54.686 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:45:54.686+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:45:55.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:55.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:56.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:56.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:57.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:57.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:58.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:58.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:59.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:45:59.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:45:59.687 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:45:59.687+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:46:00.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:00.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:01.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:01.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:02.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:02.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:03.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:03.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:04.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:04.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:04.688 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:46:04.688+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:46:05.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:05.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:06.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:06.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:07.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:07.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:08.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:08.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:09.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:09.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:09.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:46:09.689+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:46:10.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:10.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:11.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:11.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:12.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:12.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:13.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:13.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:14.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:14.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:14.690 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:46:14.690+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:46:15.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:15.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:16.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:16.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:17.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:17.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:18.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:18.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:19.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:19.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:19.691 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:46:19.691+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:46:20.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:20.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:21.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:21.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:22.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:22.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:23.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:23.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:24.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:24.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:24.693 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:46:24.692+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:46:25.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:25.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:26.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:26.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:27.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:27.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:28.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:28.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:29.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:29.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:29.694 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:46:29.693+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:46:30.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:30.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:31.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:31.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:32.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:32.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:33.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:33.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:34.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:34.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:34.695 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:46:34.694+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:46:35.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:35.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:36.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:36.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:37.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:37.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:38.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:38.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:39.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:39.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:39.696 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:46:39.696+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:46:40.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:40.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:41.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:41.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:42.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:42.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:43.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:43.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:44.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:44.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:44.697 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:46:44.696+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:46:45.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:45.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:46.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:46.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:47.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:47.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:48.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:48.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:49.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:49.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:49.698 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:46:49.698+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:46:50.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:50.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:51.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:51.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:52.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:52.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:53.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:53.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:54.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:54.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:54.698 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:46:54.699+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:46:55.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:55.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:56.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:56.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:57.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:57.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:58.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:58.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:59.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:46:59.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:46:59.698 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:46:59.698+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:47:00.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:00.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:01.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:01.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:02.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:02.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:03.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:03.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:04.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:04.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:04.700 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:47:04.699+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:47:05.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:05.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:06.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:06.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:07.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:07.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:08.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:08.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:09.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:09.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:09.701 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:47:09.700+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:47:10.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:10.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:11.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:11.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:12.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:12.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:13.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:13.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:14.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:14.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:14.702 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:47:14.701+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:47:15.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:15.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:16.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:16.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:17.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:17.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:18.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:18.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:19.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:19.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:19.702 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:47:19.702+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:47:20.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:20.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:21.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:21.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:22.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:22.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:23.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:23.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:24.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:24.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:24.704 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:47:24.703+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:47:25.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:25.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:26.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:26.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:27.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:27.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:28.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:28.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:29.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:29.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:29.706 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:47:29.704+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:47:30.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:30.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:31.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:31.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:32.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:32.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:33.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:33.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:34.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:34.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:34.706 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:47:34.705+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:47:35.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:35.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:36.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:36.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:37.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:37.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:38.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:38.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:39.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:39.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:39.707 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:47:39.706+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:47:40.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:40.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:41.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:41.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:42.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:42.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:43.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:43.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:44.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:44.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:44.708 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:47:44.707+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:47:45.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:45.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:46.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:46.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:47.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:47.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:48.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:48.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:49.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:49.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:49.709 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:47:49.708+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:47:50.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:50.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:51.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:51.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:52.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:52.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:53.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:53.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:54.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:54.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:54.710 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:47:54.709+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:47:55.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:55.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:56.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:56.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:57.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:57.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:58.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:58.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:59.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:47:59.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:47:59.711 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:47:59.710+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:48:00.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:00.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:01.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:01.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:02.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:02.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:03.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:03.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:04.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:04.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:04.712 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:48:04.712+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:48:05.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:05.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:06.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:06.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:07.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:07.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:08.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:08.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:09.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:09.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:09.713 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:48:09.712+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:48:10.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:10.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:11.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:11.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:12.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:12.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:13.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:13.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:14.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:14.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:14.714 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:48:14.714+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:48:15.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:15.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:16.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:16.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:17.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:17.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:18.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:18.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:19.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:19.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:19.715 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:48:19.714+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:48:20.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:20.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:21.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:21.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:22.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:22.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:23.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:23.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:24.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:24.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:24.715 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:48:24.715+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:48:25.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:25.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:26.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:26.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:27.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:27.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:28.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:28.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:29.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:29.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:29.716 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:48:29.716+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:48:30.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:30.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:31.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:31.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:32.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:32.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:33.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:33.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:34.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:34.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:34.718 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:48:34.718+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:48:35.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:35.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:36.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:36.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:37.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:37.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:38.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:38.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:39.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:39.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:39.719 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:48:39.719+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:48:40.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:40.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:41.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:41.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:42.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:42.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:43.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:43.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:44.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:44.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:44.720 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:48:44.720+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:48:45.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:45.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:46.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:46.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:47.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:47.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:48.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:48.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:49.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:49.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:49.721 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:48:49.720+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:48:50.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:50.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:51.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:51.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:52.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:52.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:53.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:53.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:54.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:54.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:54.722 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:48:54.721+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:48:55.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:55.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:56.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:56.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:57.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:57.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:58.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:58.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:59.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:48:59.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:48:59.722 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:48:59.722+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:49:00.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:00.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:01.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:01.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:02.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:02.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:03.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:03.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:04.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:04.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:04.723 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:49:04.723+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:49:05.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:05.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:06.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:06.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:07.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:07.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:08.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:08.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:09.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:09.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:09.724 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:49:09.724+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:49:10.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:10.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:11.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:11.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:12.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:12.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:13.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:13.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:14.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:14.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:14.725 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:49:14.725+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:49:15.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:15.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:16.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:16.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:17.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:17.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:18.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:18.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:19.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:19.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:19.726 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:49:19.725+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:49:20.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:20.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:21.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:21.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:22.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:22.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:23.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:23.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:24.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:24.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:24.727 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:49:24.727+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:49:25.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:25.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:26.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:26.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:27.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:27.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:28.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:28.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:29.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:29.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:29.728 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:49:29.728+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:49:30.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:30.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:31.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:31.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:32.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:32.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:33.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:33.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:34.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:34.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:34.729 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:49:34.729+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:49:35.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:35.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:36.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:36.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:37.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:37.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:38.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:38.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:39.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:39.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:39.730 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:49:39.730+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:49:40.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:40.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:41.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:41.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:42.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:42.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:43.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:43.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:44.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:44.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:44.732 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:49:44.731+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:49:45.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:45.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:46.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:46.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:47.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:47.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:48.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:48.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:49.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:49.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:49.732 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:49:49.733+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:49:50.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:50.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:51.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:51.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:52.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:52.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:53.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:53.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:54.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:54.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:54.733 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:49:54.734+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:49:55.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:55.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:56.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:56.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:57.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:57.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:58.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:58.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:59.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:49:59.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:49:59.734 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:49:59.733+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:50:00.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:00.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:01.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:01.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:02.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:02.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:03.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:03.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:04.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:04.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:04.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:50:04.734+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:50:05.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:05.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:06.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:06.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:07.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:07.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:08.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:08.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:09.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:09.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:09.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:50:09.735+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:50:10.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:10.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:11.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:11.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:12.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:12.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:13.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:13.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:14.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:14.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:14.737 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:50:14.736+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:50:15.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:15.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:16.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:16.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:17.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:17.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:18.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:18.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:19.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:19.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:19.737 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:50:19.737+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:50:20.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:20.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:21.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:21.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:22.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:22.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:23.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:23.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:24.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:24.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:24.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:50:24.738+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:50:25.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:25.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:26.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:26.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:27.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:27.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:28.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:28.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:29.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:29.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:29.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:50:29.739+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:50:30.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:30.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:31.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:31.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:32.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:32.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:33.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:33.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:34.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:34.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:34.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:50:34.740+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:50:35.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:35.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:35.827 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:Terminated 2021-11-21T09:50:35.828 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ cleanup 143 2021-11-21T09:50:35.828 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local error_code=143 2021-11-21T09:50:35.828 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ set +e 2021-11-21T09:50:35.829 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ '[' 143 -ne 0 ']' 2021-11-21T09:50:35.829 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ status 2021-11-21T09:50:35.829 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 status 2021-11-21T09:50:35.830 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ local cluster daemon image_pool image_ns image 2021-11-21T09:50:35.830 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for cluster in ${CLUSTER1} ${CLUSTER2} 2021-11-21T09:50:35.830 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 status' 2021-11-21T09:50:35.830 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ARGS= 2021-11-21T09:50:35.831 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --cluster cluster1 -s 2021-11-21T09:50:36.131 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: cluster: 2021-11-21T09:50:36.131 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 84f78865-ca38-49d0-bbfb-e8f9679d6c9c 2021-11-21T09:50:36.131 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: HEALTH_OK 2021-11-21T09:50:36.131 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.132 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: services: 2021-11-21T09:50:36.132 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mon: 1 daemons, quorum a (age 6h) 2021-11-21T09:50:36.132 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mgr: x(active, since 6h) 2021-11-21T09:50:36.132 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: osd: 3 osds: 3 up (since 6h), 3 in (since 6h) 2021-11-21T09:50:36.132 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: rbd-mirror: 3 daemons active (4316, 4604, 4750) 2021-11-21T09:50:36.133 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.133 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: task status: 2021-11-21T09:50:36.133 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.133 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: data: 2021-11-21T09:50:36.133 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: pools: 4 pools, 137 pgs 2021-11-21T09:50:36.134 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: objects: 106 objects, 2.3 KiB 2021-11-21T09:50:36.134 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: usage: 3.0 GiB used, 267 GiB / 270 GiB avail 2021-11-21T09:50:36.134 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: pgs: 137 active+clean 2021-11-21T09:50:36.134 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.135 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: io: 2021-11-21T09:50:36.135 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: client: 2.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s rd, 1 op/s wr 2021-11-21T09:50:36.135 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.138 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ARGS= 2021-11-21T09:50:36.139 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --cluster cluster1 service dump 2021-11-21T09:50:36.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:36.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:36.367 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:{ 2021-11-21T09:50:36.368 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "epoch": 131, 2021-11-21T09:50:36.368 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "modified": "2021-11-21T09:49:24.318134+0000", 2021-11-21T09:50:36.368 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "services": { 2021-11-21T09:50:36.368 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "rbd-mirror": { 2021-11-21T09:50:36.369 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "daemons": { 2021-11-21T09:50:36.369 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "summary": "", 2021-11-21T09:50:36.369 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "4316": { 2021-11-21T09:50:36.369 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "start_epoch": 7, 2021-11-21T09:50:36.370 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "start_stamp": "2021-11-21T03:51:40.527461+0000", 2021-11-21T09:50:36.370 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "gid": 4316, 2021-11-21T09:50:36.370 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "addr": "172.21.2.143:0/845362684", 2021-11-21T09:50:36.370 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "metadata": { 2021-11-21T09:50:36.370 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "arch": "x86_64", 2021-11-21T09:50:36.371 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_release": "octopus", 2021-11-21T09:50:36.371 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-21T09:50:36.371 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_version_short": "15.2.15-32-gb0aaed0f", 2021-11-21T09:50:36.371 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "cpu": "Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz", 2021-11-21T09:50:36.372 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro": "rhel", 2021-11-21T09:50:36.372 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro_description": "Red Hat Enterprise Linux 8.3 (Ootpa)", 2021-11-21T09:50:36.372 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro_version": "8.3", 2021-11-21T09:50:36.372 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "hostname": "gibba043", 2021-11-21T09:50:36.372 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "id": "mirror.1", 2021-11-21T09:50:36.373 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "instance_id": "4316", 2021-11-21T09:50:36.373 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "kernel_description": "#1 SMP Mon Jul 26 08:06:24 EDT 2021", 2021-11-21T09:50:36.373 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "kernel_version": "4.18.0-305.12.1.el8_4.x86_64", 2021-11-21T09:50:36.373 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "mem_swap_kb": "0", 2021-11-21T09:50:36.373 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "mem_total_kb": "32622744", 2021-11-21T09:50:36.374 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "os": "Linux" 2021-11-21T09:50:36.374 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:36.374 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "task_status": {} 2021-11-21T09:50:36.374 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:36.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "4604": { 2021-11-21T09:50:36.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "start_epoch": 15, 2021-11-21T09:50:36.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "start_stamp": "2021-11-21T03:59:27.670407+0000", 2021-11-21T09:50:36.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "gid": 4604, 2021-11-21T09:50:36.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "addr": "172.21.2.143:0/3537487617", 2021-11-21T09:50:36.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "metadata": { 2021-11-21T09:50:36.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "arch": "x86_64", 2021-11-21T09:50:36.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_release": "octopus", 2021-11-21T09:50:36.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-21T09:50:36.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_version_short": "15.2.15-32-gb0aaed0f", 2021-11-21T09:50:36.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "cpu": "Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz", 2021-11-21T09:50:36.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro": "rhel", 2021-11-21T09:50:36.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro_description": "Red Hat Enterprise Linux 8.3 (Ootpa)", 2021-11-21T09:50:36.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro_version": "8.3", 2021-11-21T09:50:36.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "hostname": "gibba043", 2021-11-21T09:50:36.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "id": "mirror.3", 2021-11-21T09:50:36.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "instance_id": "4604", 2021-11-21T09:50:36.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "kernel_description": "#1 SMP Mon Jul 26 08:06:24 EDT 2021", 2021-11-21T09:50:36.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "kernel_version": "4.18.0-305.12.1.el8_4.x86_64", 2021-11-21T09:50:36.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "mem_swap_kb": "0", 2021-11-21T09:50:36.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "mem_total_kb": "32622744", 2021-11-21T09:50:36.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "os": "Linux" 2021-11-21T09:50:36.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:36.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "task_status": {} 2021-11-21T09:50:36.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:36.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "4750": { 2021-11-21T09:50:36.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "start_epoch": 18, 2021-11-21T09:50:36.381 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "start_stamp": "2021-11-21T04:03:24.762350+0000", 2021-11-21T09:50:36.381 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "gid": 4750, 2021-11-21T09:50:36.381 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "addr": "172.21.2.143:0/2860203705", 2021-11-21T09:50:36.381 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "metadata": { 2021-11-21T09:50:36.382 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "arch": "x86_64", 2021-11-21T09:50:36.382 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_release": "octopus", 2021-11-21T09:50:36.382 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-21T09:50:36.382 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_version_short": "15.2.15-32-gb0aaed0f", 2021-11-21T09:50:36.382 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "cpu": "Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz", 2021-11-21T09:50:36.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro": "rhel", 2021-11-21T09:50:36.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro_description": "Red Hat Enterprise Linux 8.3 (Ootpa)", 2021-11-21T09:50:36.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro_version": "8.3", 2021-11-21T09:50:36.383 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "hostname": "gibba043", 2021-11-21T09:50:36.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "id": "mirror.2", 2021-11-21T09:50:36.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "instance_id": "4750", 2021-11-21T09:50:36.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "kernel_description": "#1 SMP Mon Jul 26 08:06:24 EDT 2021", 2021-11-21T09:50:36.384 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "kernel_version": "4.18.0-305.12.1.el8_4.x86_64", 2021-11-21T09:50:36.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "mem_swap_kb": "0", 2021-11-21T09:50:36.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "mem_total_kb": "32622744", 2021-11-21T09:50:36.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "os": "Linux" 2021-11-21T09:50:36.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:36.385 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "task_status": {} 2021-11-21T09:50:36.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:36.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:36.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:36.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:36.386 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:} 2021-11-21T09:50:36.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ARGS= 2021-11-21T09:50:36.387 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --cluster cluster1 service status 2021-11-21T09:50:36.605 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:{ 2021-11-21T09:50:36.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "rbd-mirror": { 2021-11-21T09:50:36.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "4316": { 2021-11-21T09:50:36.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "status_stamp": "2021-11-21T09:50:15.872616+0000", 2021-11-21T09:50:36.606 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "last_beacon": "2021-11-21T09:50:35.872709+0000", 2021-11-21T09:50:36.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "status": { 2021-11-21T09:50:36.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "json": "{\"3\":{\"name\":\"mirror\",\"callouts\":{},\"image_assigned_count\":5,\"image_error_count\":0,\"image_local_count\":16,\"image_remote_count\":15,\"image_warning_count\":0,\"instance_id\":\"4319\",\"leader\":true,\"namespaces\":{\"ns1\":{\"image_assigned_count\":0,\"image_error_count\":0,\"image_local_count\":0,\"image_remote_count\":0,\"image_warning_count\":0},\"ns2\":{\"image_assigned_count\":0,\"image_error_count\":0,\"image_local_count\":0,\"image_remote_count\":0,\"image_warning_count\":0}}},\"4\":{\"name\":\"mirror_parent\",\"callouts\":{},\"image_assigned_count\":0,\"image_error_count\":0,\"image_local_count\":0,\"image_remote_count\":0,\"image_warning_count\":0,\"instance_id\":\"4321\",\"leader\":true}}" 2021-11-21T09:50:36.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:36.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:36.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "4604": { 2021-11-21T09:50:36.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "status_stamp": "2021-11-21T09:50:32.870527+0000", 2021-11-21T09:50:36.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "last_beacon": "2021-11-21T09:50:32.870527+0000", 2021-11-21T09:50:36.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "status": { 2021-11-21T09:50:36.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "json": "{\"3\":{\"name\":\"mirror\",\"callouts\":{},\"image_assigned_count\":5,\"image_error_count\":0,\"image_warning_count\":0,\"instance_id\":\"4607\",\"namespaces\":{\"ns1\":{\"image_assigned_count\":0,\"image_error_count\":0,\"image_warning_count\":0},\"ns2\":{\"image_assigned_count\":0,\"image_error_count\":0,\"image_warning_count\":0}}},\"4\":{\"name\":\"mirror_parent\",\"callouts\":{},\"image_assigned_count\":0,\"image_error_count\":0,\"image_warning_count\":0,\"instance_id\":\"4610\"}}" 2021-11-21T09:50:36.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:36.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:36.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "4750": { 2021-11-21T09:50:36.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "status_stamp": "2021-11-21T09:50:29.926824+0000", 2021-11-21T09:50:36.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "last_beacon": "2021-11-21T09:50:34.926886+0000", 2021-11-21T09:50:36.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "status": { 2021-11-21T09:50:36.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "json": "{\"3\":{\"name\":\"mirror\",\"callouts\":{},\"image_assigned_count\":5,\"image_error_count\":0,\"image_warning_count\":0,\"instance_id\":\"4753\",\"namespaces\":{\"ns1\":{\"image_assigned_count\":0,\"image_error_count\":0,\"image_warning_count\":0},\"ns2\":{\"image_assigned_count\":0,\"image_error_count\":0,\"image_warning_count\":0}}},\"4\":{\"name\":\"mirror_parent\",\"callouts\":{},\"image_assigned_count\":0,\"image_error_count\":0,\"image_warning_count\":0,\"instance_id\":\"4756\"}}" 2021-11-21T09:50:36.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:36.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:36.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:36.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:} 2021-11-21T09:50:36.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror images 2021-11-21T09:50:36.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:36.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image_pool in ${POOL} ${PARENT_POOL} 2021-11-21T09:50:36.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image_ns in "" "${NS1}" "${NS2}" 2021-11-21T09:50:36.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror images' 2021-11-21T09:50:36.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' ls -l 2021-11-21T09:50:36.676 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:NAME SIZE PARENT FMT PROT LOCK 2021-11-21T09:50:36.677 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_1 128 MiB 2 excl 2021-11-21T09:50:36.677 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_10 128 MiB 2 excl 2021-11-21T09:50:36.677 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_11 128 MiB 2 excl 2021-11-21T09:50:36.677 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_12 128 MiB 2 excl 2021-11-21T09:50:36.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_13 128 MiB 2 excl 2021-11-21T09:50:36.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_14 128 MiB 2 excl 2021-11-21T09:50:36.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_15 128 MiB 2 excl 2021-11-21T09:50:36.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_2 128 MiB 2 excl 2021-11-21T09:50:36.678 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_3 128 MiB 2 excl 2021-11-21T09:50:36.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_4 128 MiB 2 excl 2021-11-21T09:50:36.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_5 128 MiB 2 excl 2021-11-21T09:50:36.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_6 128 MiB 2 excl 2021-11-21T09:50:36.679 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_7 128 MiB 2 excl 2021-11-21T09:50:36.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_8 128 MiB 2 excl 2021-11-21T09:50:36.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_9 128 MiB 2 excl 2021-11-21T09:50:36.680 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.681 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:36.681 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror mirror pool info 2021-11-21T09:50:36.682 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror mirror pool info' 2021-11-21T09:50:36.682 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' mirror pool info 2021-11-21T09:50:36.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mode: image 2021-11-21T09:50:36.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Site Name: cluster1 2021-11-21T09:50:36.700 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Peer Sites: 2021-11-21T09:50:36.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:UUID: b641d402-21f7-4f5f-849e-57795b161e6b 2021-11-21T09:50:36.701 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Name: cluster2 2021-11-21T09:50:36.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirror UUID: 4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:36.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Direction: rx-tx 2021-11-21T09:50:36.702 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Client: client.mirror 2021-11-21T09:50:36.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror mirror pool status 2021-11-21T09:50:36.703 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:36.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror mirror pool status' 2021-11-21T09:50:36.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ARGS= 2021-11-21T09:50:36.704 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' mirror pool status --verbose 2021-11-21T09:50:36.725 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:health: WARNING 2021-11-21T09:50:36.725 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:daemon health: OK 2021-11-21T09:50:36.725 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image health: WARNING 2021-11-21T09:50:36.726 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:images: 15 total 2021-11-21T09:50:36.726 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 4 unknown 2021-11-21T09:50:36.726 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 11 starting_replay 2021-11-21T09:50:36.726 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:DAEMONS 2021-11-21T09:50:36.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:service 4316: 2021-11-21T09:50:36.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: instance_id: 4319 2021-11-21T09:50:36.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: client_id: mirror.1 2021-11-21T09:50:36.727 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: hostname: gibba043 2021-11-21T09:50:36.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: version: 15.2.15-32-gb0aaed0f 2021-11-21T09:50:36.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: leader: true 2021-11-21T09:50:36.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: OK 2021-11-21T09:50:36.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.728 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:service 4604: 2021-11-21T09:50:36.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: instance_id: 4607 2021-11-21T09:50:36.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: client_id: mirror.3 2021-11-21T09:50:36.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: hostname: gibba043 2021-11-21T09:50:36.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: version: 15.2.15-32-gb0aaed0f 2021-11-21T09:50:36.729 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: leader: false 2021-11-21T09:50:36.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: OK 2021-11-21T09:50:36.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:service 4750: 2021-11-21T09:50:36.730 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: instance_id: 4753 2021-11-21T09:50:36.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: client_id: mirror.2 2021-11-21T09:50:36.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: hostname: gibba043 2021-11-21T09:50:36.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: version: 15.2.15-32-gb0aaed0f 2021-11-21T09:50:36.731 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: leader: false 2021-11-21T09:50:36.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: OK 2021-11-21T09:50:36.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.732 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:IMAGES 2021-11-21T09:50:36.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_1: 2021-11-21T09:50:36.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: be46e825-58f6-4e65-b6d2-fc0be6e64f4e 2021-11-21T09:50:36.741 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T09:50:36.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637467301,"remote_snapshot_timestamp":1637467301,"replay_state":"idle"} 2021-11-21T09:50:36.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.1 on gibba043 2021-11-21T09:50:36.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:10 2021-11-21T09:50:36.742 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:12 2021-11-21T09:50:36.743 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.744 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_10: 2021-11-21T09:50:36.744 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: 42618bf2-8400-47df-b725-a1eb59f07031 2021-11-21T09:50:36.744 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.744 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.744 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.3 on gibba043 2021-11-21T09:50:36.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:27 2021-11-21T09:50:36.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: down+starting_replay 2021-11-21T09:50:36.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 04:15:35 2021-11-21T09:50:36.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_11: 2021-11-21T09:50:36.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: 2c130211-1580-41ed-aa51-f7643556598e 2021-11-21T09:50:36.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T09:50:36.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637467404,"remote_snapshot_timestamp":1637467404,"replay_state":"idle"} 2021-11-21T09:50:36.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.3 on gibba043 2021-11-21T09:50:36.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:27 2021-11-21T09:50:36.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:23 2021-11-21T09:50:36.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_12: 2021-11-21T09:50:36.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: 139b2feb-80c0-48dc-8426-7b6bdc64aa6d 2021-11-21T09:50:36.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T09:50:36.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637467415,"remote_snapshot_timestamp":1637467415,"replay_state":"idle"} 2021-11-21T09:50:36.751 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.2 on gibba043 2021-11-21T09:50:36.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:24 2021-11-21T09:50:36.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.752 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:30 2021-11-21T09:50:36.753 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_13: 2021-11-21T09:50:36.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: 2d7d427f-cc00-475d-8855-d03b1f0fa522 2021-11-21T09:50:36.754 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.1 on gibba043 2021-11-21T09:50:36.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:10 2021-11-21T09:50:36.755 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.756 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.756 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.756 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.756 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:12 2021-11-21T09:50:36.757 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.757 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_14: 2021-11-21T09:50:36.757 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: 89e936a4-e09b-4f45-8def-ed135c2927c8 2021-11-21T09:50:36.757 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T09:50:36.758 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637467437,"remote_snapshot_timestamp":1637467437,"replay_state":"idle"} 2021-11-21T09:50:36.758 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.3 on gibba043 2021-11-21T09:50:36.758 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:27 2021-11-21T09:50:36.758 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.759 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.759 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: down+starting_replay 2021-11-21T09:50:36.759 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.760 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 04:15:35 2021-11-21T09:50:36.760 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.760 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_15: 2021-11-21T09:50:36.760 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: f2d5f182-4b10-42f9-b5d2-151e9528777e 2021-11-21T09:50:36.761 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T09:50:36.761 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"remote_snapshot_timestamp":1637467450,"replay_state":"syncing","syncing_percent":0,"syncing_snapshot_timestamp":1637467450} 2021-11-21T09:50:36.761 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.2 on gibba043 2021-11-21T09:50:36.761 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:24 2021-11-21T09:50:36.762 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.762 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.762 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.762 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.763 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:23 2021-11-21T09:50:36.763 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.763 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_2: 2021-11-21T09:50:36.763 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: 6f66cc00-d06d-4d0e-a3ba-7a8e14ce9459 2021-11-21T09:50:36.764 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.764 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.764 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.2 on gibba043 2021-11-21T09:50:36.764 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:24 2021-11-21T09:50:36.764 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.765 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.765 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: down+starting_replay 2021-11-21T09:50:36.765 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.765 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 04:15:35 2021-11-21T09:50:36.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_3: 2021-11-21T09:50:36.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: 7ac970f4-f86d-4f19-b1d6-44ae38498abc 2021-11-21T09:50:36.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T09:50:36.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637467324,"remote_snapshot_timestamp":1637467324,"replay_state":"idle"} 2021-11-21T09:50:36.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.3 on gibba043 2021-11-21T09:50:36.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:27 2021-11-21T09:50:36.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:23 2021-11-21T09:50:36.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_4: 2021-11-21T09:50:36.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: 215afa64-ac76-4ba2-a08b-49839af9f78c 2021-11-21T09:50:36.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T09:50:36.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637467338,"remote_snapshot_timestamp":1637467338,"replay_state":"idle"} 2021-11-21T09:50:36.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.1 on gibba043 2021-11-21T09:50:36.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:10 2021-11-21T09:50:36.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:30 2021-11-21T09:50:36.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_5: 2021-11-21T09:50:36.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: a1f86261-eb99-4961-b238-70a123bab03c 2021-11-21T09:50:36.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T09:50:36.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637467347,"remote_snapshot_timestamp":1637467347,"replay_state":"idle"} 2021-11-21T09:50:36.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.2 on gibba043 2021-11-21T09:50:36.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:24 2021-11-21T09:50:36.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:12 2021-11-21T09:50:36.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_6: 2021-11-21T09:50:36.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: 8a5bd1f3-8041-4bae-9906-cb85875aeb2a 2021-11-21T09:50:36.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.1 on gibba043 2021-11-21T09:50:36.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:10 2021-11-21T09:50:36.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: down+starting_replay 2021-11-21T09:50:36.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 04:15:35 2021-11-21T09:50:36.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_7: 2021-11-21T09:50:36.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: e7ffa431-fb16-42fc-8895-9a08e47d331f 2021-11-21T09:50:36.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T09:50:36.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637467367,"remote_snapshot_timestamp":1637467367,"replay_state":"idle"} 2021-11-21T09:50:36.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.3 on gibba043 2021-11-21T09:50:36.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:27 2021-11-21T09:50:36.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:23 2021-11-21T09:50:36.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_8: 2021-11-21T09:50:36.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: 91a3408b-8ea3-490d-9a45-f350e49e992d 2021-11-21T09:50:36.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T09:50:36.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637467376,"remote_snapshot_timestamp":1637467376,"replay_state":"idle"} 2021-11-21T09:50:36.783 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.1 on gibba043 2021-11-21T09:50:36.783 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:10 2021-11-21T09:50:36.783 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.783 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.783 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:30 2021-11-21T09:50:36.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_9: 2021-11-21T09:50:36.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: global_id: 1376368b-86a1-428f-85a1-9ec262aa5595 2021-11-21T09:50:36.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+replaying 2021-11-21T09:50:36.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637467386,"remote_snapshot_timestamp":1637467386,"replay_state":"idle"} 2021-11-21T09:50:36.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: service: mirror.2 on gibba043 2021-11-21T09:50:36.785 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:24 2021-11-21T09:50:36.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: peer_sites: 2021-11-21T09:50:36.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: name: cluster2 2021-11-21T09:50:36.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: state: up+starting_replay 2021-11-21T09:50:36.786 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: description: starting replay 2021-11-21T09:50:36.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: last_update: 2021-11-21 09:50:12 2021-11-21T09:50:36.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:36.787 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:36.788 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ rbd --cluster cluster1 -p mirror --namespace '' ls 2021-11-21T09:50:36.788 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:36.789 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_1 info 2021-11-21T09:50:36.789 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_1 info' 2021-11-21T09:50:36.790 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_1 2021-11-21T09:50:37.013 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_1': 2021-11-21T09:50:37.013 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:37.014 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:37.014 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:37.014 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 110cbd8e431b 2021-11-21T09:50:37.014 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.110cbd8e431b 2021-11-21T09:50:37.015 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:37.015 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:37.015 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:37.015 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:37.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:01:43 2021 2021-11-21T09:50:37.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:01:43 2021 2021-11-21T09:50:37.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:01:43 2021 2021-11-21T09:50:37.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:37.016 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:37.017 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: be46e825-58f6-4e65-b6d2-fc0be6e64f4e 2021-11-21T09:50:37.017 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:37.018 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.018 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.018 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_1 journal status 2021-11-21T09:50:37.019 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_1 journal status' 2021-11-21T09:50:37.019 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_1 2021-11-21T09:50:37.046 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_1 2021-11-21T09:50:37.048 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.048 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.049 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_1 snapshots 2021-11-21T09:50:37.049 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_1 snapshots' 2021-11-21T09:50:37.049 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_1 2021-11-21T09:50:37.078 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:37.078 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 53 .mirror.non_primary.be46e825-58f6-4e65-b6d2-fc0be6e64f4e.a486a353-1483-4877-9769-7c932356ac74 128 MiB Sun Nov 21 04:01:44 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:68 copied) 2021-11-21T09:50:37.080 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.080 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.081 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:37.081 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_10 info 2021-11-21T09:50:37.082 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_10 info' 2021-11-21T09:50:37.082 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_10 2021-11-21T09:50:37.108 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_10': 2021-11-21T09:50:37.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:37.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:37.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:37.109 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 11935ca5bd73 2021-11-21T09:50:37.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.11935ca5bd73 2021-11-21T09:50:37.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:37.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:37.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:37.110 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:37.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:03:18 2021 2021-11-21T09:50:37.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:03:18 2021 2021-11-21T09:50:37.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:03:18 2021 2021-11-21T09:50:37.111 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:37.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:37.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: 42618bf2-8400-47df-b725-a1eb59f07031 2021-11-21T09:50:37.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:37.112 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.113 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.113 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_10 journal status 2021-11-21T09:50:37.114 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_10 journal status' 2021-11-21T09:50:37.114 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_10 2021-11-21T09:50:37.137 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_10 2021-11-21T09:50:37.139 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.139 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_10 snapshots 2021-11-21T09:50:37.140 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.140 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_10 snapshots' 2021-11-21T09:50:37.140 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_10 2021-11-21T09:50:37.166 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:37.166 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 79 .mirror.non_primary.42618bf2-8400-47df-b725-a1eb59f07031.0f971db9-7052-4723-9d51-bd5bda657d2f 128 MiB Sun Nov 21 04:03:18 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:77 copied) 2021-11-21T09:50:37.168 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.168 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.169 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:37.169 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_11 info 2021-11-21T09:50:37.170 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_11 info' 2021-11-21T09:50:37.170 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_11 2021-11-21T09:50:37.201 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_11': 2021-11-21T09:50:37.201 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:37.202 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:37.202 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:37.202 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 11ff71a4aa4c 2021-11-21T09:50:37.202 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.11ff71a4aa4c 2021-11-21T09:50:37.203 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:37.203 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:37.203 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:37.203 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:37.204 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:03:26 2021 2021-11-21T09:50:37.204 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:03:26 2021 2021-11-21T09:50:37.204 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:03:26 2021 2021-11-21T09:50:37.204 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:37.204 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:37.205 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: 2c130211-1580-41ed-aa51-f7643556598e 2021-11-21T09:50:37.205 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:37.206 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.206 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.206 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_11 journal status 2021-11-21T09:50:37.207 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_11 journal status' 2021-11-21T09:50:37.207 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_11 2021-11-21T09:50:37.226 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_11 2021-11-21T09:50:37.228 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.229 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.229 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_11 snapshots 2021-11-21T09:50:37.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_11 snapshots' 2021-11-21T09:50:37.230 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_11 2021-11-21T09:50:37.257 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:37.257 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 80 .mirror.non_primary.2c130211-1580-41ed-aa51-f7643556598e.fab419ae-4fb5-4353-b102-b2df22b032bc 128 MiB Sun Nov 21 04:03:27 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:78 copied) 2021-11-21T09:50:37.259 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.259 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.260 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:37.260 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_12 info 2021-11-21T09:50:37.261 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_12 info' 2021-11-21T09:50:37.261 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_12 2021-11-21T09:50:37.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:37.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:37.285 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_12': 2021-11-21T09:50:37.285 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:37.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:37.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:37.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 12918cd474ad 2021-11-21T09:50:37.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.12918cd474ad 2021-11-21T09:50:37.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:37.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:37.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:37.287 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:37.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:03:37 2021 2021-11-21T09:50:37.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:03:37 2021 2021-11-21T09:50:37.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:03:37 2021 2021-11-21T09:50:37.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:37.288 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:37.289 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: 139b2feb-80c0-48dc-8426-7b6bdc64aa6d 2021-11-21T09:50:37.289 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:37.289 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.290 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_12 journal status 2021-11-21T09:50:37.290 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.290 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_12 journal status' 2021-11-21T09:50:37.291 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_12 2021-11-21T09:50:37.315 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_12 2021-11-21T09:50:37.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.317 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_12 snapshots 2021-11-21T09:50:37.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_12 snapshots' 2021-11-21T09:50:37.318 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_12 2021-11-21T09:50:37.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:37.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 81 .mirror.non_primary.139b2feb-80c0-48dc-8426-7b6bdc64aa6d.42224e14-a5d6-40a0-b03d-f21f3b29ed1b 128 MiB Sun Nov 21 04:03:38 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:79 copied) 2021-11-21T09:50:37.345 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.345 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_13 info 2021-11-21T09:50:37.346 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.346 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:37.346 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_13 info' 2021-11-21T09:50:37.346 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_13 2021-11-21T09:50:37.374 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_13': 2021-11-21T09:50:37.374 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:37.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:37.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:37.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 11935e218d8 2021-11-21T09:50:37.375 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.11935e218d8 2021-11-21T09:50:37.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:37.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:37.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:37.376 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:37.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:03:51 2021 2021-11-21T09:50:37.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:03:51 2021 2021-11-21T09:50:37.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:03:51 2021 2021-11-21T09:50:37.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:37.377 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:37.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: 2d7d427f-cc00-475d-8855-d03b1f0fa522 2021-11-21T09:50:37.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:37.378 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.379 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_13 journal status 2021-11-21T09:50:37.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_13 journal status' 2021-11-21T09:50:37.380 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_13 2021-11-21T09:50:37.405 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_13 2021-11-21T09:50:37.407 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.407 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_13 snapshots 2021-11-21T09:50:37.407 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_13 snapshots' 2021-11-21T09:50:37.408 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_13 2021-11-21T09:50:37.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:37.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 82 .mirror.non_primary.2d7d427f-cc00-475d-8855-d03b1f0fa522.9251b965-31da-4d4c-b419-831f078b9b1a 128 MiB Sun Nov 21 04:03:52 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:80 copied) 2021-11-21T09:50:37.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:37.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_14 info' 2021-11-21T09:50:37.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_14 info 2021-11-21T09:50:37.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_14 2021-11-21T09:50:37.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_14': 2021-11-21T09:50:37.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:37.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:37.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:37.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 11fff10f492b 2021-11-21T09:50:37.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.11fff10f492b 2021-11-21T09:50:37.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:37.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:37.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:37.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:37.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:03:59 2021 2021-11-21T09:50:37.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:03:59 2021 2021-11-21T09:50:37.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:03:59 2021 2021-11-21T09:50:37.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:37.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:37.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: 89e936a4-e09b-4f45-8def-ed135c2927c8 2021-11-21T09:50:37.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:37.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_14 journal status 2021-11-21T09:50:37.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_14 journal status' 2021-11-21T09:50:37.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_14 2021-11-21T09:50:37.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_14 2021-11-21T09:50:37.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_14 snapshots 2021-11-21T09:50:37.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_14 snapshots' 2021-11-21T09:50:37.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_14 2021-11-21T09:50:37.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:37.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 83 .mirror.non_primary.89e936a4-e09b-4f45-8def-ed135c2927c8.e69f592f-71c6-4e6f-a6ab-e9363c5960df 128 MiB Sun Nov 21 04:03:59 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:81 copied) 2021-11-21T09:50:37.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:37.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_15 info 2021-11-21T09:50:37.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_15 info' 2021-11-21T09:50:37.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_15 2021-11-21T09:50:37.557 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_15': 2021-11-21T09:50:37.557 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:37.557 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:37.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:37.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 12911bc54a71 2021-11-21T09:50:37.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.12911bc54a71 2021-11-21T09:50:37.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:37.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:37.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:37.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:37.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:04:12 2021 2021-11-21T09:50:37.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:04:12 2021 2021-11-21T09:50:37.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:04:12 2021 2021-11-21T09:50:37.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:37.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:37.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: f2d5f182-4b10-42f9-b5d2-151e9528777e 2021-11-21T09:50:37.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:37.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_15 journal status 2021-11-21T09:50:37.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_15 journal status' 2021-11-21T09:50:37.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_15 2021-11-21T09:50:37.588 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_15 2021-11-21T09:50:37.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_15 snapshots 2021-11-21T09:50:37.590 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_15 snapshots' 2021-11-21T09:50:37.591 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_15 2021-11-21T09:50:37.619 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:37.620 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 84 .mirror.non_primary.f2d5f182-4b10-42f9-b5d2-151e9528777e.e6fcdd22-8f72-4dc0-8353-ddf620ef8fb0 128 MiB Sun Nov 21 04:04:13 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:82 0% copied) 2021-11-21T09:50:37.621 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_2 info 2021-11-21T09:50:37.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:37.622 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_2 info' 2021-11-21T09:50:37.623 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_2 2021-11-21T09:50:37.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_2': 2021-11-21T09:50:37.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:37.650 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:37.651 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:37.651 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 1193a62e9c6d 2021-11-21T09:50:37.651 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.1193a62e9c6d 2021-11-21T09:50:37.651 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:37.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:37.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:37.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:37.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:01:54 2021 2021-11-21T09:50:37.652 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:01:54 2021 2021-11-21T09:50:37.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:01:54 2021 2021-11-21T09:50:37.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:37.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:37.653 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: 6f66cc00-d06d-4d0e-a3ba-7a8e14ce9459 2021-11-21T09:50:37.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:37.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.654 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_2 journal status 2021-11-21T09:50:37.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_2 journal status' 2021-11-21T09:50:37.655 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_2 2021-11-21T09:50:37.681 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_2 2021-11-21T09:50:37.683 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.683 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_2 snapshots 2021-11-21T09:50:37.683 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.684 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_2 snapshots' 2021-11-21T09:50:37.684 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_2 2021-11-21T09:50:37.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:37.712 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 65 .mirror.non_primary.6f66cc00-d06d-4d0e-a3ba-7a8e14ce9459.66bba5a3-6829-4d6b-917a-bbc594097f8b 128 MiB Sun Nov 21 04:01:55 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:69 copied) 2021-11-21T09:50:37.713 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.714 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:37.715 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_3 info 2021-11-21T09:50:37.715 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_3 info' 2021-11-21T09:50:37.715 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_3 2021-11-21T09:50:37.744 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_3': 2021-11-21T09:50:37.744 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:37.744 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:37.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:37.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 11ffaca17dec 2021-11-21T09:50:37.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.11ffaca17dec 2021-11-21T09:50:37.745 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:37.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:37.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:37.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:37.746 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:02:06 2021 2021-11-21T09:50:37.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:02:06 2021 2021-11-21T09:50:37.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:02:06 2021 2021-11-21T09:50:37.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:37.747 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:37.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: 7ac970f4-f86d-4f19-b1d6-44ae38498abc 2021-11-21T09:50:37.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:37.748 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.749 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_3 journal status 2021-11-21T09:50:37.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_3 journal status' 2021-11-21T09:50:37.750 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_3 2021-11-21T09:50:37.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_3 2021-11-21T09:50:37.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_3 snapshots 2021-11-21T09:50:37.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_3 snapshots' 2021-11-21T09:50:37.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_3 2021-11-21T09:50:37.803 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:37.803 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 72 .mirror.non_primary.7ac970f4-f86d-4f19-b1d6-44ae38498abc.0f4f618c-b7f5-4136-89c9-26c314180f0d 128 MiB Sun Nov 21 04:02:07 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:70 copied) 2021-11-21T09:50:37.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.805 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.806 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:37.806 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_4 info' 2021-11-21T09:50:37.806 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_4 info 2021-11-21T09:50:37.807 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_4 2021-11-21T09:50:37.832 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_4': 2021-11-21T09:50:37.832 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:37.833 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:37.833 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:37.833 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 10df81b4d003 2021-11-21T09:50:37.833 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.10df81b4d003 2021-11-21T09:50:37.833 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:37.834 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:37.834 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:37.834 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:37.834 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:02:20 2021 2021-11-21T09:50:37.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:02:20 2021 2021-11-21T09:50:37.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:02:20 2021 2021-11-21T09:50:37.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:37.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:37.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: 215afa64-ac76-4ba2-a08b-49839af9f78c 2021-11-21T09:50:37.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:37.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.837 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.837 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_4 journal status 2021-11-21T09:50:37.838 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_4 journal status' 2021-11-21T09:50:37.838 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_4 2021-11-21T09:50:37.860 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_4 2021-11-21T09:50:37.862 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.863 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.863 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_4 snapshots 2021-11-21T09:50:37.864 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_4 snapshots' 2021-11-21T09:50:37.864 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_4 2021-11-21T09:50:37.889 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:37.889 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 73 .mirror.non_primary.215afa64-ac76-4ba2-a08b-49839af9f78c.aee87329-7e49-4863-9b64-a7755c502cd7 128 MiB Sun Nov 21 04:02:21 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:71 copied) 2021-11-21T09:50:37.891 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.891 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:37.892 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_5 info' 2021-11-21T09:50:37.893 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_5 info 2021-11-21T09:50:37.893 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_5 2021-11-21T09:50:37.922 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_5': 2021-11-21T09:50:37.922 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:37.922 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:37.923 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:37.923 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 110c962e61d3 2021-11-21T09:50:37.923 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.110c962e61d3 2021-11-21T09:50:37.923 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:37.924 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:37.924 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:37.924 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:37.924 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:02:29 2021 2021-11-21T09:50:37.924 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:02:29 2021 2021-11-21T09:50:37.925 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:02:29 2021 2021-11-21T09:50:37.925 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:37.925 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:37.925 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: a1f86261-eb99-4961-b238-70a123bab03c 2021-11-21T09:50:37.926 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:37.926 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.927 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.927 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_5 journal status 2021-11-21T09:50:37.928 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_5 journal status' 2021-11-21T09:50:37.928 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_5 2021-11-21T09:50:37.951 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_5 2021-11-21T09:50:37.954 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.954 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.954 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_5 snapshots 2021-11-21T09:50:37.955 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_5 snapshots' 2021-11-21T09:50:37.955 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_5 2021-11-21T09:50:37.980 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:37.980 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 74 .mirror.non_primary.a1f86261-eb99-4961-b238-70a123bab03c.ba0467dd-d6e2-4ccd-b7ce-f28b9b474e3d 128 MiB Sun Nov 21 04:02:30 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:72 copied) 2021-11-21T09:50:37.982 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:37.983 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:37.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:37.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_6 info' 2021-11-21T09:50:37.984 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_6 info 2021-11-21T09:50:37.985 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_6 2021-11-21T09:50:38.009 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_6': 2021-11-21T09:50:38.009 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:38.009 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:38.010 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:38.010 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 11935378c071 2021-11-21T09:50:38.010 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.11935378c071 2021-11-21T09:50:38.010 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:38.010 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:38.011 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:38.011 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:38.011 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:02:38 2021 2021-11-21T09:50:38.011 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:02:38 2021 2021-11-21T09:50:38.012 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:02:38 2021 2021-11-21T09:50:38.012 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:38.012 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:38.012 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: 8a5bd1f3-8041-4bae-9906-cb85875aeb2a 2021-11-21T09:50:38.012 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:38.013 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.013 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.014 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_6 journal status 2021-11-21T09:50:38.014 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_6 journal status' 2021-11-21T09:50:38.014 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_6 2021-11-21T09:50:38.038 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_6 2021-11-21T09:50:38.040 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.041 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.041 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_6 snapshots 2021-11-21T09:50:38.042 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_6 snapshots' 2021-11-21T09:50:38.042 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_6 2021-11-21T09:50:38.067 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:38.068 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 75 .mirror.non_primary.8a5bd1f3-8041-4bae-9906-cb85875aeb2a.c3499a46-467e-4042-a7c3-559e0063d734 128 MiB Sun Nov 21 04:02:38 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:73 copied) 2021-11-21T09:50:38.069 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.070 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.070 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:38.070 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_7 info' 2021-11-21T09:50:38.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_7 info 2021-11-21T09:50:38.071 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_7 2021-11-21T09:50:38.097 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_7': 2021-11-21T09:50:38.097 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:38.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:38.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:38.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 11ffab067935 2021-11-21T09:50:38.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.11ffab067935 2021-11-21T09:50:38.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:38.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:38.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:38.099 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:38.100 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:02:49 2021 2021-11-21T09:50:38.100 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:02:49 2021 2021-11-21T09:50:38.100 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:02:49 2021 2021-11-21T09:50:38.100 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:38.100 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:38.101 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: e7ffa431-fb16-42fc-8895-9a08e47d331f 2021-11-21T09:50:38.101 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:38.101 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.102 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.102 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_7 journal status 2021-11-21T09:50:38.103 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_7 journal status' 2021-11-21T09:50:38.103 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_7 2021-11-21T09:50:38.127 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_7 2021-11-21T09:50:38.129 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.130 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.130 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_7 snapshots 2021-11-21T09:50:38.131 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_7 snapshots' 2021-11-21T09:50:38.131 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_7 2021-11-21T09:50:38.156 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:38.156 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 76 .mirror.non_primary.e7ffa431-fb16-42fc-8895-9a08e47d331f.358958db-2e4b-4925-a82e-0ddde16f979b 128 MiB Sun Nov 21 04:02:50 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:74 copied) 2021-11-21T09:50:38.158 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.158 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:38.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_8 info' 2021-11-21T09:50:38.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_8 info 2021-11-21T09:50:38.160 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_8 2021-11-21T09:50:38.187 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_8': 2021-11-21T09:50:38.187 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:38.187 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:38.188 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:38.188 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 10dfccc09249 2021-11-21T09:50:38.188 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.10dfccc09249 2021-11-21T09:50:38.188 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:38.188 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:38.189 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:38.189 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:38.189 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:02:58 2021 2021-11-21T09:50:38.189 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:02:58 2021 2021-11-21T09:50:38.189 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:02:58 2021 2021-11-21T09:50:38.190 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:38.190 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:38.190 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: 91a3408b-8ea3-490d-9a45-f350e49e992d 2021-11-21T09:50:38.190 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:38.191 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_8 journal status 2021-11-21T09:50:38.192 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_8 journal status' 2021-11-21T09:50:38.193 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_8 2021-11-21T09:50:38.219 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_8 2021-11-21T09:50:38.221 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_8 snapshots 2021-11-21T09:50:38.222 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_8 snapshots' 2021-11-21T09:50:38.223 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_8 2021-11-21T09:50:38.249 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:38.249 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 77 .mirror.non_primary.91a3408b-8ea3-490d-9a45-f350e49e992d.a0d4f2d0-c5a2-4a16-8d87-c682254e6fd7 128 MiB Sun Nov 21 04:02:58 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:75 copied) 2021-11-21T09:50:38.251 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.251 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.252 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image in `rbd --cluster ${cluster} -p ${image_pool} --namespace "${image_ns}" ls 2>/dev/null` 2021-11-21T09:50:38.252 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_9 info 2021-11-21T09:50:38.253 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_9 info' 2021-11-21T09:50:38.253 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' info image_9 2021-11-21T09:50:38.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:38.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:38.281 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:rbd image 'image_9': 2021-11-21T09:50:38.281 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: size 128 MiB in 32 objects 2021-11-21T09:50:38.281 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: order 22 (4 MiB objects) 2021-11-21T09:50:38.281 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: snapshot_count: 1 2021-11-21T09:50:38.282 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 110cbdf77d80 2021-11-21T09:50:38.282 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: block_name_prefix: rbd_data.110cbdf77d80 2021-11-21T09:50:38.282 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: format: 2 2021-11-21T09:50:38.282 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: features: layering, exclusive-lock, object-map, fast-diff, non-primary 2021-11-21T09:50:38.283 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: op_features: 2021-11-21T09:50:38.283 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: flags: 2021-11-21T09:50:38.283 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: create_timestamp: Sun Nov 21 04:03:08 2021 2021-11-21T09:50:38.283 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: access_timestamp: Sun Nov 21 04:03:08 2021 2021-11-21T09:50:38.283 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: modify_timestamp: Sun Nov 21 04:03:08 2021 2021-11-21T09:50:38.284 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring state: enabled 2021-11-21T09:50:38.284 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring mode: snapshot 2021-11-21T09:50:38.284 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring global id: 1376368b-86a1-428f-85a1-9ec262aa5595 2021-11-21T09:50:38.284 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mirroring primary: false 2021-11-21T09:50:38.285 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.285 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_9 journal status 2021-11-21T09:50:38.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_9 journal status' 2021-11-21T09:50:38.286 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' journal status --image image_9 2021-11-21T09:50:38.311 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: journaling is not enabled for image image_9 2021-11-21T09:50:38.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.313 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.314 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image image_9 snapshots 2021-11-21T09:50:38.314 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'image image_9 snapshots' 2021-11-21T09:50:38.314 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' snap ls --all image_9 2021-11-21T09:50:38.340 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:SNAPID NAME SIZE PROTECTED TIMESTAMP NAMESPACE 2021-11-21T09:50:38.340 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 78 .mirror.non_primary.1376368b-86a1-428f-85a1-9ec262aa5595.51863825-c4db-463c-ae19-c2209d323fd0 128 MiB Sun Nov 21 04:03:08 2021 mirror (non-primary peer_uuids:[] 4fa635b5-ad3c-4925-9808-f708842ccb00:76 copied) 2021-11-21T09:50:38.342 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror rbd_mirroring omap vals 2021-11-21T09:50:38.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.343 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror rbd_mirroring omap vals' 2021-11-21T09:50:38.344 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rados --cluster cluster1 -p mirror --namespace '' listomapvals rbd_mirroring 2021-11-21T09:50:38.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_1376368b-86a1-428f-85a1-9ec262aa5595 2021-11-21T09:50:38.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.428 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 31 30 63 62 64 66 37 37 64 38 30 |....110cbdf77d80| 2021-11-21T09:50:38.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_139b2feb-80c0-48dc-8426-7b6bdc64aa6d 2021-11-21T09:50:38.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.429 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 32 39 31 38 63 64 34 37 34 61 64 |....12918cd474ad| 2021-11-21T09:50:38.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_215afa64-ac76-4ba2-a08b-49839af9f78c 2021-11-21T09:50:38.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.430 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 30 64 66 38 31 62 34 64 30 30 33 |....10df81b4d003| 2021-11-21T09:50:38.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_2c130211-1580-41ed-aa51-f7643556598e 2021-11-21T09:50:38.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.431 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 31 66 66 37 31 61 34 61 61 34 63 |....11ff71a4aa4c| 2021-11-21T09:50:38.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_2d7d427f-cc00-475d-8855-d03b1f0fa522 2021-11-21T09:50:38.432 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (15 bytes) : 2021-11-21T09:50:38.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0b 00 00 00 31 31 39 33 35 65 32 31 38 64 38 |....11935e218d8| 2021-11-21T09:50:38.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:0000000f 2021-11-21T09:50:38.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_42618bf2-8400-47df-b725-a1eb59f07031 2021-11-21T09:50:38.433 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 31 39 33 35 63 61 35 62 64 37 33 |....11935ca5bd73| 2021-11-21T09:50:38.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_6f66cc00-d06d-4d0e-a3ba-7a8e14ce9459 2021-11-21T09:50:38.434 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 31 39 33 61 36 32 65 39 63 36 64 |....1193a62e9c6d| 2021-11-21T09:50:38.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.435 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_7ac970f4-f86d-4f19-b1d6-44ae38498abc 2021-11-21T09:50:38.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 31 66 66 61 63 61 31 37 64 65 63 |....11ffaca17dec| 2021-11-21T09:50:38.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.436 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_89e936a4-e09b-4f45-8def-ed135c2927c8 2021-11-21T09:50:38.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 31 66 66 66 31 30 66 34 39 32 62 |....11fff10f492b| 2021-11-21T09:50:38.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.437 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_8a5bd1f3-8041-4bae-9906-cb85875aeb2a 2021-11-21T09:50:38.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 31 39 33 35 33 37 38 63 30 37 31 |....11935378c071| 2021-11-21T09:50:38.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.438 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_91a3408b-8ea3-490d-9a45-f350e49e992d 2021-11-21T09:50:38.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 30 64 66 63 63 63 30 39 32 34 39 |....10dfccc09249| 2021-11-21T09:50:38.439 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_a1f86261-eb99-4961-b238-70a123bab03c 2021-11-21T09:50:38.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 31 30 63 39 36 32 65 36 31 64 33 |....110c962e61d3| 2021-11-21T09:50:38.440 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_be46e825-58f6-4e65-b6d2-fc0be6e64f4e 2021-11-21T09:50:38.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.441 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 31 30 63 62 64 38 65 34 33 31 62 |....110cbd8e431b| 2021-11-21T09:50:38.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_e7ffa431-fb16-42fc-8895-9a08e47d331f 2021-11-21T09:50:38.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.442 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 31 66 66 61 62 30 36 37 39 33 35 |....11ffab067935| 2021-11-21T09:50:38.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:global_f2d5f182-4b10-42f9-b5d2-151e9528777e 2021-11-21T09:50:38.443 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (16 bytes) : 2021-11-21T09:50:38.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 0c 00 00 00 31 32 39 31 31 62 63 35 34 61 37 31 |....12911bc54a71| 2021-11-21T09:50:38.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 2021-11-21T09:50:38.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_10df81b4d003 2021-11-21T09:50:38.444 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 32 31 35 61 66 61 |..*...$...215afa| 2021-11-21T09:50:38.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 36 34 2d 61 63 37 36 2d 34 62 61 32 2d 61 30 38 |64-ac76-4ba2-a08| 2021-11-21T09:50:38.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 62 2d 34 39 38 33 39 61 66 39 66 37 38 63 01 01 |b-49839af9f78c..| 2021-11-21T09:50:38.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.445 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_10dfccc09249 2021-11-21T09:50:38.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 39 31 61 33 34 30 |..*...$...91a340| 2021-11-21T09:50:38.446 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 38 62 2d 38 65 61 33 2d 34 39 30 64 2d 39 61 34 |8b-8ea3-490d-9a4| 2021-11-21T09:50:38.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 35 2d 66 33 35 30 65 34 39 65 39 39 32 64 01 01 |5-f350e49e992d..| 2021-11-21T09:50:38.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_110c962e61d3 2021-11-21T09:50:38.447 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 61 31 66 38 36 32 |..*...$...a1f862| 2021-11-21T09:50:38.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 36 31 2d 65 62 39 39 2d 34 39 36 31 2d 62 32 33 |61-eb99-4961-b23| 2021-11-21T09:50:38.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 38 2d 37 30 61 31 32 33 62 61 62 30 33 63 01 01 |8-70a123bab03c..| 2021-11-21T09:50:38.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.448 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_110cbd8e431b 2021-11-21T09:50:38.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 62 65 34 36 65 38 |..*...$...be46e8| 2021-11-21T09:50:38.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 32 35 2d 35 38 66 36 2d 34 65 36 35 2d 62 36 64 |25-58f6-4e65-b6d| 2021-11-21T09:50:38.449 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 32 2d 66 63 30 62 65 36 65 36 34 66 34 65 01 01 |2-fc0be6e64f4e..| 2021-11-21T09:50:38.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_110cbdf77d80 2021-11-21T09:50:38.450 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 31 33 37 36 33 36 |..*...$...137636| 2021-11-21T09:50:38.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 38 62 2d 38 36 61 31 2d 34 32 38 66 2d 38 35 61 |8b-86a1-428f-85a| 2021-11-21T09:50:38.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 31 2d 39 65 63 32 36 32 61 61 35 35 39 35 01 01 |1-9ec262aa5595..| 2021-11-21T09:50:38.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.451 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_11935378c071 2021-11-21T09:50:38.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 38 61 35 62 64 31 |..*...$...8a5bd1| 2021-11-21T09:50:38.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 66 33 2d 38 30 34 31 2d 34 62 61 65 2d 39 39 30 |f3-8041-4bae-990| 2021-11-21T09:50:38.452 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 36 2d 63 62 38 35 38 37 35 61 65 62 32 61 01 01 |6-cb85875aeb2a..| 2021-11-21T09:50:38.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_11935ca5bd73 2021-11-21T09:50:38.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.453 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 34 32 36 31 38 62 |..*...$...42618b| 2021-11-21T09:50:38.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 66 32 2d 38 34 30 30 2d 34 37 64 66 2d 62 37 32 |f2-8400-47df-b72| 2021-11-21T09:50:38.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 35 2d 61 31 65 62 35 39 66 30 37 30 33 31 01 01 |5-a1eb59f07031..| 2021-11-21T09:50:38.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.454 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_11935e218d8 2021-11-21T09:50:38.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 32 64 37 64 34 32 |..*...$...2d7d42| 2021-11-21T09:50:38.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 37 66 2d 63 63 30 30 2d 34 37 35 64 2d 38 38 35 |7f-cc00-475d-885| 2021-11-21T09:50:38.455 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 35 2d 64 30 33 62 31 66 30 66 61 35 32 32 01 01 |5-d03b1f0fa522..| 2021-11-21T09:50:38.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_1193a62e9c6d 2021-11-21T09:50:38.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.456 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 36 66 36 36 63 63 |..*...$...6f66cc| 2021-11-21T09:50:38.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 30 30 2d 64 30 36 64 2d 34 64 30 65 2d 61 33 62 |00-d06d-4d0e-a3b| 2021-11-21T09:50:38.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 61 2d 37 61 38 65 31 34 63 65 39 34 35 39 01 01 |a-7a8e14ce9459..| 2021-11-21T09:50:38.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.457 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_11ff71a4aa4c 2021-11-21T09:50:38.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 32 63 31 33 30 32 |..*...$...2c1302| 2021-11-21T09:50:38.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 31 31 2d 31 35 38 30 2d 34 31 65 64 2d 61 61 35 |11-1580-41ed-aa5| 2021-11-21T09:50:38.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 31 2d 66 37 36 34 33 35 35 36 35 39 38 65 01 01 |1-f7643556598e..| 2021-11-21T09:50:38.458 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_11ffab067935 2021-11-21T09:50:38.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 65 37 66 66 61 34 |..*...$...e7ffa4| 2021-11-21T09:50:38.459 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 33 31 2d 66 62 31 36 2d 34 32 66 63 2d 38 38 39 |31-fb16-42fc-889| 2021-11-21T09:50:38.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 35 2d 39 61 30 38 65 34 37 64 33 33 31 66 01 01 |5-9a08e47d331f..| 2021-11-21T09:50:38.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_11ffaca17dec 2021-11-21T09:50:38.460 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 37 61 63 39 37 30 |..*...$...7ac970| 2021-11-21T09:50:38.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 66 34 2d 66 38 36 64 2d 34 66 31 39 2d 62 31 64 |f4-f86d-4f19-b1d| 2021-11-21T09:50:38.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 36 2d 34 34 61 65 33 38 34 39 38 61 62 63 01 01 |6-44ae38498abc..| 2021-11-21T09:50:38.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.461 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_11fff10f492b 2021-11-21T09:50:38.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 38 39 65 39 33 36 |..*...$...89e936| 2021-11-21T09:50:38.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 61 34 2d 65 30 39 62 2d 34 66 34 35 2d 38 64 65 |a4-e09b-4f45-8de| 2021-11-21T09:50:38.462 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 66 2d 65 64 31 33 35 63 32 39 32 37 63 38 01 01 |f-ed135c2927c8..| 2021-11-21T09:50:38.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_12911bc54a71 2021-11-21T09:50:38.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.463 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 66 32 64 35 66 31 |..*...$...f2d5f1| 2021-11-21T09:50:38.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 38 32 2d 34 62 31 30 2d 34 32 66 39 2d 62 35 64 |82-4b10-42f9-b5d| 2021-11-21T09:50:38.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 32 2d 31 35 31 65 39 35 32 38 37 37 37 65 01 01 |2-151e9528777e..| 2021-11-21T09:50:38.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.464 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image_12918cd474ad 2021-11-21T09:50:38.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (48 bytes) : 2021-11-21T09:50:38.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 2a 00 00 00 24 00 00 00 31 33 39 62 32 66 |..*...$...139b2f| 2021-11-21T09:50:38.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 65 62 2d 38 30 63 30 2d 34 38 64 63 2d 38 34 32 |eb-80c0-48dc-842| 2021-11-21T09:50:38.465 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 36 2d 37 62 36 62 64 63 36 34 61 61 36 64 01 01 |6-7b6bdc64aa6d..| 2021-11-21T09:50:38.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 2021-11-21T09:50:38.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:mirror_mode 2021-11-21T09:50:38.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (4 bytes) : 2021-11-21T09:50:38.466 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 00 00 00 |....| 2021-11-21T09:50:38.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000004 2021-11-21T09:50:38.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:mirror_peer_b641d402-21f7-4f5f-849e-57795b161e6b 2021-11-21T09:50:38.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (132 bytes) : 2021-11-21T09:50:38.467 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 7e 00 00 00 24 00 00 00 62 36 34 31 64 34 |..~...$...b641d4| 2021-11-21T09:50:38.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 30 32 2d 32 31 66 37 2d 34 66 35 66 2d 38 34 39 |02-21f7-4f5f-849| 2021-11-21T09:50:38.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 65 2d 35 37 37 39 35 62 31 36 31 65 36 62 08 00 |e-57795b161e6b..| 2021-11-21T09:50:38.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 63 6c 75 73 74 65 72 32 0d 00 00 00 63 6c |..cluster2....cl| 2021-11-21T09:50:38.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 69 65 6e 74 2e 6d 69 72 72 6f 72 ff ff ff ff ff |ient.mirror.....| 2021-11-21T09:50:38.468 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 ff ff ff 02 24 00 00 00 34 66 61 36 33 35 62 35 |....$...4fa635b5| 2021-11-21T09:50:38.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 2d 61 64 33 63 2d 34 39 32 35 2d 39 38 30 38 2d |-ad3c-4925-9808-| 2021-11-21T09:50:38.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000070 66 37 30 38 38 34 32 63 63 62 30 30 69 16 9a 61 |f708842ccb00i..a| 2021-11-21T09:50:38.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000080 0f f0 52 2e |..R.| 2021-11-21T09:50:38.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000084 2021-11-21T09:50:38.469 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:mirror_uuid 2021-11-21T09:50:38.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (36 bytes) : 2021-11-21T09:50:38.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 39 63 64 32 61 30 31 37 2d 36 61 62 32 2d 34 36 |9cd2a017-6ab2-46| 2021-11-21T09:50:38.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 32 33 2d 61 65 31 32 2d 39 62 65 62 35 65 63 64 |23-ae12-9beb5ecd| 2021-11-21T09:50:38.470 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 34 31 38 30 |4180| 2021-11-21T09:50:38.471 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000024 2021-11-21T09:50:38.471 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.471 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_1376368b-86a1-428f-85a1-9ec262aa5595_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.471 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 39 11 00 00 00 00 00 00 01 |..,....9........| 2021-11-21T09:50:38.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 81 20 0c d8 10 00 |........... ....| 2021-11-21T09:50:38.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.472 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 54 16 9a 61 |rting replayT..a| 2021-11-21T09:50:38.473 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 f8 8d 23 28 00 |..#(.| 2021-11-21T09:50:38.473 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.473 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.473 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_139b2feb-80c0-48dc-8426-7b6bdc64aa6d_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.473 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.474 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 cf 10 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.474 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 8a bd 12 11 10 00 |................| 2021-11-21T09:50:38.474 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.474 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.474 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 66 16 9a 61 |rting replayf..a| 2021-11-21T09:50:38.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 92 0e e9 27 00 |...'.| 2021-11-21T09:50:38.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_215afa64-ac76-4ba2-a08b-49839af9f78c_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.475 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 cf 10 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 8a bd 12 11 10 00 |................| 2021-11-21T09:50:38.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.476 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 66 16 9a 61 |rting replayf..a| 2021-11-21T09:50:38.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 a4 71 e9 27 00 |.q.'.| 2021-11-21T09:50:38.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.477 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_2c130211-1580-41ed-aa51-f7643556598e_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.478 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.478 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 1f 12 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.478 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 ac ca 51 07 10 00 |............Q...| 2021-11-21T09:50:38.478 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.478 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 5f 16 9a 61 |rting replay_..a| 2021-11-21T09:50:38.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 ea 4b 39 29 00 |.K9).| 2021-11-21T09:50:38.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.479 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_2d7d427f-cc00-475d-8855-d03b1f0fa522_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 39 11 00 00 00 00 00 00 01 |..,....9........| 2021-11-21T09:50:38.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 81 20 0c d8 10 00 |........... ....| 2021-11-21T09:50:38.480 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.481 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.481 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 54 16 9a 61 |rting replayT..a| 2021-11-21T09:50:38.481 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 d3 21 24 28 00 |.!$(.| 2021-11-21T09:50:38.481 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.481 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_42618bf2-8400-47df-b725-a1eb59f07031_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 f0 11 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 08 18 bc b3 10 00 |................| 2021-11-21T09:50:38.482 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 e7 c7 99 61 |rting replay...a| 2021-11-21T09:50:38.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 2a 80 29 25 00 |*.)%.| 2021-11-21T09:50:38.483 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_6f66cc00-d06d-4d0e-a3ba-7a8e14ce9459_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 f0 11 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.484 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 08 18 bc b3 10 00 |................| 2021-11-21T09:50:38.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 e7 c7 99 61 |rting replay...a| 2021-11-21T09:50:38.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 b3 14 2a 25 00 |..*%.| 2021-11-21T09:50:38.485 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_7ac970f4-f86d-4f19-b1d6-44ae38498abc_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 1f 12 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.486 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 ac ca 51 07 10 00 |............Q...| 2021-11-21T09:50:38.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 5f 16 9a 61 |rting replay_..a| 2021-11-21T09:50:38.487 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 93 a5 39 29 00 |..9).| 2021-11-21T09:50:38.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_89e936a4-e09b-4f45-8def-ed135c2927c8_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.488 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 f0 11 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 08 18 bc b3 10 00 |................| 2021-11-21T09:50:38.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 e7 c7 99 61 |rting replay...a| 2021-11-21T09:50:38.489 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 54 92 2a 25 00 |T.*%.| 2021-11-21T09:50:38.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_8a5bd1f3-8041-4bae-9906-cb85875aeb2a_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.490 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 f0 11 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 08 18 bc b3 10 00 |................| 2021-11-21T09:50:38.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.491 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 e7 c7 99 61 |rting replay...a| 2021-11-21T09:50:38.492 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 8c 0c 2b 25 00 |..+%.| 2021-11-21T09:50:38.492 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.492 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.492 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_91a3408b-8ea3-490d-9a45-f350e49e992d_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.492 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.493 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 cf 10 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.493 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 8a bd 12 11 10 00 |................| 2021-11-21T09:50:38.493 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.493 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.494 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 66 16 9a 61 |rting replayf..a| 2021-11-21T09:50:38.494 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 b4 b0 e9 27 00 |...'.| 2021-11-21T09:50:38.494 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.494 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.494 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_a1f86261-eb99-4961-b238-70a123bab03c_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 39 11 00 00 00 00 00 00 01 |..,....9........| 2021-11-21T09:50:38.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 81 20 0c d8 10 00 |........... ....| 2021-11-21T09:50:38.495 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 54 16 9a 61 |rting replayT..a| 2021-11-21T09:50:38.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 b8 a1 24 28 00 |..$(.| 2021-11-21T09:50:38.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.496 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_ae33bebc-39f4-48a5-879d-767006d29885_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (96 bytes) : 2021-11-21T09:50:38.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 cf 10 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 8a bd 12 11 10 00 |................| 2021-11-21T09:50:38.497 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 28 00 00 00 01 1a 00 00 00 65 72 72 |....(........err| 2021-11-21T09:50:38.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 6f 72 20 62 6f 6f 74 73 74 72 61 70 70 69 6e 67 |or bootstrapping| 2021-11-21T09:50:38.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 20 72 65 70 6c 61 79 b8 c4 99 61 ff 1d b8 22 00 | replay...a...".| 2021-11-21T09:50:38.498 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 2021-11-21T09:50:38.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_be46e825-58f6-4e65-b6d2-fc0be6e64f4e_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 39 11 00 00 00 00 00 00 01 |..,....9........| 2021-11-21T09:50:38.499 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 81 20 0c d8 10 00 |........... ....| 2021-11-21T09:50:38.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 54 16 9a 61 |rting replayT..a| 2021-11-21T09:50:38.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 7e 22 25 28 00 |~"%(.| 2021-11-21T09:50:38.500 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_e7ffa431-fb16-42fc-8895-9a08e47d331f_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 1f 12 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.501 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 ac ca 51 07 10 00 |............Q...| 2021-11-21T09:50:38.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 5f 16 9a 61 |rting replay_..a| 2021-11-21T09:50:38.502 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 5b e8 39 29 00 |[.9).| 2021-11-21T09:50:38.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:remote_status_global_f2d5f182-4b10-42f9-b5d2-151e9528777e_4fa635b5-ad3c-4925-9808-f708842ccb00 2021-11-21T09:50:38.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.503 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 1f 12 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 ac ca 51 07 10 00 |............Q...| 2021-11-21T09:50:38.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 5f 16 9a 61 |rting replay_..a| 2021-11-21T09:50:38.504 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 c3 28 3a 29 00 |.(:).| 2021-11-21T09:50:38.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_1376368b-86a1-428f-85a1-9ec262aa5595 2021-11-21T09:50:38.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (229 bytes) : 2021-11-21T09:50:38.505 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 91 12 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 9a 02 4a 99 10 00 |............J...| 2021-11-21T09:50:38.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 ad 00 00 00 04 9f 00 00 00 72 65 70 |.............rep| 2021-11-21T09:50:38.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 6c 61 79 69 6e 67 2c 20 7b 22 62 79 74 65 73 5f |laying, {"bytes_| 2021-11-21T09:50:38.506 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 70 65 72 5f 73 65 63 6f 6e 64 22 3a 30 2e 30 2c |per_second":0.0,| 2021-11-21T09:50:38.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 22 62 79 74 65 73 5f 70 65 72 5f 73 6e 61 70 73 |"bytes_per_snaps| 2021-11-21T09:50:38.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000070 68 6f 74 22 3a 30 2e 30 2c 22 6c 6f 63 61 6c 5f |hot":0.0,"local_| 2021-11-21T09:50:38.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000080 73 6e 61 70 73 68 6f 74 5f 74 69 6d 65 73 74 61 |snapshot_timesta| 2021-11-21T09:50:38.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000090 6d 70 22 3a 31 36 33 37 34 36 37 33 38 36 2c 22 |mp":1637467386,"| 2021-11-21T09:50:38.507 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000a0 72 65 6d 6f 74 65 5f 73 6e 61 70 73 68 6f 74 5f |remote_snapshot_| 2021-11-21T09:50:38.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000b0 74 69 6d 65 73 74 61 6d 70 22 3a 31 36 33 37 34 |timestamp":16374| 2021-11-21T09:50:38.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000c0 36 37 33 38 36 2c 22 72 65 70 6c 61 79 5f 73 74 |67386,"replay_st| 2021-11-21T09:50:38.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000d0 61 74 65 22 3a 22 69 64 6c 65 22 7d 60 16 9a 61 |ate":"idle"}`..a| 2021-11-21T09:50:38.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e0 06 75 3c 35 00 |.u<5.| 2021-11-21T09:50:38.508 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e5 2021-11-21T09:50:38.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_139b2feb-80c0-48dc-8426-7b6bdc64aa6d 2021-11-21T09:50:38.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (229 bytes) : 2021-11-21T09:50:38.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 91 12 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.509 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 9a 02 4a 99 10 00 |............J...| 2021-11-21T09:50:38.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 ad 00 00 00 04 9f 00 00 00 72 65 70 |.............rep| 2021-11-21T09:50:38.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 6c 61 79 69 6e 67 2c 20 7b 22 62 79 74 65 73 5f |laying, {"bytes_| 2021-11-21T09:50:38.510 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 70 65 72 5f 73 65 63 6f 6e 64 22 3a 30 2e 30 2c |per_second":0.0,| 2021-11-21T09:50:38.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 22 62 79 74 65 73 5f 70 65 72 5f 73 6e 61 70 73 |"bytes_per_snaps| 2021-11-21T09:50:38.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000070 68 6f 74 22 3a 30 2e 30 2c 22 6c 6f 63 61 6c 5f |hot":0.0,"local_| 2021-11-21T09:50:38.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000080 73 6e 61 70 73 68 6f 74 5f 74 69 6d 65 73 74 61 |snapshot_timesta| 2021-11-21T09:50:38.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000090 6d 70 22 3a 31 36 33 37 34 36 37 34 31 35 2c 22 |mp":1637467415,"| 2021-11-21T09:50:38.511 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000a0 72 65 6d 6f 74 65 5f 73 6e 61 70 73 68 6f 74 5f |remote_snapshot_| 2021-11-21T09:50:38.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000b0 74 69 6d 65 73 74 61 6d 70 22 3a 31 36 33 37 34 |timestamp":16374| 2021-11-21T09:50:38.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000c0 36 37 34 31 35 2c 22 72 65 70 6c 61 79 5f 73 74 |67415,"replay_st| 2021-11-21T09:50:38.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000d0 61 74 65 22 3a 22 69 64 6c 65 22 7d 60 16 9a 61 |ate":"idle"}`..a| 2021-11-21T09:50:38.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e0 14 d5 3c 35 00 |..<5.| 2021-11-21T09:50:38.512 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e5 2021-11-21T09:50:38.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_215afa64-ac76-4ba2-a08b-49839af9f78c 2021-11-21T09:50:38.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (229 bytes) : 2021-11-21T09:50:38.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 df 10 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.513 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 e7 75 5d 00 10 00 |...........u]...| 2021-11-21T09:50:38.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 ad 00 00 00 04 9f 00 00 00 72 65 70 |.............rep| 2021-11-21T09:50:38.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 6c 61 79 69 6e 67 2c 20 7b 22 62 79 74 65 73 5f |laying, {"bytes_| 2021-11-21T09:50:38.514 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 70 65 72 5f 73 65 63 6f 6e 64 22 3a 30 2e 30 2c |per_second":0.0,| 2021-11-21T09:50:38.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 22 62 79 74 65 73 5f 70 65 72 5f 73 6e 61 70 73 |"bytes_per_snaps| 2021-11-21T09:50:38.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000070 68 6f 74 22 3a 30 2e 30 2c 22 6c 6f 63 61 6c 5f |hot":0.0,"local_| 2021-11-21T09:50:38.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000080 73 6e 61 70 73 68 6f 74 5f 74 69 6d 65 73 74 61 |snapshot_timesta| 2021-11-21T09:50:38.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000090 6d 70 22 3a 31 36 33 37 34 36 37 33 33 38 2c 22 |mp":1637467338,"| 2021-11-21T09:50:38.515 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000a0 72 65 6d 6f 74 65 5f 73 6e 61 70 73 68 6f 74 5f |remote_snapshot_| 2021-11-21T09:50:38.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000b0 74 69 6d 65 73 74 61 6d 70 22 3a 31 36 33 37 34 |timestamp":16374| 2021-11-21T09:50:38.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000c0 36 37 33 33 38 2c 22 72 65 70 6c 61 79 5f 73 74 |67338,"replay_st| 2021-11-21T09:50:38.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000d0 61 74 65 22 3a 22 69 64 6c 65 22 7d 52 16 9a 61 |ate":"idle"}R..a| 2021-11-21T09:50:38.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e0 97 cd d7 26 00 |...&.| 2021-11-21T09:50:38.516 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e5 2021-11-21T09:50:38.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_2c130211-1580-41ed-aa51-f7643556598e 2021-11-21T09:50:38.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (229 bytes) : 2021-11-21T09:50:38.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 ff 11 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.517 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 51 da 7f ed 10 00 |..........Q.....| 2021-11-21T09:50:38.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 ad 00 00 00 04 9f 00 00 00 72 65 70 |.............rep| 2021-11-21T09:50:38.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 6c 61 79 69 6e 67 2c 20 7b 22 62 79 74 65 73 5f |laying, {"bytes_| 2021-11-21T09:50:38.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 70 65 72 5f 73 65 63 6f 6e 64 22 3a 30 2e 30 2c |per_second":0.0,| 2021-11-21T09:50:38.518 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 22 62 79 74 65 73 5f 70 65 72 5f 73 6e 61 70 73 |"bytes_per_snaps| 2021-11-21T09:50:38.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000070 68 6f 74 22 3a 30 2e 30 2c 22 6c 6f 63 61 6c 5f |hot":0.0,"local_| 2021-11-21T09:50:38.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000080 73 6e 61 70 73 68 6f 74 5f 74 69 6d 65 73 74 61 |snapshot_timesta| 2021-11-21T09:50:38.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000090 6d 70 22 3a 31 36 33 37 34 36 37 34 30 34 2c 22 |mp":1637467404,"| 2021-11-21T09:50:38.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000a0 72 65 6d 6f 74 65 5f 73 6e 61 70 73 68 6f 74 5f |remote_snapshot_| 2021-11-21T09:50:38.519 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000b0 74 69 6d 65 73 74 61 6d 70 22 3a 31 36 33 37 34 |timestamp":16374| 2021-11-21T09:50:38.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000c0 36 37 34 30 34 2c 22 72 65 70 6c 61 79 5f 73 74 |67404,"replay_st| 2021-11-21T09:50:38.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000d0 61 74 65 22 3a 22 69 64 6c 65 22 7d 63 16 9a 61 |ate":"idle"}c..a| 2021-11-21T09:50:38.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e0 7a 6b 29 2f 00 |zk)/.| 2021-11-21T09:50:38.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e5 2021-11-21T09:50:38.520 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_2d7d427f-cc00-475d-8855-d03b1f0fa522 2021-11-21T09:50:38.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 df 10 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.521 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 e7 75 5d 00 10 00 |...........u]...| 2021-11-21T09:50:38.522 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.522 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.522 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 52 16 9a 61 |rting replayR..a| 2021-11-21T09:50:38.522 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 ab 66 d8 26 00 |.f.&.| 2021-11-21T09:50:38.522 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.523 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.523 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_42618bf2-8400-47df-b725-a1eb59f07031 2021-11-21T09:50:38.523 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.523 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 ff 11 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 51 da 7f ed 10 00 |..........Q.....| 2021-11-21T09:50:38.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 63 16 9a 61 |rting replayc..a| 2021-11-21T09:50:38.524 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 ff 37 2a 2f 00 |.7*/.| 2021-11-21T09:50:38.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_6f66cc00-d06d-4d0e-a3ba-7a8e14ce9459 2021-11-21T09:50:38.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.525 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 91 12 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 9a 02 4a 99 10 00 |............J...| 2021-11-21T09:50:38.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.526 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 60 16 9a 61 |rting replay`..a| 2021-11-21T09:50:38.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 0a 19 3d 35 00 |..=5.| 2021-11-21T09:50:38.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_7ac970f4-f86d-4f19-b1d6-44ae38498abc 2021-11-21T09:50:38.527 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (229 bytes) : 2021-11-21T09:50:38.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 ff 11 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 51 da 7f ed 10 00 |..........Q.....| 2021-11-21T09:50:38.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 ad 00 00 00 04 9f 00 00 00 72 65 70 |.............rep| 2021-11-21T09:50:38.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 6c 61 79 69 6e 67 2c 20 7b 22 62 79 74 65 73 5f |laying, {"bytes_| 2021-11-21T09:50:38.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 70 65 72 5f 73 65 63 6f 6e 64 22 3a 30 2e 30 2c |per_second":0.0,| 2021-11-21T09:50:38.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 22 62 79 74 65 73 5f 70 65 72 5f 73 6e 61 70 73 |"bytes_per_snaps| 2021-11-21T09:50:38.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000070 68 6f 74 22 3a 30 2e 30 2c 22 6c 6f 63 61 6c 5f |hot":0.0,"local_| 2021-11-21T09:50:38.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000080 73 6e 61 70 73 68 6f 74 5f 74 69 6d 65 73 74 61 |snapshot_timesta| 2021-11-21T09:50:38.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000090 6d 70 22 3a 31 36 33 37 34 36 37 33 32 34 2c 22 |mp":1637467324,"| 2021-11-21T09:50:38.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000a0 72 65 6d 6f 74 65 5f 73 6e 61 70 73 68 6f 74 5f |remote_snapshot_| 2021-11-21T09:50:38.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000b0 74 69 6d 65 73 74 61 6d 70 22 3a 31 36 33 37 34 |timestamp":16374| 2021-11-21T09:50:38.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000c0 36 37 33 32 34 2c 22 72 65 70 6c 61 79 5f 73 74 |67324,"replay_st| 2021-11-21T09:50:38.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000d0 61 74 65 22 3a 22 69 64 6c 65 22 7d 63 16 9a 61 |ate":"idle"}c..a| 2021-11-21T09:50:38.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e0 28 77 2a 2f 00 |(w*/.| 2021-11-21T09:50:38.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e5 2021-11-21T09:50:38.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_89e936a4-e09b-4f45-8def-ed135c2927c8 2021-11-21T09:50:38.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (229 bytes) : 2021-11-21T09:50:38.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 ff 11 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 51 da 7f ed 10 00 |..........Q.....| 2021-11-21T09:50:38.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 ad 00 00 00 04 9f 00 00 00 72 65 70 |.............rep| 2021-11-21T09:50:38.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 6c 61 79 69 6e 67 2c 20 7b 22 62 79 74 65 73 5f |laying, {"bytes_| 2021-11-21T09:50:38.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 70 65 72 5f 73 65 63 6f 6e 64 22 3a 30 2e 30 2c |per_second":0.0,| 2021-11-21T09:50:38.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 22 62 79 74 65 73 5f 70 65 72 5f 73 6e 61 70 73 |"bytes_per_snaps| 2021-11-21T09:50:38.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000070 68 6f 74 22 3a 30 2e 30 2c 22 6c 6f 63 61 6c 5f |hot":0.0,"local_| 2021-11-21T09:50:38.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000080 73 6e 61 70 73 68 6f 74 5f 74 69 6d 65 73 74 61 |snapshot_timesta| 2021-11-21T09:50:38.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000090 6d 70 22 3a 31 36 33 37 34 36 37 34 33 37 2c 22 |mp":1637467437,"| 2021-11-21T09:50:38.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000a0 72 65 6d 6f 74 65 5f 73 6e 61 70 73 68 6f 74 5f |remote_snapshot_| 2021-11-21T09:50:38.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000b0 74 69 6d 65 73 74 61 6d 70 22 3a 31 36 33 37 34 |timestamp":16374| 2021-11-21T09:50:38.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000c0 36 37 34 33 37 2c 22 72 65 70 6c 61 79 5f 73 74 |67437,"replay_st| 2021-11-21T09:50:38.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000d0 61 74 65 22 3a 22 69 64 6c 65 22 7d 63 16 9a 61 |ate":"idle"}c..a| 2021-11-21T09:50:38.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e0 f1 b2 2a 2f 00 |..*/.| 2021-11-21T09:50:38.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e5 2021-11-21T09:50:38.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_8a5bd1f3-8041-4bae-9906-cb85875aeb2a 2021-11-21T09:50:38.535 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (85 bytes) : 2021-11-21T09:50:38.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 df 10 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 e7 75 5d 00 10 00 |...........u]...| 2021-11-21T09:50:38.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 1d 00 00 00 03 0f 00 00 00 73 74 61 |.............sta| 2021-11-21T09:50:38.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 72 74 69 6e 67 20 72 65 70 6c 61 79 52 16 9a 61 |rting replayR..a| 2021-11-21T09:50:38.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 4e ea d8 26 00 |N..&.| 2021-11-21T09:50:38.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000055 2021-11-21T09:50:38.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_91a3408b-8ea3-490d-9a45-f350e49e992d 2021-11-21T09:50:38.537 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (229 bytes) : 2021-11-21T09:50:38.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 df 10 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 e7 75 5d 00 10 00 |...........u]...| 2021-11-21T09:50:38.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.538 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 ad 00 00 00 04 9f 00 00 00 72 65 70 |.............rep| 2021-11-21T09:50:38.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 6c 61 79 69 6e 67 2c 20 7b 22 62 79 74 65 73 5f |laying, {"bytes_| 2021-11-21T09:50:38.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 70 65 72 5f 73 65 63 6f 6e 64 22 3a 30 2e 30 2c |per_second":0.0,| 2021-11-21T09:50:38.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 22 62 79 74 65 73 5f 70 65 72 5f 73 6e 61 70 73 |"bytes_per_snaps| 2021-11-21T09:50:38.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000070 68 6f 74 22 3a 30 2e 30 2c 22 6c 6f 63 61 6c 5f |hot":0.0,"local_| 2021-11-21T09:50:38.539 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000080 73 6e 61 70 73 68 6f 74 5f 74 69 6d 65 73 74 61 |snapshot_timesta| 2021-11-21T09:50:38.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000090 6d 70 22 3a 31 36 33 37 34 36 37 33 37 36 2c 22 |mp":1637467376,"| 2021-11-21T09:50:38.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000a0 72 65 6d 6f 74 65 5f 73 6e 61 70 73 68 6f 74 5f |remote_snapshot_| 2021-11-21T09:50:38.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000b0 74 69 6d 65 73 74 61 6d 70 22 3a 31 36 33 37 34 |timestamp":16374| 2021-11-21T09:50:38.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000c0 36 37 33 37 36 2c 22 72 65 70 6c 61 79 5f 73 74 |67376,"replay_st| 2021-11-21T09:50:38.540 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000d0 61 74 65 22 3a 22 69 64 6c 65 22 7d 52 16 9a 61 |ate":"idle"}R..a| 2021-11-21T09:50:38.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e0 ea 66 d9 26 00 |.f.&.| 2021-11-21T09:50:38.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e5 2021-11-21T09:50:38.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.541 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_a1f86261-eb99-4961-b238-70a123bab03c 2021-11-21T09:50:38.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (229 bytes) : 2021-11-21T09:50:38.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 91 12 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 9a 02 4a 99 10 00 |............J...| 2021-11-21T09:50:38.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.542 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 ad 00 00 00 04 9f 00 00 00 72 65 70 |.............rep| 2021-11-21T09:50:38.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 6c 61 79 69 6e 67 2c 20 7b 22 62 79 74 65 73 5f |laying, {"bytes_| 2021-11-21T09:50:38.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 70 65 72 5f 73 65 63 6f 6e 64 22 3a 30 2e 30 2c |per_second":0.0,| 2021-11-21T09:50:38.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 22 62 79 74 65 73 5f 70 65 72 5f 73 6e 61 70 73 |"bytes_per_snaps| 2021-11-21T09:50:38.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000070 68 6f 74 22 3a 30 2e 30 2c 22 6c 6f 63 61 6c 5f |hot":0.0,"local_| 2021-11-21T09:50:38.543 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000080 73 6e 61 70 73 68 6f 74 5f 74 69 6d 65 73 74 61 |snapshot_timesta| 2021-11-21T09:50:38.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000090 6d 70 22 3a 31 36 33 37 34 36 37 33 34 37 2c 22 |mp":1637467347,"| 2021-11-21T09:50:38.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000a0 72 65 6d 6f 74 65 5f 73 6e 61 70 73 68 6f 74 5f |remote_snapshot_| 2021-11-21T09:50:38.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000b0 74 69 6d 65 73 74 61 6d 70 22 3a 31 36 33 37 34 |timestamp":16374| 2021-11-21T09:50:38.544 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000c0 36 37 33 34 37 2c 22 72 65 70 6c 61 79 5f 73 74 |67347,"replay_st| 2021-11-21T09:50:38.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000d0 61 74 65 22 3a 22 69 64 6c 65 22 7d 60 16 9a 61 |ate":"idle"}`..a| 2021-11-21T09:50:38.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e0 49 5a 3d 35 00 |IZ=5.| 2021-11-21T09:50:38.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e5 2021-11-21T09:50:38.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_ae33bebc-39f4-48a5-879d-767006d29885 2021-11-21T09:50:38.545 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (96 bytes) : 2021-11-21T09:50:38.546 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 df 10 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.546 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 e7 75 5d 00 10 00 |...........u]...| 2021-11-21T09:50:38.546 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.546 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 28 00 00 00 01 1a 00 00 00 65 72 72 |....(........err| 2021-11-21T09:50:38.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 6f 72 20 62 6f 6f 74 73 74 72 61 70 70 69 6e 67 |or bootstrapping| 2021-11-21T09:50:38.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 20 72 65 70 6c 61 79 c2 c4 99 61 d6 67 c2 21 00 | replay...a.g.!.| 2021-11-21T09:50:38.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 2021-11-21T09:50:38.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.547 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_be46e825-58f6-4e65-b6d2-fc0be6e64f4e 2021-11-21T09:50:38.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (229 bytes) : 2021-11-21T09:50:38.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 df 10 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 e7 75 5d 00 10 00 |...........u]...| 2021-11-21T09:50:38.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.548 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 ad 00 00 00 04 9f 00 00 00 72 65 70 |.............rep| 2021-11-21T09:50:38.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 6c 61 79 69 6e 67 2c 20 7b 22 62 79 74 65 73 5f |laying, {"bytes_| 2021-11-21T09:50:38.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 70 65 72 5f 73 65 63 6f 6e 64 22 3a 30 2e 30 2c |per_second":0.0,| 2021-11-21T09:50:38.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 22 62 79 74 65 73 5f 70 65 72 5f 73 6e 61 70 73 |"bytes_per_snaps| 2021-11-21T09:50:38.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000070 68 6f 74 22 3a 30 2e 30 2c 22 6c 6f 63 61 6c 5f |hot":0.0,"local_| 2021-11-21T09:50:38.549 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000080 73 6e 61 70 73 68 6f 74 5f 74 69 6d 65 73 74 61 |snapshot_timesta| 2021-11-21T09:50:38.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000090 6d 70 22 3a 31 36 33 37 34 36 37 33 30 31 2c 22 |mp":1637467301,"| 2021-11-21T09:50:38.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000a0 72 65 6d 6f 74 65 5f 73 6e 61 70 73 68 6f 74 5f |remote_snapshot_| 2021-11-21T09:50:38.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000b0 74 69 6d 65 73 74 61 6d 70 22 3a 31 36 33 37 34 |timestamp":16374| 2021-11-21T09:50:38.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000c0 36 37 33 30 31 2c 22 72 65 70 6c 61 79 5f 73 74 |67301,"replay_st| 2021-11-21T09:50:38.550 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000d0 61 74 65 22 3a 22 69 64 6c 65 22 7d 52 16 9a 61 |ate":"idle"}R..a| 2021-11-21T09:50:38.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e0 51 e8 d9 26 00 |Q..&.| 2021-11-21T09:50:38.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e5 2021-11-21T09:50:38.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_e7ffa431-fb16-42fc-8895-9a08e47d331f 2021-11-21T09:50:38.551 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (229 bytes) : 2021-11-21T09:50:38.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 ff 11 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 51 da 7f ed 10 00 |..........Q.....| 2021-11-21T09:50:38.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 ad 00 00 00 04 9f 00 00 00 72 65 70 |.............rep| 2021-11-21T09:50:38.552 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 6c 61 79 69 6e 67 2c 20 7b 22 62 79 74 65 73 5f |laying, {"bytes_| 2021-11-21T09:50:38.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 70 65 72 5f 73 65 63 6f 6e 64 22 3a 30 2e 30 2c |per_second":0.0,| 2021-11-21T09:50:38.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 22 62 79 74 65 73 5f 70 65 72 5f 73 6e 61 70 73 |"bytes_per_snaps| 2021-11-21T09:50:38.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000070 68 6f 74 22 3a 30 2e 30 2c 22 6c 6f 63 61 6c 5f |hot":0.0,"local_| 2021-11-21T09:50:38.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000080 73 6e 61 70 73 68 6f 74 5f 74 69 6d 65 73 74 61 |snapshot_timesta| 2021-11-21T09:50:38.553 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000090 6d 70 22 3a 31 36 33 37 34 36 37 33 36 37 2c 22 |mp":1637467367,"| 2021-11-21T09:50:38.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000a0 72 65 6d 6f 74 65 5f 73 6e 61 70 73 68 6f 74 5f |remote_snapshot_| 2021-11-21T09:50:38.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000b0 74 69 6d 65 73 74 61 6d 70 22 3a 31 36 33 37 34 |timestamp":16374| 2021-11-21T09:50:38.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000c0 36 37 33 36 37 2c 22 72 65 70 6c 61 79 5f 73 74 |67367,"replay_st| 2021-11-21T09:50:38.554 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000d0 61 74 65 22 3a 22 69 64 6c 65 22 7d 63 16 9a 61 |ate":"idle"}c..a| 2021-11-21T09:50:38.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e0 e6 ef 2a 2f 00 |..*/.| 2021-11-21T09:50:38.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e5 2021-11-21T09:50:38.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:status_global_f2d5f182-4b10-42f9-b5d2-151e9528777e 2021-11-21T09:50:38.555 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (254 bytes) : 2021-11-21T09:50:38.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 01 2c 00 00 00 08 91 12 00 00 00 00 00 00 01 |..,.............| 2021-11-21T09:50:38.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 01 01 1c 00 00 00 03 00 00 00 9a 02 4a 99 10 00 |............J...| 2021-11-21T09:50:38.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 00 00 02 00 00 00 ac 15 02 8f 00 00 00 00 00 00 |................| 2021-11-21T09:50:38.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 01 01 c6 00 00 00 04 b8 00 00 00 72 65 70 |.............rep| 2021-11-21T09:50:38.556 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 6c 61 79 69 6e 67 2c 20 7b 22 62 79 74 65 73 5f |laying, {"bytes_| 2021-11-21T09:50:38.557 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 70 65 72 5f 73 65 63 6f 6e 64 22 3a 30 2e 30 2c |per_second":0.0,| 2021-11-21T09:50:38.557 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 22 62 79 74 65 73 5f 70 65 72 5f 73 6e 61 70 73 |"bytes_per_snaps| 2021-11-21T09:50:38.557 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000070 68 6f 74 22 3a 30 2e 30 2c 22 72 65 6d 6f 74 65 |hot":0.0,"remote| 2021-11-21T09:50:38.557 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000080 5f 73 6e 61 70 73 68 6f 74 5f 74 69 6d 65 73 74 |_snapshot_timest| 2021-11-21T09:50:38.557 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000090 61 6d 70 22 3a 31 36 33 37 34 36 37 34 35 30 2c |amp":1637467450,| 2021-11-21T09:50:38.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000a0 22 72 65 70 6c 61 79 5f 73 74 61 74 65 22 3a 22 |"replay_state":"| 2021-11-21T09:50:38.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000b0 73 79 6e 63 69 6e 67 22 2c 22 73 79 6e 63 69 6e |syncing","syncin| 2021-11-21T09:50:38.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000c0 67 5f 70 65 72 63 65 6e 74 22 3a 30 2c 22 73 79 |g_percent":0,"sy| 2021-11-21T09:50:38.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000d0 6e 63 69 6e 67 5f 73 6e 61 70 73 68 6f 74 5f 74 |ncing_snapshot_t| 2021-11-21T09:50:38.558 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000e0 69 6d 65 73 74 61 6d 70 22 3a 31 36 33 37 34 36 |imestamp":163746| 2021-11-21T09:50:38.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000f0 37 34 35 30 7d 60 16 9a 61 f2 9d 3d 35 00 |7450}`..a..=5.| 2021-11-21T09:50:38.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:000000fe 2021-11-21T09:50:38.559 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.560 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image_ns in "" "${NS1}" "${NS2}" 2021-11-21T09:50:38.561 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror ns1 images 2021-11-21T09:50:38.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror ns1 images' 2021-11-21T09:50:38.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace ns1 ls -l 2021-11-21T09:50:38.562 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirrorns1 mirror pool info 2021-11-21T09:50:38.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirrorns1 mirror pool info' 2021-11-21T09:50:38.563 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace ns1 mirror pool info 2021-11-21T09:50:38.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mode: image 2021-11-21T09:50:38.564 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.565 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirrorns1 mirror pool status 2021-11-21T09:50:38.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirrorns1 mirror pool status' 2021-11-21T09:50:38.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ARGS= 2021-11-21T09:50:38.566 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace ns1 mirror pool status --verbose 2021-11-21T09:50:38.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:health: OK 2021-11-21T09:50:38.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:daemon health: OK 2021-11-21T09:50:38.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image health: OK 2021-11-21T09:50:38.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:images: 0 total 2021-11-21T09:50:38.567 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:DAEMONS 2021-11-21T09:50:38.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:service 4316: 2021-11-21T09:50:38.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: instance_id: 4319 2021-11-21T09:50:38.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: client_id: mirror.1 2021-11-21T09:50:38.568 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: hostname: gibba043 2021-11-21T09:50:38.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: version: 15.2.15-32-gb0aaed0f 2021-11-21T09:50:38.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: leader: true 2021-11-21T09:50:38.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: OK 2021-11-21T09:50:38.569 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:service 4604: 2021-11-21T09:50:38.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: instance_id: 4607 2021-11-21T09:50:38.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: client_id: mirror.3 2021-11-21T09:50:38.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: hostname: gibba043 2021-11-21T09:50:38.570 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: version: 15.2.15-32-gb0aaed0f 2021-11-21T09:50:38.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: leader: false 2021-11-21T09:50:38.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: OK 2021-11-21T09:50:38.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:service 4750: 2021-11-21T09:50:38.571 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: instance_id: 4753 2021-11-21T09:50:38.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: client_id: mirror.2 2021-11-21T09:50:38.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: hostname: gibba043 2021-11-21T09:50:38.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: version: 15.2.15-32-gb0aaed0f 2021-11-21T09:50:38.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: leader: false 2021-11-21T09:50:38.572 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: OK 2021-11-21T09:50:38.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.573 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:IMAGES 2021-11-21T09:50:38.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ rbd --cluster cluster1 -p mirror --namespace ns1 ls 2021-11-21T09:50:38.574 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror ns1 rbd_mirroring omap vals 2021-11-21T09:50:38.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror ns1 rbd_mirroring omap vals' 2021-11-21T09:50:38.575 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rados --cluster cluster1 -p mirror --namespace ns1 listomapvals rbd_mirroring 2021-11-21T09:50:38.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:mirror_mode 2021-11-21T09:50:38.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (4 bytes) : 2021-11-21T09:50:38.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 00 00 00 |....| 2021-11-21T09:50:38.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000004 2021-11-21T09:50:38.576 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:mirror_uuid 2021-11-21T09:50:38.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (36 bytes) : 2021-11-21T09:50:38.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 34 63 63 37 37 31 38 61 2d 33 39 65 30 2d 34 32 |4cc7718a-39e0-42| 2021-11-21T09:50:38.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 33 34 2d 38 38 33 65 2d 64 38 64 33 31 39 62 32 |34-883e-d8d319b2| 2021-11-21T09:50:38.577 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 62 31 65 32 |b1e2| 2021-11-21T09:50:38.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000024 2021-11-21T09:50:38.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.578 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image_ns in "" "${NS1}" "${NS2}" 2021-11-21T09:50:38.579 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror ns2 images' 2021-11-21T09:50:38.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror ns2 images 2021-11-21T09:50:38.580 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace ns2 ls -l 2021-11-21T09:50:38.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirrorns2 mirror pool info 2021-11-21T09:50:38.581 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirrorns2 mirror pool info' 2021-11-21T09:50:38.582 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace ns2 mirror pool info 2021-11-21T09:50:38.584 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mode: image 2021-11-21T09:50:38.585 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirrorns2 mirror pool status 2021-11-21T09:50:38.586 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirrorns2 mirror pool status' 2021-11-21T09:50:38.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ARGS= 2021-11-21T09:50:38.587 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror --namespace ns2 mirror pool status --verbose 2021-11-21T09:50:38.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:health: OK 2021-11-21T09:50:38.607 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:daemon health: OK 2021-11-21T09:50:38.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image health: OK 2021-11-21T09:50:38.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:images: 0 total 2021-11-21T09:50:38.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.608 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:DAEMONS 2021-11-21T09:50:38.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:service 4316: 2021-11-21T09:50:38.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: instance_id: 4319 2021-11-21T09:50:38.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: client_id: mirror.1 2021-11-21T09:50:38.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: hostname: gibba043 2021-11-21T09:50:38.609 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: version: 15.2.15-32-gb0aaed0f 2021-11-21T09:50:38.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: leader: true 2021-11-21T09:50:38.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: OK 2021-11-21T09:50:38.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:service 4604: 2021-11-21T09:50:38.610 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: instance_id: 4607 2021-11-21T09:50:38.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: client_id: mirror.3 2021-11-21T09:50:38.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: hostname: gibba043 2021-11-21T09:50:38.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: version: 15.2.15-32-gb0aaed0f 2021-11-21T09:50:38.611 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: leader: false 2021-11-21T09:50:38.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: OK 2021-11-21T09:50:38.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:service 4750: 2021-11-21T09:50:38.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: instance_id: 4753 2021-11-21T09:50:38.612 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: client_id: mirror.2 2021-11-21T09:50:38.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: hostname: gibba043 2021-11-21T09:50:38.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: version: 15.2.15-32-gb0aaed0f 2021-11-21T09:50:38.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: leader: false 2021-11-21T09:50:38.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: OK 2021-11-21T09:50:38.613 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.614 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:IMAGES 2021-11-21T09:50:38.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.615 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ rbd --cluster cluster1 -p mirror --namespace ns2 ls 2021-11-21T09:50:38.835 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror ns2 rbd_mirroring omap vals 2021-11-21T09:50:38.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror ns2 rbd_mirroring omap vals' 2021-11-21T09:50:38.836 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rados --cluster cluster1 -p mirror --namespace ns2 listomapvals rbd_mirroring 2021-11-21T09:50:38.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:mirror_mode 2021-11-21T09:50:38.857 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (4 bytes) : 2021-11-21T09:50:38.858 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 00 00 00 |....| 2021-11-21T09:50:38.858 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000004 2021-11-21T09:50:38.858 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.858 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:mirror_uuid 2021-11-21T09:50:38.858 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (36 bytes) : 2021-11-21T09:50:38.859 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 33 37 61 62 38 65 34 32 2d 34 64 38 30 2d 34 66 |37ab8e42-4d80-4f| 2021-11-21T09:50:38.859 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 65 31 2d 38 65 66 31 2d 31 33 62 64 36 36 39 38 |e1-8ef1-13bd6698| 2021-11-21T09:50:38.859 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 64 61 62 36 |dab6| 2021-11-21T09:50:38.859 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000024 2021-11-21T09:50:38.859 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.860 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.860 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror_parent images 2021-11-21T09:50:38.861 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.861 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image_pool in ${POOL} ${PARENT_POOL} 2021-11-21T09:50:38.861 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image_ns in "" "${NS1}" "${NS2}" 2021-11-21T09:50:38.861 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror_parent images' 2021-11-21T09:50:38.862 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror_parent --namespace '' ls -l 2021-11-21T09:50:38.880 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror_parent mirror pool info 2021-11-21T09:50:38.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror_parent mirror pool info' 2021-11-21T09:50:38.881 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror_parent --namespace '' mirror pool info 2021-11-21T09:50:38.902 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mode: image 2021-11-21T09:50:38.902 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Site Name: cluster1 2021-11-21T09:50:38.902 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.902 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Peer Sites: 2021-11-21T09:50:38.903 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.903 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:UUID: c6f0d615-2791-47d9-b665-37e6e63dc576 2021-11-21T09:50:38.903 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Name: cluster2 2021-11-21T09:50:38.903 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Mirror UUID: 1423ee1a-7459-433a-bd7d-bc191525f8d4 2021-11-21T09:50:38.903 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Direction: rx-tx 2021-11-21T09:50:38.904 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:Client: client.mirror 2021-11-21T09:50:38.904 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.904 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror_parent mirror pool status 2021-11-21T09:50:38.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror_parent mirror pool status' 2021-11-21T09:50:38.905 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ARGS= 2021-11-21T09:50:38.906 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror_parent --namespace '' mirror pool status --verbose 2021-11-21T09:50:38.926 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:health: OK 2021-11-21T09:50:38.926 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:daemon health: OK 2021-11-21T09:50:38.926 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:image health: OK 2021-11-21T09:50:38.926 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:images: 0 total 2021-11-21T09:50:38.927 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.927 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:DAEMONS 2021-11-21T09:50:38.927 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:service 4316: 2021-11-21T09:50:38.927 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: instance_id: 4321 2021-11-21T09:50:38.927 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: client_id: mirror.1 2021-11-21T09:50:38.928 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: hostname: gibba043 2021-11-21T09:50:38.928 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: version: 15.2.15-32-gb0aaed0f 2021-11-21T09:50:38.928 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: leader: true 2021-11-21T09:50:38.928 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: OK 2021-11-21T09:50:38.928 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.929 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:service 4604: 2021-11-21T09:50:38.929 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: instance_id: 4610 2021-11-21T09:50:38.929 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: client_id: mirror.3 2021-11-21T09:50:38.929 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: hostname: gibba043 2021-11-21T09:50:38.930 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: version: 15.2.15-32-gb0aaed0f 2021-11-21T09:50:38.930 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: leader: false 2021-11-21T09:50:38.930 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: OK 2021-11-21T09:50:38.930 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.930 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:service 4750: 2021-11-21T09:50:38.931 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: instance_id: 4756 2021-11-21T09:50:38.931 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: client_id: mirror.2 2021-11-21T09:50:38.931 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: hostname: gibba043 2021-11-21T09:50:38.931 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: version: 15.2.15-32-gb0aaed0f 2021-11-21T09:50:38.931 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: leader: false 2021-11-21T09:50:38.932 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: OK 2021-11-21T09:50:38.932 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.932 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.933 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:IMAGES 2021-11-21T09:50:38.933 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.933 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ rbd --cluster cluster1 -p mirror_parent --namespace '' ls 2021-11-21T09:50:38.949 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror_parent rbd_mirroring omap vals 2021-11-21T09:50:38.950 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror_parent rbd_mirroring omap vals' 2021-11-21T09:50:38.950 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rados --cluster cluster1 -p mirror_parent --namespace '' listomapvals rbd_mirroring 2021-11-21T09:50:38.970 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:mirror_mode 2021-11-21T09:50:38.971 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (4 bytes) : 2021-11-21T09:50:38.971 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 01 00 00 00 |....| 2021-11-21T09:50:38.971 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000004 2021-11-21T09:50:38.971 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.971 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:mirror_peer_c6f0d615-2791-47d9-b665-37e6e63dc576 2021-11-21T09:50:38.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (132 bytes) : 2021-11-21T09:50:38.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 02 01 7e 00 00 00 24 00 00 00 63 36 66 30 64 36 |..~...$...c6f0d6| 2021-11-21T09:50:38.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 31 35 2d 32 37 39 31 2d 34 37 64 39 2d 62 36 36 |15-2791-47d9-b66| 2021-11-21T09:50:38.972 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 35 2d 33 37 65 36 65 36 33 64 63 35 37 36 08 00 |5-37e6e63dc576..| 2021-11-21T09:50:38.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000030 00 00 63 6c 75 73 74 65 72 32 0d 00 00 00 63 6c |..cluster2....cl| 2021-11-21T09:50:38.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000040 69 65 6e 74 2e 6d 69 72 72 6f 72 ff ff ff ff ff |ient.mirror.....| 2021-11-21T09:50:38.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000050 ff ff ff 02 24 00 00 00 31 34 32 33 65 65 31 61 |....$...1423ee1a| 2021-11-21T09:50:38.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000060 2d 37 34 35 39 2d 34 33 33 61 2d 62 64 37 64 2d |-7459-433a-bd7d-| 2021-11-21T09:50:38.973 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000070 62 63 31 39 31 35 32 35 66 38 64 34 69 16 9a 61 |bc191525f8d4i..a| 2021-11-21T09:50:38.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000080 b4 96 89 23 |...#| 2021-11-21T09:50:38.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000084 2021-11-21T09:50:38.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.974 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:mirror_uuid 2021-11-21T09:50:38.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:value (36 bytes) : 2021-11-21T09:50:38.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000000 62 30 35 32 39 34 65 36 2d 37 63 31 39 2d 34 63 |b05294e6-7c19-4c| 2021-11-21T09:50:38.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000010 33 66 2d 39 31 37 38 2d 30 36 30 30 35 35 64 61 |3f-9178-060055da| 2021-11-21T09:50:38.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000020 37 30 61 30 |70a0| 2021-11-21T09:50:38.975 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:00000024 2021-11-21T09:50:38.976 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.976 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.976 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror_parent ns1 images 2021-11-21T09:50:38.977 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.977 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image_ns in "" "${NS1}" "${NS2}" 2021-11-21T09:50:38.977 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror_parent ns1 images' 2021-11-21T09:50:38.978 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror_parent --namespace ns1 ls -l 2021-11-21T09:50:38.991 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: namespace 'ns1' does not exist. 2021-11-21T09:50:38.991 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: listing images failed: (2) No such file or directory 2021-11-21T09:50:38.993 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:38.993 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror_parentns1 mirror pool info 2021-11-21T09:50:38.993 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:38.994 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror_parentns1 mirror pool info' 2021-11-21T09:50:38.994 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror_parent --namespace ns1 mirror pool info 2021-11-21T09:50:39.012 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: namespace 'ns1' does not exist. 2021-11-21T09:50:39.013 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:39.013 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror_parentns1 mirror pool status 2021-11-21T09:50:39.014 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:39.014 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror_parentns1 mirror pool status' 2021-11-21T09:50:39.014 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ARGS= 2021-11-21T09:50:39.015 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror_parent --namespace ns1 mirror pool status --verbose 2021-11-21T09:50:39.033 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: namespace 'ns1' does not exist. 2021-11-21T09:50:39.034 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:39.035 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:39.035 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ rbd --cluster cluster1 -p mirror_parent --namespace ns1 ls 2021-11-21T09:50:39.055 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror_parent ns1 rbd_mirroring omap vals' 2021-11-21T09:50:39.055 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror_parent ns1 rbd_mirroring omap vals 2021-11-21T09:50:39.056 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rados --cluster cluster1 -p mirror_parent --namespace ns1 listomapvals rbd_mirroring 2021-11-21T09:50:39.075 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:error getting omap keys mirror_parent/rbd_mirroring: (2) No such file or directory 2021-11-21T09:50:39.076 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:39.077 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror_parent ns2 images 2021-11-21T09:50:39.077 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:39.077 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image_ns in "" "${NS1}" "${NS2}" 2021-11-21T09:50:39.077 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror_parent ns2 images' 2021-11-21T09:50:39.078 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror_parent --namespace ns2 ls -l 2021-11-21T09:50:39.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: namespace 'ns2' does not exist. 2021-11-21T09:50:39.095 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: listing images failed: (2) No such file or directory 2021-11-21T09:50:39.096 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:39.097 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:39.097 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror_parentns2 mirror pool info 2021-11-21T09:50:39.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror_parentns2 mirror pool info' 2021-11-21T09:50:39.098 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror_parent --namespace ns2 mirror pool info 2021-11-21T09:50:39.117 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: namespace 'ns2' does not exist. 2021-11-21T09:50:39.119 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:39.119 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:39.119 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror_parentns2 mirror pool status 2021-11-21T09:50:39.120 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror_parentns2 mirror pool status' 2021-11-21T09:50:39.120 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ARGS= 2021-11-21T09:50:39.120 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster1 -p mirror_parent --namespace ns2 mirror pool status --verbose 2021-11-21T09:50:39.137 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:rbd: namespace 'ns2' does not exist. 2021-11-21T09:50:39.138 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:39.139 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:39.139 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:+++ rbd --cluster cluster1 -p mirror_parent --namespace ns2 ls 2021-11-21T09:50:39.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster1 mirror_parent ns2 rbd_mirroring omap vals' 2021-11-21T09:50:39.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster1 mirror_parent ns2 rbd_mirroring omap vals 2021-11-21T09:50:39.159 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rados --cluster cluster1 -p mirror_parent --namespace ns2 listomapvals rbd_mirroring 2021-11-21T09:50:39.178 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:error getting omap keys mirror_parent/rbd_mirroring: (2) No such file or directory 2021-11-21T09:50:39.179 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:39.180 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:39.180 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for cluster in ${CLUSTER1} ${CLUSTER2} 2021-11-21T09:50:39.180 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster2 status 2021-11-21T09:50:39.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster2 status' 2021-11-21T09:50:39.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ARGS= 2021-11-21T09:50:39.181 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --cluster cluster2 -s 2021-11-21T09:50:39.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:39.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:39.528 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: cluster: 2021-11-21T09:50:39.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: id: 3cfc0544-020d-4e5b-8500-d522ef4891d9 2021-11-21T09:50:39.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: health: HEALTH_WARN 2021-11-21T09:50:39.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 1 osds down 2021-11-21T09:50:39.529 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: Reduced data availability: 61 pgs stale 2021-11-21T09:50:39.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: Degraded data redundancy: 590/1180 objects degraded (50.000%), 73 pgs degraded, 137 pgs undersized 2021-11-21T09:50:39.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 256 slow ops, oldest one blocked for 20210 sec, osd.2 has slow ops 2021-11-21T09:50:39.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:39.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: services: 2021-11-21T09:50:39.530 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mon: 1 daemons, quorum a (age 6h) 2021-11-21T09:50:39.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: mgr: x(active, since 6h) 2021-11-21T09:50:39.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: osd: 3 osds: 1 up (since 5h), 2 in (since 5h) 2021-11-21T09:50:39.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: rbd-mirror: 3 daemons active (4313, 4392, 4571) 2021-11-21T09:50:39.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:39.531 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: task status: 2021-11-21T09:50:39.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:39.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: data: 2021-11-21T09:50:39.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: pools: 4 pools, 137 pgs 2021-11-21T09:50:39.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: objects: 590 objects, 1.9 GiB 2021-11-21T09:50:39.532 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: usage: 4.3 GiB used, 176 GiB / 180 GiB avail 2021-11-21T09:50:39.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: pgs: 590/1180 objects degraded (50.000%) 2021-11-21T09:50:39.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 44 active+undersized+degraded 2021-11-21T09:50:39.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 32 active+undersized 2021-11-21T09:50:39.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 32 stale+active+undersized 2021-11-21T09:50:39.533 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 29 stale+active+undersized+degraded 2021-11-21T09:50:39.534 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:39.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ARGS= 2021-11-21T09:50:39.536 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --cluster cluster2 service dump 2021-11-21T09:50:39.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:50:39.742+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:50:39.765 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:{ 2021-11-21T09:50:39.765 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "epoch": 81, 2021-11-21T09:50:39.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "modified": "2021-11-21T09:41:37.447867+0000", 2021-11-21T09:50:39.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "services": { 2021-11-21T09:50:39.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "rbd-mirror": { 2021-11-21T09:50:39.766 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "daemons": { 2021-11-21T09:50:39.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "summary": "", 2021-11-21T09:50:39.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "4313": { 2021-11-21T09:50:39.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "start_epoch": 6, 2021-11-21T09:50:39.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "start_stamp": "2021-11-21T03:51:30.542424+0000", 2021-11-21T09:50:39.767 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "gid": 4313, 2021-11-21T09:50:39.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "addr": "172.21.2.143:0/841689737", 2021-11-21T09:50:39.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "metadata": { 2021-11-21T09:50:39.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "arch": "x86_64", 2021-11-21T09:50:39.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_release": "octopus", 2021-11-21T09:50:39.768 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-21T09:50:39.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_version_short": "15.2.15-32-gb0aaed0f", 2021-11-21T09:50:39.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "cpu": "Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz", 2021-11-21T09:50:39.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro": "rhel", 2021-11-21T09:50:39.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro_description": "Red Hat Enterprise Linux 8.3 (Ootpa)", 2021-11-21T09:50:39.769 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro_version": "8.3", 2021-11-21T09:50:39.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "hostname": "gibba043", 2021-11-21T09:50:39.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "id": "mirror.3", 2021-11-21T09:50:39.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "instance_id": "4313", 2021-11-21T09:50:39.770 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "kernel_description": "#1 SMP Mon Jul 26 08:06:24 EDT 2021", 2021-11-21T09:50:39.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "kernel_version": "4.18.0-305.12.1.el8_4.x86_64", 2021-11-21T09:50:39.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "mem_swap_kb": "0", 2021-11-21T09:50:39.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "mem_total_kb": "32622744", 2021-11-21T09:50:39.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "os": "Linux" 2021-11-21T09:50:39.771 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:39.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "task_status": {} 2021-11-21T09:50:39.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:39.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "4392": { 2021-11-21T09:50:39.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "start_epoch": 8, 2021-11-21T09:50:39.772 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "start_stamp": "2021-11-21T03:54:12.550796+0000", 2021-11-21T09:50:39.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "gid": 4392, 2021-11-21T09:50:39.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "addr": "172.21.2.143:0/2270181368", 2021-11-21T09:50:39.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "metadata": { 2021-11-21T09:50:39.773 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "arch": "x86_64", 2021-11-21T09:50:39.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_release": "octopus", 2021-11-21T09:50:39.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-21T09:50:39.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_version_short": "15.2.15-32-gb0aaed0f", 2021-11-21T09:50:39.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "cpu": "Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz", 2021-11-21T09:50:39.774 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro": "rhel", 2021-11-21T09:50:39.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro_description": "Red Hat Enterprise Linux 8.3 (Ootpa)", 2021-11-21T09:50:39.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro_version": "8.3", 2021-11-21T09:50:39.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "hostname": "gibba043", 2021-11-21T09:50:39.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "id": "mirror.2", 2021-11-21T09:50:39.775 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "instance_id": "4392", 2021-11-21T09:50:39.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "kernel_description": "#1 SMP Mon Jul 26 08:06:24 EDT 2021", 2021-11-21T09:50:39.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "kernel_version": "4.18.0-305.12.1.el8_4.x86_64", 2021-11-21T09:50:39.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "mem_swap_kb": "0", 2021-11-21T09:50:39.776 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "mem_total_kb": "32622744", 2021-11-21T09:50:39.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "os": "Linux" 2021-11-21T09:50:39.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:39.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "task_status": {} 2021-11-21T09:50:39.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:39.777 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "4571": { 2021-11-21T09:50:39.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "start_epoch": 16, 2021-11-21T09:50:39.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "start_stamp": "2021-11-21T04:00:23.573687+0000", 2021-11-21T09:50:39.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "gid": 4571, 2021-11-21T09:50:39.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "addr": "172.21.2.143:0/734953610", 2021-11-21T09:50:39.778 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "metadata": { 2021-11-21T09:50:39.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "arch": "x86_64", 2021-11-21T09:50:39.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_release": "octopus", 2021-11-21T09:50:39.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_version": "ceph version 15.2.15-32-gb0aaed0f (b0aaed0fe8cdfe99c82a70b230004934b51091ff) octopus (stable)", 2021-11-21T09:50:39.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "ceph_version_short": "15.2.15-32-gb0aaed0f", 2021-11-21T09:50:39.779 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "cpu": "Intel(R) Xeon(R) E-2278G CPU @ 3.40GHz", 2021-11-21T09:50:39.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro": "rhel", 2021-11-21T09:50:39.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro_description": "Red Hat Enterprise Linux 8.3 (Ootpa)", 2021-11-21T09:50:39.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "distro_version": "8.3", 2021-11-21T09:50:39.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "hostname": "gibba043", 2021-11-21T09:50:39.780 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "id": "mirror.1", 2021-11-21T09:50:39.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "instance_id": "4571", 2021-11-21T09:50:39.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "kernel_description": "#1 SMP Mon Jul 26 08:06:24 EDT 2021", 2021-11-21T09:50:39.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "kernel_version": "4.18.0-305.12.1.el8_4.x86_64", 2021-11-21T09:50:39.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "mem_swap_kb": "0", 2021-11-21T09:50:39.781 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "mem_total_kb": "32622744", 2021-11-21T09:50:39.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "os": "Linux" 2021-11-21T09:50:39.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:39.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "task_status": {} 2021-11-21T09:50:39.782 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:39.783 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:39.783 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:39.783 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:39.783 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:} 2021-11-21T09:50:39.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ CEPH_ARGS= 2021-11-21T09:50:39.784 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ ceph --cluster cluster2 service status 2021-11-21T09:50:40.004 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:{ 2021-11-21T09:50:40.004 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "rbd-mirror": { 2021-11-21T09:50:40.005 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "4313": { 2021-11-21T09:50:40.005 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "status_stamp": "2021-11-21T09:50:35.916236+0000", 2021-11-21T09:50:40.005 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "last_beacon": "2021-11-21T09:50:35.916236+0000", 2021-11-21T09:50:40.005 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "status": { 2021-11-21T09:50:40.005 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "json": "{\"3\":{\"name\":\"mirror\",\"callouts\":{},\"image_assigned_count\":3,\"image_error_count\":0,\"image_local_count\":15,\"image_remote_count\":16,\"image_warning_count\":0,\"instance_id\":\"4316\",\"leader\":true,\"namespaces\":{\"ns1\":{\"image_assigned_count\":0,\"image_error_count\":0,\"image_local_count\":0,\"image_remote_count\":0,\"image_warning_count\":0},\"ns2\":{\"image_assigned_count\":0,\"image_error_count\":0,\"image_local_count\":0,\"image_remote_count\":0,\"image_warning_count\":0}}},\"4\":{\"name\":\"mirror_parent\",\"callouts\":{},\"image_assigned_count\":0,\"image_error_count\":0,\"image_warning_count\":0,\"instance_id\":\"4318\"}}" 2021-11-21T09:50:40.006 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:40.006 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:40.006 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "4392": { 2021-11-21T09:50:40.006 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "status_stamp": "2021-11-21T09:50:18.348783+0000", 2021-11-21T09:50:40.007 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "last_beacon": "2021-11-21T09:50:38.349556+0000", 2021-11-21T09:50:40.007 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "status": { 2021-11-21T09:50:40.007 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "json": "{\"3\":{\"name\":\"mirror\",\"callouts\":{},\"image_assigned_count\":4,\"image_error_count\":0,\"image_warning_count\":0,\"instance_id\":\"4395\",\"namespaces\":{\"ns1\":{\"image_assigned_count\":0,\"image_error_count\":0,\"image_warning_count\":0},\"ns2\":{\"image_assigned_count\":0,\"image_error_count\":0,\"image_warning_count\":0}}},\"4\":{\"name\":\"mirror_parent\",\"callouts\":{},\"image_assigned_count\":0,\"image_error_count\":0,\"image_local_count\":0,\"image_remote_count\":0,\"image_warning_count\":0,\"instance_id\":\"4398\",\"leader\":true}}" 2021-11-21T09:50:40.007 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:40.007 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: }, 2021-11-21T09:50:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "4571": { 2021-11-21T09:50:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "status_stamp": "2021-11-21T09:50:28.766785+0000", 2021-11-21T09:50:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "last_beacon": "2021-11-21T09:50:38.766877+0000", 2021-11-21T09:50:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "status": { 2021-11-21T09:50:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: "json": "{\"3\":{\"name\":\"mirror\",\"callouts\":{},\"image_assigned_count\":4,\"image_error_count\":0,\"image_warning_count\":0,\"instance_id\":\"4574\",\"namespaces\":{\"ns1\":{\"image_assigned_count\":0,\"image_error_count\":0,\"image_warning_count\":0},\"ns2\":{\"image_assigned_count\":0,\"image_error_count\":0,\"image_warning_count\":0}}},\"4\":{\"name\":\"mirror_parent\",\"callouts\":{},\"image_assigned_count\":0,\"image_error_count\":0,\"image_warning_count\":0,\"instance_id\":\"4577\"}}" 2021-11-21T09:50:40.009 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:40.009 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:40.009 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: } 2021-11-21T09:50:40.009 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:} 2021-11-21T09:50:40.011 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout: 2021-11-21T09:50:40.012 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stdout:cluster2 mirror images 2021-11-21T09:50:40.012 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 2021-11-21T09:50:40.012 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image_pool in ${POOL} ${PARENT_POOL} 2021-11-21T09:50:40.013 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ for image_ns in "" "${NS1}" "${NS2}" 2021-11-21T09:50:40.013 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ echo 'cluster2 mirror images' 2021-11-21T09:50:40.013 INFO:tasks.workunit.cluster1.client.mirror.gibba043.stderr:++ rbd --cluster cluster2 -p mirror --namespace '' ls -l 2021-11-21T09:50:40.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:40.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:41.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:41.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:42.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:42.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:43.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:43.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:44.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:44.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:44.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:50:44.742+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:50:45.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:45.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:46.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:46.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:47.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:47.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:48.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:48.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:49.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:49.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:49.743 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:50:49.743+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:50:50.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:50.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:51.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:51.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:52.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:52.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:53.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:53.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:54.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:54.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:54.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:50:54.744+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:50:55.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:55.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:56.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:56.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:57.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:57.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:58.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:58.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:59.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:50:59.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:50:59.746 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:50:59.745+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:51:00.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:00.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:01.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:01.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:02.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:02.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:03.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:03.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:04.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:04.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:04.747 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:51:04.746+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:51:05.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:05.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:06.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:06.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:07.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:07.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:08.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:08.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:09.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:09.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:09.748 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:51:09.747+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:51:10.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:10.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:11.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:11.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:12.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:12.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:13.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:13.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:14.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:14.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:14.749 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:51:14.748+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:51:15.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:15.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:16.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:16.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:17.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:17.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:18.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:18.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:19.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:19.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:19.750 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:51:19.749+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:51:20.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:20.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:21.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:21.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:22.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:22.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:23.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:23.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:24.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:24.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:24.751 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:51:24.750+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:51:25.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:25.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:26.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:26.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:27.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:27.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:28.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:28.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:29.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:29.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:29.752 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:51:29.751+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:51:30.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:30.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:31.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:31.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:32.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:32.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:33.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:33.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:34.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:34.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:34.752 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:51:34.752+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:51:35.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:35.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:36.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:36.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:37.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:37.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:38.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:38.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:39.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:39.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:39.753 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:51:39.753+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:51:40.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:40.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:41.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:41.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:42.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:42.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:43.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:43.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:44.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:44.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:44.754 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:51:44.754+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:51:45.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:45.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:46.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:46.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:47.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:47.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:48.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:48.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:49.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:49.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:49.755 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:51:49.755+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:51:50.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:50.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:51.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:51.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:52.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:52.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:53.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:53.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:54.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:54.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:54.756 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:51:54.756+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:51:55.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:55.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:56.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:56.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:57.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:57.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:58.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:58.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:59.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:51:59.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:51:59.757 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:51:59.757+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:52:00.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:00.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:01.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:01.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:02.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:02.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:03.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:03.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:04.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:04.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:04.759 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:52:04.758+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:52:05.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:05.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:06.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:06.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:07.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:07.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:08.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:08.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:09.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:09.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:09.760 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:52:09.759+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:52:10.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:10.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:11.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:11.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:12.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:12.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:13.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:13.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:14.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:14.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:14.761 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:52:14.761+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:52:15.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:15.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:16.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:16.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:17.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:17.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:18.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:18.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:19.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:19.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:19.762 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:52:19.761+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:52:20.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:20.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:21.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:21.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:22.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:22.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:23.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:23.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:24.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:24.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:24.763 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:52:24.763+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:52:25.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:25.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:26.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:26.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:27.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:27.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:28.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:28.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:29.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:29.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:29.763 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:52:29.763+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:52:30.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:30.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:31.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:31.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:32.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:32.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:33.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:33.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:34.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:34.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:34.765 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:52:34.764+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:52:35.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:35.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:36.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:36.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:37.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:37.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:38.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:38.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:39.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:39.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:39.765 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:52:39.765+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:52:40.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:40.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:41.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:41.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:42.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:42.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:43.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:43.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:44.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:44.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:44.766 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:52:44.766+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:52:45.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:45.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:46.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:46.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:47.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:47.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:48.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:48.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:49.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:49.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:49.767 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:52:49.767+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:52:50.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:50.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:51.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:51.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:52.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:52.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:53.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:53.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:54.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:54.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:54.767 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:52:54.768+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:52:55.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:55.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:56.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:56.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:57.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:57.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:58.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:58.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:59.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:52:59.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:52:59.768 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:52:59.769+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:53:00.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:00.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:01.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:01.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:02.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:02.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:03.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:03.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:04.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:04.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:04.769 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:53:04.769+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:53:05.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:05.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:06.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:06.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:07.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:07.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:08.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:08.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:09.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:09.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:09.771 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:53:09.770+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:53:10.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:10.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:11.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:11.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:12.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:12.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:13.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:13.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:14.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:14.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:14.772 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:53:14.771+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:53:15.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:15.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:16.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:16.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:17.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:17.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:18.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:18.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:19.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:19.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:19.773 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:53:19.772+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:53:20.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:20.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:21.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:21.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:22.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:22.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:23.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:23.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:24.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:24.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:24.774 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:53:24.773+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:53:25.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:25.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:26.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:26.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:27.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:27.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:28.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:28.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:29.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:29.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:29.775 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:53:29.774+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:53:30.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:30.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:31.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:31.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:32.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:32.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:33.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:33.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:34.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:34.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:34.776 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:53:34.775+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:53:35.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:35.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:36.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:36.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:37.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:37.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:38.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:38.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:39.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:39.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:39.777 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:53:39.776+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:53:40.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:40.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:41.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:41.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:42.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:42.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:43.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:43.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:44.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:44.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:44.778 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:53:44.778+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:53:45.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:45.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:46.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:46.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:47.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:47.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:48.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:48.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:49.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:49.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:49.779 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:53:49.778+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:53:50.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:50.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:51.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:51.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:52.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:52.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:53.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:53.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:54.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:54.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:54.780 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:53:54.779+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:53:55.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:55.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:56.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:56.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:57.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:57.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:58.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:58.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:59.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:53:59.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:53:59.780 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:53:59.780+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:54:00.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:00.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:01.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:01.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:02.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:02.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:03.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:03.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:04.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:04.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:04.782 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:54:04.781+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:54:05.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:05.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:06.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:06.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:07.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:07.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:08.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:08.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:09.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:09.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:09.782 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:54:09.782+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:54:10.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:10.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:11.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:11.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:12.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:12.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:13.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:13.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:14.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:14.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:14.784 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:54:14.783+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:54:15.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:15.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:16.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:16.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:17.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:17.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:18.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:18.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:19.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:19.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:19.784 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:54:19.784+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:54:20.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:20.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:21.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:21.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:22.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:22.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:23.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:23.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:24.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:24.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:24.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:54:24.786+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:54:25.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:25.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:26.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:26.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:27.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:27.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:28.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:28.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:29.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:29.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:29.787 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:54:29.786+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:54:30.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:30.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:31.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:31.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:32.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:32.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:33.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:33.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:34.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:34.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:34.788 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:54:34.787+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:54:35.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:35.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:36.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:36.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:37.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:37.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:38.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:38.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:39.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:39.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:39.788 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:54:39.788+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:54:40.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:40.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:41.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:41.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:42.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:42.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:43.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:43.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:44.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:44.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:44.790 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:54:44.789+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:54:45.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:45.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:46.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:46.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:47.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:47.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:48.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:48.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:49.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:49.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:49.790 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:54:49.790+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:54:50.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:50.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:51.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:51.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:52.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:52.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:53.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:53.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:54.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:54.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:54.792 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:54:54.791+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:54:55.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:55.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:56.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:56.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:57.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:57.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:58.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:58.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:59.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:54:59.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:54:59.793 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:54:59.792+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:55:00.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:00.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:01.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:01.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:02.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:02.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:03.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:03.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:04.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:04.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:04.793 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:55:04.793+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:55:05.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:05.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:06.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:06.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:07.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:07.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:08.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:08.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:09.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:09.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:09.795 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:55:09.795+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:55:10.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:10.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:11.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:11.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:12.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:12.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:13.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:13.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:14.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:14.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:14.795 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:55:14.795+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:55:15.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:15.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:16.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:16.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:17.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:17.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:18.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:18.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:19.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:19.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:19.796 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:55:19.796+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:55:20.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:20.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:21.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:21.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:22.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:22.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:23.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:23.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:24.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:24.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:24.798 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:55:24.797+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:55:25.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:25.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:26.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:26.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:27.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:27.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:28.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:28.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:29.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:29.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:29.799 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:55:29.798+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:55:30.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:30.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:31.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:31.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:32.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:32.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:33.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:33.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:34.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:34.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:34.799 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:55:34.799+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:55:35.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:35.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:36.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:36.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:37.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:37.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:38.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:38.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:39.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:39.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:39.801 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:55:39.800+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:55:40.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:40.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:41.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:41.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:42.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:42.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:43.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:43.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:44.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:44.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:44.802 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:55:44.801+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:55:45.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:45.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:46.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:46.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:47.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:47.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:48.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:48.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:49.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:49.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:49.802 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:55:49.802+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:55:50.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:50.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:51.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:51.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:52.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:52.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:53.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:53.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:54.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:54.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:54.803 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:55:54.804+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:55:55.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:55.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:56.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:56.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:57.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:57.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:58.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:58.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:59.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:55:59.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:55:59.804 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:55:59.805+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:56:00.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:00.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:01.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:01.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:02.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:02.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:03.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:03.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:04.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:04.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:04.805 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:56:04.806+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:56:05.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:05.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:06.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:06.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:07.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:07.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:08.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:08.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:09.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:09.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:09.806 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:56:09.806+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:56:10.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:10.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:11.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:11.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:12.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:12.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:13.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:13.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:14.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:14.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:14.807 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:56:14.806+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:56:15.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:15.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:16.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:16.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:17.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:17.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:18.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:18.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:19.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:19.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:19.808 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:56:19.808+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:56:20.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:20.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:21.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:21.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:22.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:22.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:23.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:23.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:24.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:24.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:24.809 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:56:24.809+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:56:25.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:25.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:26.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:26.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:27.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:27.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:28.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:28.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:29.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:29.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:29.810 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:56:29.810+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:56:30.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:30.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:31.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:31.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:32.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:32.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:33.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:33.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:34.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:34.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:34.811 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:56:34.811+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:56:35.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:35.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:36.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:36.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:37.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:37.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:38.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:38.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:39.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:39.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:39.812 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:56:39.811+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:56:40.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:40.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:41.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:41.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:42.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:42.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:43.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:43.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:44.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:44.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:44.813 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:56:44.812+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:56:45.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:45.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:46.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:46.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:47.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:47.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:48.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:48.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:49.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:49.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:49.813 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:56:49.813+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:56:50.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:50.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:51.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:51.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:52.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:52.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:53.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:53.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:54.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:54.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:54.814 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:56:54.814+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:56:55.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:55.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:56.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:56.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:57.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:57.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:58.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:58.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:59.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:56:59.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:56:59.815 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:56:59.815+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:57:00.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:00.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:01.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:01.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:02.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:02.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:03.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:03.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:04.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:04.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:04.816 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:57:04.816+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:57:05.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:05.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:06.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:06.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:07.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:07.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:08.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:08.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:09.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:09.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:09.817 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:57:09.816+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:57:10.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:10.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:11.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:11.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:12.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:12.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:13.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:13.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:14.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:14.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:14.818 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:57:14.818+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:57:15.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:15.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:16.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:16.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:17.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:17.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:18.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:18.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:19.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:19.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:19.819 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:57:19.819+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:57:20.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:20.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:21.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:21.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:22.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:22.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:23.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:23.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:24.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:24.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:24.820 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:57:24.820+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:57:25.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:25.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:26.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:26.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:27.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:27.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:28.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:28.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:29.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:29.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:29.821 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:57:29.821+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:57:30.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:30.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:31.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:31.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:32.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:32.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:33.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:33.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:34.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:34.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:34.823 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:57:34.822+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:57:35.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:35.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:36.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:36.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:37.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:37.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:38.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:38.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:39.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:39.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:39.824 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:57:39.824+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:57:40.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:40.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:41.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:41.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:42.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:42.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:43.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:43.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:44.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:44.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:44.825 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:57:44.824+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:57:45.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:45.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:46.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:46.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:47.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:47.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:48.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:48.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:49.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:49.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:49.825 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:57:49.825+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:57:50.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:50.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:51.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:51.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:52.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:52.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:53.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:53.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:54.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:54.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:54.827 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:57:54.827+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:57:55.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:55.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:56.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:56.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:57.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:57.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:58.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:58.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:59.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:57:59.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:57:59.828 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:57:59.827+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:58:00.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:00.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:01.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:01.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:02.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:02.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:03.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:03.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:04.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:04.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:04.829 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:58:04.828+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:58:05.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:05.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:06.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:06.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:07.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:07.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:08.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:08.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:09.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:09.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:09.830 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:58:09.830+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:58:10.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:10.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:11.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:11.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:12.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:12.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:13.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:13.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:14.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:14.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:14.831 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:58:14.831+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:58:15.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:15.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:16.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:16.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:17.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:17.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:18.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:18.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:19.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:19.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:19.831 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:58:19.831+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:58:20.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:20.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:21.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:21.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:22.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:22.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:23.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:23.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:24.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:24.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:24.832 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:58:24.832+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:58:25.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:25.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:26.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:26.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:27.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:27.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:28.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:28.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:29.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:29.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:29.833 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:58:29.833+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:58:30.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:30.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:31.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:31.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:32.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:32.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:33.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:33.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:34.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:34.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:34.835 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:58:34.835+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:58:35.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:35.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:36.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:36.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:37.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:37.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:38.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:38.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:39.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:39.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:39.836 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:58:39.835+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:58:40.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:40.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:41.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:41.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:42.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:42.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:43.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:43.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:44.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:44.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:44.837 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:58:44.837+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:58:45.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:45.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:46.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:46.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:47.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:47.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:48.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:48.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:49.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:49.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:49.837 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:58:49.837+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:58:50.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:50.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:51.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:51.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:52.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:52.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:53.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:53.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:54.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:54.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:54.839 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:58:54.838+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:58:55.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:55.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:56.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:56.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:57.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:57.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:58.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:58.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:59.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:58:59.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:58:59.839 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:58:59.839+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:59:00.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:00.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:01.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:01.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:02.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:02.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:03.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:03.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:04.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:04.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:04.840 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:59:04.841+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:59:05.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:05.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:06.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:06.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:07.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:07.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:08.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:08.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:09.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:09.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:09.841 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:59:09.841+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:59:10.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:10.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:11.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:11.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:12.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:12.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:13.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:13.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:14.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:14.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:14.841 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:59:14.841+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:59:15.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:15.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:16.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:16.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:17.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:17.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:18.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:18.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:19.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:19.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:19.842 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:59:19.842+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:59:20.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:20.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:21.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:21.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:22.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:22.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:23.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:23.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:24.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:24.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:24.844 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:59:24.843+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:59:25.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:25.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:26.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:26.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:27.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:27.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:28.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:28.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:29.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:29.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:29.844 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:59:29.844+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:59:30.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:30.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:31.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:31.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:32.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:32.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:33.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:33.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:34.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:34.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:34.845 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:59:34.845+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:59:35.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:35.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:36.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:36.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:37.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:37.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:38.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:38.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:39.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:39.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:39.846 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:59:39.846+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:59:40.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:40.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:41.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:41.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:42.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:42.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:43.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:43.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:44.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:44.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:44.847 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:59:44.847+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:59:45.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:45.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:46.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:46.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:47.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:47.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:48.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:48.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:49.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:49.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:49.848 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:59:49.848+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:59:50.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:50.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:51.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:51.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:52.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:52.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:53.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:53.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:54.850 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:59:54.849+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:59:54.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:54.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:55.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:55.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:56.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:56.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:57.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:57.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:58.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:58.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T09:59:59.851 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T09:59:59.850+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T09:59:59.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T09:59:59.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:00.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:00.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:01.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:01.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:03.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:03.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:04.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:04.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:04.852 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:00:04.851+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:00:05.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:05.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:06.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:06.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:07.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:07.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:08.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:08.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:09.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:09.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:09.852 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:00:09.852+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:00:10.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:10.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:11.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:11.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:12.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:12.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:13.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:13.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:14.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:14.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:14.853 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:00:14.853+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:00:15.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:15.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:16.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:16.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:17.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:17.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:18.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:18.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:19.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:19.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:19.854 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:00:19.854+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:00:20.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:20.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:21.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:21.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:22.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:22.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:23.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:23.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:24.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:24.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:24.855 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:00:24.855+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:00:25.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:25.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:26.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:26.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:27.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:27.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:28.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:28.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:29.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:29.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:29.857 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:00:29.856+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:00:30.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:30.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:31.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:31.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:32.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:32.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:33.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:33.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:34.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:34.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:35.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:35.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:36.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:36.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:37.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:37.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:38.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:38.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:39.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:39.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:39.859 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:00:39.859+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:00:40.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:40.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:41.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:41.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:42.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:42.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:43.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:43.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:44.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:44.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:44.860 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:00:44.860+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:00:45.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:45.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:46.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:46.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:47.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:47.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:48.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:48.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:49.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:49.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:49.860 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:00:49.860+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:00:50.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:50.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:51.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:51.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:52.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:52.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:53.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:53.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:54.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:54.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:54.862 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:00:54.861+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:00:55.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:55.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:56.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:56.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:57.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:57.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:58.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:58.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:59.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:00:59.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:00:59.863 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:00:59.862+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:01:00.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:00.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:01.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:01.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:02.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:02.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:03.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:03.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:04.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:04.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:04.864 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:01:04.863+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:01:05.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:05.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:06.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:06.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:07.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:07.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:08.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:08.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:09.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:09.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:09.865 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:01:09.864+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:01:10.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:10.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:11.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:11.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:12.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:12.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:13.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:13.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:14.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:14.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:14.866 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:01:14.865+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:01:15.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:15.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:16.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:16.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:17.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:17.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:18.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:18.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:19.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:19.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:19.867 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:01:19.866+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:01:20.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:20.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:21.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:21.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:22.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:22.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:23.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:23.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:24.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:24.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:24.867 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:01:24.867+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:01:25.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:25.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:26.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:26.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:27.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:27.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:28.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:28.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:29.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:29.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:29.868 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:01:29.868+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:01:30.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:30.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:31.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:31.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:32.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:32.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:33.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:33.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:34.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:34.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:34.869 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:01:34.869+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:01:35.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:35.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:36.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:36.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:37.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:37.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:38.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:38.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:39.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:39.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:39.870 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:01:39.870+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:01:40.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:40.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:41.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:41.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:42.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:42.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:43.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:43.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:44.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:44.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:44.871 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:01:44.871+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:01:45.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:45.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:46.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:46.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:47.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:47.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:48.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:48.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:49.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:49.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:49.872 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:01:49.872+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:01:50.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:50.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:51.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:51.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:52.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:52.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:53.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:53.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:54.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:54.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:54.873 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:01:54.873+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:01:55.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:55.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:56.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:56.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:57.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:57.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:58.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:58.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:59.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:01:59.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:01:59.874 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:01:59.874+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:02:00.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:00.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:01.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:01.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:02.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:02.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:03.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:03.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:04.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:04.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:04.875 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:02:04.876+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:02:05.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:05.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:06.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:06.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:07.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:07.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:08.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:08.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:09.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:09.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:09.876 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:02:09.877+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:02:10.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:10.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:11.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:11.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:12.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:12.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:13.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:13.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:14.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:14.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:14.877 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:02:14.877+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:02:15.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:15.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:16.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:16.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:17.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:17.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:18.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:18.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:19.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:19.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:19.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:02:19.878+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:02:20.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:20.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:21.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:21.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:22.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:22.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:23.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:23.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:24.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:24.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:24.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:02:24.878+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:02:25.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:25.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:26.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:26.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:27.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:27.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:28.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:28.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:29.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:29.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:29.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:02:29.879+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:02:30.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:30.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:31.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:31.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:32.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:32.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:33.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:33.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:34.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:34.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:34.881 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:02:34.880+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:02:35.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:35.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:36.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:36.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:37.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:37.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:38.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:38.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:39.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:39.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:39.882 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:02:39.881+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:02:40.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:40.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:41.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:41.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:42.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:42.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:43.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:43.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:44.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:44.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:44.883 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:02:44.883+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:02:45.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:45.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:46.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:46.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:47.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:47.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:48.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:48.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:49.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:49.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:49.884 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:02:49.884+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:02:50.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:50.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:51.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:51.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:52.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:52.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:53.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:53.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:54.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:54.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:54.885 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:02:54.884+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:02:55.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:55.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:56.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:56.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:57.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:57.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:58.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:58.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:59.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:02:59.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:02:59.886 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:02:59.885+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:03:00.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:00.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:01.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:01.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:02.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:02.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:03.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:03.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:04.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:04.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:04.886 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:03:04.886+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:03:05.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:05.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:06.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:06.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:07.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:07.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:08.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:08.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:09.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:09.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:09.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:03:09.887+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:03:10.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:10.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:11.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:11.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:12.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:12.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:13.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:13.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:14.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:14.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:14.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:03:14.887+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:03:15.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:15.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:16.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:16.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:17.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:17.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:18.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:18.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:19.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:19.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:19.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:03:19.888+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:03:20.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:20.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:21.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:21.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:22.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:22.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:23.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:23.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:24.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:24.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:24.889 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:03:24.889+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:03:25.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:25.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:26.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:26.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:27.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:27.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:28.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:28.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:29.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:29.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:29.890 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:03:29.890+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:03:30.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:30.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:31.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:31.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:32.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:32.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:33.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:33.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:34.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:34.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:34.891 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:03:34.891+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:03:35.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:35.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:36.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:36.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:37.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:37.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:38.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:38.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:39.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:39.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:39.893 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:03:39.893+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:03:40.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:40.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:41.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:41.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:42.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:42.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:43.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:43.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:44.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:44.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:44.894 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:03:44.894+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:03:45.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:45.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:46.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:46.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:47.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:47.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:48.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:48.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:49.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:49.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:49.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:03:49.895+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:03:50.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:50.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:51.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:51.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:52.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:52.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:53.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:53.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:54.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:54.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:54.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:03:54.896+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:03:55.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:55.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:56.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:56.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:57.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:57.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:58.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:58.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:59.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:03:59.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:03:59.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:03:59.897+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:04:00.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:00.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:01.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:01.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:02.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:02.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:03.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:03.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:04.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:04.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:04.899 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:04:04.898+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:04:05.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:05.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:06.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:06.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:07.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:07.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:08.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:08.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:09.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:09.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:09.900 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:04:09.899+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:04:10.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:10.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:11.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:11.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:12.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:12.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:13.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:13.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:14.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:14.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:14.901 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:04:14.901+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:04:15.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:15.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:16.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:16.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:17.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:17.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:18.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:18.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:19.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:19.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:19.902 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:04:19.902+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:04:20.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:20.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:21.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:21.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:22.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:22.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:23.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:23.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:24.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:24.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:24.903 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:04:24.902+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:04:25.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:25.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:26.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:26.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:27.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:27.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:28.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:28.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:29.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:29.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:29.904 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:04:29.903+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:04:30.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:30.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:31.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:31.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:32.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:32.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:33.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:33.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:34.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:34.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:34.905 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:04:34.904+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:04:35.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:35.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:36.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:36.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:37.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:37.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:38.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:38.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:39.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:39.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:39.906 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:04:39.905+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:04:40.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:40.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:41.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:41.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:42.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:42.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:43.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:43.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:44.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:44.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:44.907 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:04:44.906+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:04:45.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:45.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:46.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:46.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:47.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:47.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:48.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:48.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:49.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:49.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:49.907 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:04:49.907+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:04:50.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:50.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:51.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:51.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:52.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:52.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:53.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:53.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:54.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:54.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:54.908 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:04:54.908+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:04:55.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:55.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:56.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:56.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:57.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:57.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:58.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:58.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:59.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:04:59.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:04:59.909 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:04:59.910+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:05:00.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:00.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:01.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:01.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:02.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:02.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:03.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:03.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:04.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:04.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:04.911 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:05:04.910+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:05:05.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:05.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:06.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:06.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:07.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:07.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:08.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:08.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:09.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:09.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:09.911 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:05:09.912+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:05:10.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:10.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:11.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:11.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:12.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:12.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:13.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:13.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:14.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:14.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:14.912 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:05:14.913+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:05:15.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:15.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:16.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:16.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:17.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:17.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:18.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:18.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:19.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:19.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:19.913 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:05:19.913+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:05:20.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:20.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:21.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:21.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:22.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:22.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:23.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:23.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:24.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:24.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:24.914 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:05:24.913+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:05:25.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:25.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:26.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:26.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:27.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:27.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:28.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:28.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:29.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:29.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:29.915 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:05:29.915+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:05:30.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:30.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:31.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:31.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:32.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:32.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:33.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:33.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:34.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:34.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:34.916 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:05:34.915+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:05:35.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:35.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:36.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:36.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:37.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:37.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:38.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:38.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:39.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:39.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:39.917 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:05:39.916+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:05:40.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:40.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:41.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:41.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:42.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:42.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:43.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:43.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:44.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:44.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:44.918 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:05:44.917+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:05:45.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:45.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:46.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:46.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:47.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:47.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:48.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:48.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:49.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:49.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:49.919 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:05:49.918+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:05:50.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:50.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:51.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:51.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:52.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:52.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:53.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:53.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:54.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:54.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:54.920 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:05:54.919+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:05:55.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:55.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:56.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:56.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:57.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:57.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:58.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:58.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:59.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:05:59.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:05:59.921 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:05:59.920+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:06:00.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:00.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:01.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:01.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:02.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:02.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:03.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:03.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:04.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:04.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:04.921 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:06:04.921+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:06:05.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:05.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:06.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:06.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:07.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:07.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:08.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:08.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:09.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:09.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:09.922 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:06:09.922+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:06:10.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:10.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:11.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:11.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:12.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:12.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:13.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:13.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:14.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:14.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:14.924 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:06:14.923+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:06:15.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:15.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:16.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:16.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:17.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:17.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:18.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:18.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:19.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:19.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:19.925 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:06:19.924+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:06:20.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:20.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:21.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:21.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:22.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:22.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:23.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:23.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:24.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:24.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:24.925 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:06:24.925+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:06:25.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:25.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:26.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:26.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:27.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:27.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:28.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:28.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:29.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:29.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:29.927 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:06:29.926+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:06:30.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:30.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:31.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:31.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:32.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:32.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:33.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:33.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:34.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:34.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:34.928 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:06:34.927+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:06:35.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:35.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:36.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:36.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:37.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:37.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:38.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:38.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:39.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:39.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:39.929 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:06:39.929+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:06:40.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:40.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:41.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:41.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:42.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:42.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:43.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:43.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:44.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:44.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:44.929 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:06:44.929+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:06:45.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:45.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:46.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:46.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:47.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:47.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:48.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:48.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:49.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:49.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:49.931 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:06:49.931+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:06:50.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:50.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:51.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:51.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:52.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:52.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:53.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:53.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:54.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:54.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:54.932 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:06:54.932+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:06:55.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:55.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:56.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:56.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:57.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:57.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:58.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:58.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:59.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:06:59.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:06:59.933 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:06:59.932+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:07:00.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:00.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:01.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:01.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:02.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:02.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:03.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:03.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:04.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:04.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:04.934 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:07:04.933+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:07:05.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:05.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:06.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:06.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:07.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:07.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:08.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:08.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:09.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:09.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:09.935 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:07:09.934+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:07:10.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:10.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:11.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:11.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:12.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:12.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:13.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:13.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:14.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:14.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:14.935 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:07:14.935+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:07:15.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:15.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:16.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:16.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:17.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:17.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:18.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:18.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:19.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:19.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:19.937 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:07:19.936+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:07:20.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:20.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:21.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:21.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:22.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:22.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:23.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:23.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:24.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:24.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:24.937 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:07:24.937+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:07:25.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:25.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:26.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:26.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:27.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:27.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:28.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:28.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:29.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:29.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:29.938 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:07:29.938+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:07:30.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:30.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:31.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:31.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:32.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:32.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:33.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:33.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:34.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:34.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:34.940 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:07:34.939+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:07:35.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:35.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:36.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:36.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:37.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:37.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:38.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:38.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:39.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:39.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:39.941 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:07:39.940+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:07:40.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:40.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:41.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:41.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:42.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:42.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:43.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:43.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:44.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:44.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:44.942 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:07:44.941+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:07:45.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:45.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:46.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:46.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:47.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:47.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:48.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:48.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:49.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:49.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:49.943 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:07:49.942+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:07:50.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:50.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:51.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:51.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:52.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:52.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:53.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:53.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:54.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:54.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:54.943 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:07:54.943+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:07:55.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:55.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:56.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:56.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:57.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:57.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:58.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:58.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:59.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:07:59.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:07:59.945 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:07:59.945+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:08:00.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:00.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:01.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:01.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:02.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:02.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:03.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:03.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:04.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:04.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:04.946 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:08:04.945+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:08:05.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:05.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:06.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:06.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:07.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:07.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:08.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:08.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:09.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:09.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:09.947 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:08:09.947+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:08:10.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:10.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:11.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:11.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:12.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:12.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:13.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:13.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:14.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:14.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:14.947 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:08:14.948+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:08:15.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:15.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:16.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:16.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:17.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:17.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:18.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:18.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:19.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:19.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:19.948 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:08:19.949+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:08:20.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:20.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:21.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:21.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:22.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:22.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:23.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:23.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:24.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:24.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:24.949 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:08:24.949+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:08:25.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:25.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:26.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:26.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:27.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:27.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:28.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:28.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:29.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:29.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:29.950 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:08:29.949+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:08:30.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:30.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:31.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:31.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:32.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:32.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:33.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:33.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:34.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:34.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:34.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:08:34.950+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:08:35.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:35.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:36.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:36.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:37.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:37.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:38.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:38.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:39.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:39.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:39.952 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:08:39.952+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:08:40.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:40.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:41.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:41.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:42.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:42.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:43.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:43.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:44.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:44.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:44.953 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:08:44.952+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:08:45.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:45.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:46.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:46.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:47.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:47.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:48.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:48.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:49.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:49.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:49.954 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:08:49.953+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:08:50.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:50.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:51.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:51.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:52.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:52.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:53.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:53.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:54.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:54.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:54.955 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:08:54.954+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:08:55.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:55.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:56.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:56.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:57.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:57.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:58.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:58.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:59.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:08:59.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:08:59.956 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:08:59.956+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:09:00.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:00.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:01.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:01.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:02.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:02.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:03.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:03.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:04.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:04.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:04.957 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:09:04.956+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:09:05.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:05.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:06.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:06.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:07.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:07.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:08.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:08.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:09.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:09.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:09.958 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:09:09.958+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:09:10.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:10.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:11.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:11.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:12.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:12.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:13.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:13.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:14.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:14.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:14.959 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:09:14.959+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:09:14.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:14.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:16.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:16.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:17.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:17.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:18.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:18.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:19.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:19.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:19.960 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:09:19.959+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:09:20.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:20.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:21.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:21.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:22.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:22.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:23.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:23.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:24.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:24.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:24.960 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:09:24.960+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:09:25.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:25.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:26.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:26.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:27.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:27.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:28.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:28.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:29.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:29.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:29.962 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:09:29.962+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:09:30.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:30.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:31.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:31.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:32.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:32.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:33.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:33.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:34.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:34.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:34.963 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:09:34.962+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:09:35.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:35.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:36.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:36.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:37.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:37.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:38.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:38.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:39.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:39.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:39.964 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:09:39.964+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:09:40.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:40.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:41.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:41.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:42.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:42.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:43.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:43.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:43.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:43.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:44.965 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:09:44.964+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:09:45.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:45.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:45.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:45.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:46.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:46.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:47.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:47.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:48.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:48.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:49.966 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:09:49.965+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:09:49.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:49.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:50.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:50.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:51.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:51.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:52.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:52.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:53.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:53.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:54.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:54.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:54.966 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:09:54.966+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:09:55.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:55.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:56.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:56.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:57.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:57.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:58.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:09:58.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:09:59.968 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:09:59.968+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:10:00.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:00.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:01.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:01.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:02.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:02.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:02.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:02.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:03.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:03.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:04.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:04.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:04.969 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:10:04.968+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:10:05.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:05.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:06.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:06.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:07.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:07.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:08.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:08.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:09.970 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:10:09.969+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:10:09.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:09.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:10.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:10.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:11.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:11.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:12.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:12.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:14.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:14.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:14.970 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:10:14.970+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:10:15.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:15.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:16.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:16.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:17.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:17.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:18.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:18.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:19.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:19.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:19.971 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:10:19.971+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:10:20.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:20.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:21.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:21.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:22.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:22.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:23.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:23.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:24.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:24.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:24.972 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:10:24.972+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:10:25.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:25.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:26.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:26.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:27.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:27.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:28.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:28.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:29.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:29.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:29.973 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:10:29.972+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:10:30.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:30.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:31.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:31.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:32.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:32.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:33.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:33.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:34.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:34.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:34.973 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:10:34.973+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:10:35.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:35.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:36.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:36.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:37.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:37.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:38.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:38.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:39.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:39.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:39.974 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:10:39.974+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:10:40.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:40.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:41.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:41.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:42.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:42.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:43.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:43.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:44.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:44.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:44.975 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:10:44.975+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:10:45.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:45.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:46.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:46.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:47.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:47.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:48.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:48.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:49.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:49.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:49.977 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:10:49.976+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:10:50.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:50.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:51.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:51.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:52.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:52.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:53.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:53.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:54.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:54.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:54.978 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:10:54.977+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:10:55.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:55.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:56.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:56.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:57.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:57.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:58.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:58.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:59.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:10:59.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:10:59.979 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:10:59.979+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:11:00.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:00.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:01.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:01.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:02.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:02.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:03.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:03.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:04.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:04.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:04.980 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:11:04.980+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:11:05.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:05.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:06.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:06.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:07.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:07.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:08.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:08.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:09.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:09.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:09.981 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:11:09.981+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:11:10.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:10.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:11.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:11.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:12.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:12.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:13.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:13.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:14.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:14.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:14.983 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:11:14.982+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:11:15.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:15.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:16.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:16.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:17.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:17.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:18.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:18.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:19.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:19.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:19.984 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:11:19.984+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:11:20.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:20.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:21.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:21.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:22.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:22.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:23.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:23.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:24.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:24.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:24.984 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:11:24.985+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:11:25.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:25.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:26.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:26.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:27.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:27.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:28.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:28.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:29.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:29.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:29.985 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:11:29.985+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:11:30.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:30.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:31.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:31.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:32.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:32.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:33.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:33.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:34.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:34.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:34.986 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:11:34.986+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:11:35.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:35.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:36.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:36.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:37.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:37.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:38.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:38.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:39.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:39.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:39.987 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:11:39.986+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:11:40.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:40.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:41.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:41.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:42.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:42.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:43.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:43.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:44.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:44.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:44.988 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:11:44.987+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:11:45.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:45.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:46.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:46.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:47.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:47.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:48.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:48.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:49.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:49.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:49.989 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:11:49.989+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:11:50.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:50.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:51.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:51.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:52.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:52.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:53.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:53.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:54.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:54.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:54.990 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:11:54.989+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:11:55.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:55.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:56.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:56.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:57.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:57.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:58.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:58.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:59.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:11:59.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:11:59.991 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:11:59.990+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:12:00.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:00.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:01.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:01.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:02.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:02.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:03.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:03.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:04.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:04.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:04.992 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:12:04.991+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:12:05.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:05.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:06.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:06.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:07.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:07.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:08.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:08.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:09.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:09.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:09.993 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:12:09.992+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:12:10.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:10.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:11.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:11.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:12.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:12.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:13.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:13.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:14.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:14.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:14.994 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:12:14.994+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:12:15.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:15.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:16.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:16.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:17.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:17.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:18.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:18.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:19.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:19.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:19.995 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:12:19.995+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:12:20.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:20.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:21.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:21.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:22.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:22.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:23.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:23.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:24.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:24.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:24.996 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:12:24.995+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:12:25.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:25.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:26.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:26.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:27.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:27.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:28.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:28.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:29.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:29.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:29.997 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:12:29.996+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:12:30.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:30.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:31.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:31.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:32.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:32.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:33.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:33.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:34.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:34.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:34.998 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:12:34.998+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:12:35.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:35.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:36.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:36.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:37.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:37.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:38.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:38.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:39.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:39.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:39.999 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:12:39.999+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:12:40.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:40.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:41.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:41.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:42.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:42.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:43.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:43.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:44.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:44.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:45.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:45.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:46.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:46.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:47.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:47.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:48.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:48.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:49.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:49.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:50.001 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:12:50.001+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:12:50.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:50.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:51.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:51.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:52.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:52.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:53.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:53.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:54.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:54.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:55.002 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:12:55.002+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:12:55.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:55.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:56.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:56.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:57.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:57.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:58.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:58.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:12:59.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:12:59.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:00.003 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:13:00.002+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:13:00.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:00.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:01.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:01.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:02.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:02.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:03.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:03.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:04.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:04.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:05.004 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:13:05.004+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:13:05.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:05.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:06.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:06.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:07.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:07.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:08.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:08.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:09.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:09.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:10.005 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:13:10.005+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:13:10.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:10.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:11.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:11.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:12.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:12.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:13.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:13.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:14.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:14.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:15.006 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:13:15.005+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:13:15.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:15.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:16.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:16.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:17.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:17.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:18.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:18.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:19.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:19.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:20.007 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:13:20.006+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:13:20.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:20.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:21.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:21.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:22.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:22.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:23.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:23.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:24.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:24.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:25.008 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:13:25.008+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:13:25.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:25.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:26.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:26.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:27.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:27.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:28.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:28.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:29.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:29.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:30.009 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:13:30.009+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:13:30.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:30.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:31.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:31.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:32.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:32.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:33.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:33.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:34.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:34.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:35.010 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:13:35.009+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:13:35.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:35.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:36.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:36.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:37.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:37.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:38.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:38.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:39.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:39.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:40.011 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:13:40.011+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:13:40.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:40.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:41.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:41.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:42.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:42.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:43.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:43.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:44.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:44.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:45.012 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:13:45.011+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:13:45.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:45.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:46.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:46.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:47.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:47.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:48.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:48.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:49.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:49.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:50.013 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:13:50.012+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:13:50.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:50.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:51.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:51.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:52.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:52.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:53.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:53.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:54.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:54.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:55.014 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:13:55.013+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:13:55.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:55.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:56.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:56.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:57.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:57.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:58.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:58.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:13:59.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:13:59.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:00.015 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:14:00.014+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:14:00.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:00.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:01.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:01.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:02.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:02.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:03.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:03.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:04.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:04.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:05.016 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:14:05.015+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:14:05.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:05.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:06.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:06.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:07.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:07.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:08.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:08.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:09.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:09.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:10.016 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:14:10.016+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:14:10.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:10.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:11.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:11.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:12.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:12.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:13.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:13.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:14.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:14.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:15.018 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:14:15.018+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:14:15.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:15.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:16.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:16.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:17.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:17.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:18.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:18.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:19.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:19.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:20.019 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:14:20.020+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:14:20.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:20.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:21.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:21.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:22.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:22.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:23.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:23.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:24.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:24.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:25.020 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:14:25.021+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:14:25.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:25.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:26.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:26.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:27.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:27.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:28.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:28.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:29.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:29.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:30.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:30.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:31.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:31.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:32.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:32.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:33.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:33.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:34.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:34.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:35.022 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:14:35.022+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:14:35.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:35.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:36.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:36.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:37.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:37.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:38.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:38.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:39.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:39.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:40.023 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:14:40.023+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:14:40.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:40.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:41.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:41.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:42.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:42.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:43.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:43.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:44.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:44.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:45.024 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:14:45.023+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:14:45.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:45.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:46.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:46.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:47.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:47.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:48.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:48.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:49.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:49.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:50.024 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:14:50.024+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:14:50.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:50.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:51.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:51.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:52.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:52.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:53.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:53.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:54.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:54.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:55.026 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:14:55.025+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:14:55.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:55.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:56.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:56.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:57.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:57.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:58.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:58.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:14:59.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:14:59.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:00.027 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:15:00.026+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:15:00.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:00.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:01.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:01.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:02.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:02.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:03.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:03.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:04.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:04.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:05.027 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:15:05.027+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:15:05.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:05.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:06.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:06.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:07.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:07.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:08.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:08.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:09.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:09.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:10.028 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:15:10.028+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:15:10.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:10.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:11.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:11.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:12.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:12.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:13.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:13.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:14.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:14.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:15.030 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:15:15.029+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:15:15.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:15.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:16.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:16.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:17.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:17.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:18.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:18.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:19.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:19.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:20.031 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:15:20.030+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:15:20.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:20.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:21.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:21.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:23.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:23.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:24.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:24.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:25.032 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:15:25.031+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:15:25.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:25.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:26.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:26.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:27.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:27.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:28.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:28.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:29.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:29.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:30.033 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:15:30.033+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:15:30.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:30.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:31.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:31.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:32.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:32.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:33.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:33.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:34.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:34.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:35.034 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:15:35.034+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:15:35.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:35.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:36.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:36.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:37.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:37.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:38.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:38.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:39.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:39.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:40.035 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:15:40.035+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:15:40.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:40.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:41.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:41.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:42.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:42.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:43.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:43.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:44.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:44.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:45.036 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:15:45.036+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:15:45.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:45.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:46.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:46.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:47.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:47.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:48.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:48.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:49.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:49.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:50.037 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:15:50.036+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:15:50.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:50.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:51.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:51.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:52.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:52.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:53.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:53.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:54.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:54.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:55.038 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:15:55.037+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:15:55.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:55.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:56.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:56.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:57.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:57.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:58.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:58.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:15:59.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:15:59.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:00.039 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:16:00.038+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:16:00.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:00.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:01.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:01.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:02.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:02.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:03.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:03.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:04.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:04.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:05.039 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:16:05.039+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:16:05.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:05.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:06.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:06.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:07.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:07.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:08.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:08.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:09.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:09.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:10.041 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:16:10.041+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:16:10.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:10.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:11.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:11.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:12.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:12.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:13.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:13.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:14.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:14.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:15.042 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:16:15.042+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:16:15.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:15.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:16.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:16.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:17.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:17.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:18.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:18.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:19.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:19.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:20.043 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:16:20.042+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:16:20.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:20.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:21.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:21.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:22.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:22.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:23.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:23.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:24.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:24.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:25.044 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:16:25.043+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:16:25.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:25.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:26.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:26.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:27.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:27.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:28.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:28.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:29.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:29.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:30.045 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:16:30.045+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:16:30.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:30.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:31.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:31.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:32.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:32.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:33.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:33.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:34.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:34.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:35.045 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:16:35.045+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:16:35.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:35.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:36.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:36.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:37.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:37.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:38.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:38.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:39.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:39.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:40.046 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:16:40.046+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:16:40.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:40.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:41.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:41.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:42.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:42.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:43.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:43.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:44.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:44.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:45.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:16:45.048+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:16:45.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:45.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:46.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:46.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:47.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:47.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:48.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:48.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:49.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:49.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:50.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:16:50.048+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:16:50.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:50.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:51.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:51.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:52.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:52.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:53.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:53.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:54.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:54.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:55.050 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:16:55.050+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:16:55.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:55.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:56.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:56.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:57.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:57.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:58.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:58.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:16:59.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:16:59.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:00.051 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:17:00.050+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:17:00.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:00.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:01.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:01.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:02.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:02.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:03.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:03.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:04.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:04.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:05.052 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:17:05.051+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:17:05.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:05.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:06.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:06.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:07.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:07.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:08.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:08.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:09.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:09.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:10.053 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:17:10.052+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:17:10.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:10.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:11.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:11.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:12.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:12.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:13.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:13.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:14.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:14.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:15.053 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:17:15.053+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:17:15.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:15.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:16.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:16.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:17.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:17.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:18.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:18.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:19.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:19.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:20.055 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:17:20.054+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:17:20.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:20.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:21.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:21.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:22.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:22.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:23.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:23.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:24.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:24.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:25.056 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:17:25.056+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:17:25.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:25.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:26.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:26.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:27.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:27.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:28.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:28.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:29.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:29.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:30.056 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:17:30.057+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:17:30.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:30.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:31.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:31.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:32.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:32.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:33.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:33.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:34.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:34.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:35.057 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:17:35.056+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:17:35.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:35.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:36.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:36.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:37.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:37.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:38.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:38.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:39.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:39.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:40.057 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:17:40.057+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:17:40.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:40.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:41.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:41.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:42.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:42.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:43.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:43.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:44.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:44.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:45.059 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:17:45.058+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:17:45.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:45.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:46.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:46.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:47.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:47.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:48.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:48.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:49.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:49.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:50.060 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:17:50.059+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:17:50.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:50.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:51.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:51.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:52.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:52.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:53.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:53.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:54.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:54.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:55.061 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:17:55.061+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:17:55.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:55.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:56.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:56.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:57.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:57.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:58.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:58.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:17:59.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:17:59.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:00.062 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:18:00.062+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:18:00.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:00.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:01.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:01.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:02.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:02.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:03.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:03.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:04.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:04.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:05.063 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:18:05.062+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:18:05.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:05.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:06.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:06.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:07.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:07.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:08.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:08.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:09.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:09.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:10.064 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:18:10.063+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:18:10.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:10.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:11.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:11.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:12.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:12.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:13.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:13.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:14.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:14.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:15.065 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:18:15.064+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:18:15.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:15.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:16.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:16.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:17.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:17.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:18.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:18.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:19.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:19.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:20.066 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:18:20.065+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:18:20.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:20.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:21.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:21.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:22.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:22.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:23.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:23.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:24.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:24.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:25.067 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:18:25.066+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:18:25.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:25.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:26.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:26.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:27.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:27.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:28.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:28.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:29.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:29.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:30.068 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:18:30.068+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:18:30.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:30.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:31.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:31.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:32.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:32.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:33.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:33.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:34.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:34.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:35.069 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:18:35.069+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:18:35.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:35.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:36.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:36.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:37.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:37.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:38.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:38.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:39.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:39.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:40.070 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:18:40.069+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:18:40.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:40.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:41.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:41.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:42.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:42.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:43.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:43.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:44.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:44.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:45.071 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:18:45.071+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:18:45.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:45.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:46.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:46.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:47.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:47.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:48.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:48.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:49.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:49.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:50.072 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:18:50.072+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:18:50.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:50.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:51.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:51.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:52.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:52.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:53.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:53.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:54.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:54.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:55.073 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:18:55.072+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:18:55.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:55.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:56.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:56.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:57.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:57.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:58.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:58.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:18:59.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:18:59.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:00.073 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:19:00.073+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:19:00.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:00.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:01.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:01.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:02.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:02.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:03.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:03.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:04.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:04.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:05.075 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:19:05.074+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:19:05.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:05.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:06.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:06.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:07.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:07.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:08.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:08.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:09.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:09.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:10.076 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:19:10.075+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:19:10.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:10.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:11.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:11.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:12.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:12.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:13.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:13.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:14.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:14.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:15.077 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:19:15.077+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:19:15.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:15.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:16.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:16.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:17.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:17.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:18.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:18.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:19.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:19.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:20.078 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:19:20.078+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:19:20.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:20.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:21.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:21.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:22.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:22.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:23.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:23.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:24.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:24.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:25.079 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:19:25.079+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:19:25.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:25.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:26.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:26.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:27.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:27.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:28.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:28.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:29.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:29.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:30.080 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:19:30.079+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:19:30.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:30.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:31.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:31.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:32.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:32.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:33.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:33.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:34.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:34.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:35.081 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:19:35.080+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:19:35.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:35.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:36.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:36.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:37.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:37.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:38.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:38.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:39.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:39.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:40.082 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:19:40.082+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:19:40.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:40.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:41.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:41.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:42.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:42.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:43.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:43.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:44.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:44.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:45.083 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:19:45.082+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:19:45.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:45.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:46.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:46.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:47.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:47.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:48.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:48.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:49.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:49.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:50.083 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:19:50.083+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:19:50.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:50.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:51.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:51.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:52.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:52.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:53.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:53.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:54.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:54.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:55.085 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:19:55.085+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:19:55.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:55.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:56.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:56.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:57.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:57.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:58.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:58.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:19:59.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:19:59.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:00.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:20:00.085+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:20:00.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:00.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:01.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:01.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:02.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:02.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:03.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:03.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:04.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:04.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:05.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:20:05.086+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:20:05.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:05.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:06.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:06.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:07.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:07.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:08.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:08.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:09.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:09.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:10.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:20:10.087+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:20:10.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:10.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:11.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:11.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:12.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:12.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:13.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:13.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:14.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:14.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:15.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:20:15.089+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:20:15.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:15.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:16.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:16.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:17.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:17.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:18.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:18.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:19.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:19.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:20.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:20:20.090+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:20:20.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:20.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:21.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:21.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:22.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:22.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:23.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:23.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:24.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:24.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:25.090 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:20:25.090+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:20:25.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:25.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:26.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:26.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:27.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:27.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:28.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:28.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:29.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:29.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:30.091 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:20:30.091+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:20:30.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:30.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:31.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:31.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:32.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:32.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:33.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:33.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:34.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:34.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:35.092 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:20:35.092+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:20:35.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:35.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:36.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:36.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:37.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:37.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:38.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:38.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:39.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:39.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:40.093 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:20:40.092+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:20:40.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:40.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:41.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:41.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:42.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:42.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:43.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:43.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:44.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:44.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:45.093 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:20:45.093+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:20:45.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:45.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:46.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:46.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:47.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:47.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:48.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:48.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:49.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:49.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:50.095 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:20:50.094+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:20:50.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:50.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:51.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:51.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:52.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:52.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:53.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:53.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:54.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:54.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:55.096 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:20:55.096+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:20:55.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:55.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:56.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:56.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:57.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:57.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:58.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:58.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:20:59.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:20:59.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:00.097 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:21:00.096+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:21:00.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:00.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:01.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:01.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:02.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:02.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:03.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:03.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:04.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:04.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:05.098 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:21:05.097+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:21:05.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:05.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:06.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:06.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:07.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:07.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:08.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:08.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:09.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:09.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:10.099 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:21:10.098+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:21:10.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:10.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:11.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:11.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:12.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:12.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:13.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:13.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:14.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:14.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:15.100 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:21:15.099+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:21:15.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:15.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:16.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:16.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:17.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:17.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:18.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:18.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:19.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:19.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:20.101 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:21:20.101+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:21:20.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:20.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:21.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:21.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:22.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:22.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:23.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:23.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:24.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:24.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:25.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:21:25.101+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:21:25.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:25.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:26.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:26.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:27.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:27.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:28.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:28.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:29.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:29.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:30.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:21:30.102+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:21:30.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:30.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:31.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:31.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:32.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:32.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:33.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:33.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:34.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:34.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:35.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:21:35.103+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:21:35.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:35.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:36.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:36.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:37.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:37.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:38.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:38.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:39.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:39.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:40.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:21:40.103+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:21:40.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:40.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:41.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:41.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:42.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:42.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:43.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:43.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:44.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:44.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:45.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:21:45.104+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:21:45.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:45.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:46.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:46.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:47.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:47.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:48.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:48.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:49.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:49.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:50.106 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:21:50.105+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:21:50.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:50.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:51.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:51.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:52.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:52.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:53.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:53.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:54.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:54.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:55.107 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:21:55.107+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:21:55.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:55.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:56.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:56.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:57.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:57.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:58.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:58.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:21:59.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:21:59.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:00.108 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:22:00.108+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:22:00.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:00.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:01.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:01.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:02.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:02.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:03.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:03.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:04.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:04.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:05.110 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:22:05.109+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:22:05.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:05.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:06.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:06.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:07.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:07.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:08.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:08.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:09.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:09.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:10.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:10.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:10.111 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:22:10.110+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:22:11.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:11.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:12.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:12.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:13.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:13.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:14.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:14.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:15.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:15.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:15.112 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:22:15.111+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:22:16.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:16.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:17.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:17.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:17.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:17.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:19.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:19.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:20.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:20.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:20.113 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:22:20.112+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:22:21.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:21.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:22.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:22.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:23.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:23.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:24.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:24.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:25.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:25.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:25.114 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:22:25.114+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:22:26.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:26.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:27.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:27.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:28.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:28.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:29.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:29.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:30.115 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:22:30.115+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:22:30.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:30.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:31.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:31.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:32.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:32.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:33.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:33.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:34.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:34.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:35.116 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:22:35.115+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:22:35.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:35.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:36.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:36.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:37.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:37.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:38.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:38.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:39.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:39.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:40.117 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:22:40.116+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:22:40.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:40.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:41.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:41.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:42.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:42.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:43.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:43.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:44.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:44.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:45.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:45.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:45.118 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:22:45.117+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:22:46.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:46.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:46.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:46.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:47.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:47.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:48.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:48.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:49.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:49.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:50.119 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:22:50.118+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:22:50.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:50.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:51.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:51.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:52.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:52.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:53.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:53.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:54.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:54.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:55.120 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:22:55.119+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:22:55.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:55.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:56.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:56.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:57.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:57.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:58.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:58.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:22:59.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:22:59.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:00.120 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:23:00.120+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:23:00.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:00.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:01.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:01.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:02.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:02.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:03.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:03.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:04.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:04.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:05.121 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:23:05.122+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:23:05.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:05.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:06.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:06.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:07.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:07.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:08.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:08.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:09.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:09.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:10.122 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:23:10.123+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:23:10.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:10.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:11.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:11.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:12.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:12.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:13.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:13.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:14.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:14.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:15.122 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:23:15.122+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:23:15.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:15.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:16.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:16.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:17.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:17.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:18.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:18.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:19.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:19.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:20.124 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:23:20.123+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:23:20.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:20.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:21.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:21.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:22.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:22.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:23.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:23.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:24.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:24.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:25.125 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:23:25.125+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:23:25.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:25.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:26.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:26.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:27.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:27.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:28.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:28.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:29.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:29.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:30.126 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:23:30.126+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:23:30.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:30.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:31.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:31.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:32.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:32.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:33.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:33.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:34.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:34.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:35.127 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:23:35.126+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:23:35.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:35.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:36.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:36.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:37.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:37.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:38.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:38.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:39.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:39.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:40.128 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:23:40.128+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:23:40.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:40.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:41.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:41.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:42.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:42.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:43.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:43.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:44.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:44.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:45.129 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:23:45.128+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:23:45.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:45.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:46.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:46.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:47.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:47.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:48.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:48.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:49.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:49.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:50.130 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:23:50.129+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:23:50.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:50.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:51.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:51.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:52.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:52.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:53.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:53.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:54.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:54.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:55.131 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:23:55.130+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:23:55.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:55.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:56.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:56.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:57.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:57.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:58.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:58.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:23:59.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:23:59.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:00.132 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:24:00.132+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:24:00.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:00.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:01.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:01.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:02.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:02.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:03.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:03.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:04.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:04.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:05.133 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:24:05.132+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:24:05.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:05.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:06.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:06.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:07.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:07.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:08.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:08.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:09.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:09.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:10.134 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:24:10.133+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:24:10.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:10.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:11.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:11.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:12.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:12.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:13.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:13.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:14.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:14.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:15.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:24:15.134+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:24:15.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:15.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:16.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:16.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:17.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:17.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:18.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:18.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:19.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:19.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:20.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:24:20.135+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:24:20.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:20.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:21.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:21.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:22.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:22.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:23.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:23.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:24.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:24.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:25.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:24:25.137+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:24:25.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:25.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:26.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:26.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:27.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:27.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:28.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:28.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:29.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:29.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:30.138 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:24:30.138+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:24:30.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:30.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:31.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:31.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:32.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:32.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:33.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:33.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:34.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:34.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:35.140 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:24:35.140+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:24:35.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:35.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:36.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:36.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:37.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:37.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:38.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:38.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:39.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:39.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:40.141 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:24:40.140+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:24:40.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:40.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:41.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:41.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:42.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:42.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:43.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:43.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:44.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:44.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:45.142 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:24:45.141+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:24:45.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:45.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:46.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:46.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:47.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:47.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:48.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:48.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:49.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:49.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:50.142 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:24:50.142+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:24:50.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:50.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:51.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:51.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:52.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:52.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:53.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:53.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:54.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:54.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:55.143 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:24:55.143+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:24:55.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:55.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:56.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:56.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:57.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:57.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:58.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:58.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:24:59.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:24:59.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:00.143 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:25:00.143+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:25:00.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:00.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:01.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:01.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:02.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:02.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:03.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:03.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:04.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:04.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:05.145 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:25:05.144+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:25:05.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:05.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:06.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:06.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:07.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:07.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:08.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:08.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:09.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:09.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:10.146 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:25:10.145+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:25:10.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:10.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:11.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:11.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:12.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:12.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:13.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:13.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:14.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:14.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:15.147 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:25:15.146+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:25:15.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:15.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:16.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:16.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:17.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:17.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:18.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:18.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:19.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:19.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:20.147 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:25:20.147+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:25:20.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:20.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:21.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:21.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:22.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:22.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:23.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:23.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:24.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:24.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:25.148 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:25:25.148+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:25:25.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:25.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:26.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:26.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:27.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:27.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:28.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:28.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:29.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:29.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:30.149 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:25:30.149+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:25:30.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:30.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:31.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:31.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:32.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:32.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:33.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:33.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:34.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:34.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:35.150 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:25:35.150+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:25:35.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:35.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:36.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:36.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:37.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:37.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:38.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:38.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:39.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:39.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:40.152 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:25:40.151+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:25:40.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:40.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:41.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:41.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:42.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:42.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:43.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:43.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:44.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:44.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:45.153 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:25:45.153+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:25:45.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:45.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:46.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:46.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:47.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:47.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:48.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:48.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:49.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:49.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:50.154 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:25:50.153+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:25:50.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:50.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:51.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:51.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:52.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:52.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:53.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:53.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:54.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:54.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:55.155 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:25:55.154+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:25:55.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:55.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:56.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:56.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:57.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:57.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:58.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:58.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:25:59.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:25:59.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:00.156 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:26:00.156+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:26:00.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:00.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:01.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:01.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:02.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:02.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:03.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:03.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:04.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:04.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:05.156 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:26:05.157+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:26:05.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:05.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:06.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:06.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:07.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:07.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:08.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:08.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:09.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:09.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:10.157 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:26:10.157+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:26:10.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:10.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:11.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:11.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:12.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:12.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:13.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:13.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:14.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:14.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:15.158 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:26:15.158+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:26:15.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:15.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:16.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:16.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:17.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:17.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:18.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:18.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:19.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:19.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:20.159 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:26:20.159+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:26:20.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:20.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:21.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:21.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:22.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:22.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:23.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:23.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:24.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:24.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:25.160 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:26:25.160+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:26:25.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:25.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:26.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:26.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:27.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:27.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:28.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:28.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:29.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:29.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:30.161 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:26:30.160+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:26:30.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:30.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:31.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:31.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:32.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:32.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:33.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:33.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:34.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:34.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:35.162 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:26:35.161+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:26:35.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:35.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:36.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:36.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:37.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:37.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:38.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:38.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:39.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:39.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:40.163 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:26:40.162+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:26:40.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:40.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:41.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:41.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:42.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:42.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:43.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:43.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:44.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:44.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:45.164 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:26:45.163+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:26:45.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:45.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:46.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:46.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:47.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:47.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:48.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:48.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:49.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:49.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:50.165 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:26:50.164+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:26:50.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:50.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:51.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:51.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:52.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:52.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:53.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:53.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:54.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:54.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:55.166 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:26:55.165+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:26:55.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:55.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:56.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:56.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:57.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:57.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:58.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:58.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:26:59.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:26:59.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:00.167 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:27:00.166+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:27:00.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:00.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:01.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:01.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:02.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:02.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:03.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:03.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:04.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:04.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:05.168 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:27:05.167+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:27:05.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:05.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:06.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:06.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:07.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:07.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:08.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:08.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:09.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:09.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:10.169 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:27:10.169+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:27:10.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:10.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:11.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:11.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:12.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:12.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:13.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:13.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:14.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:14.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:15.170 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:27:15.170+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:27:15.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:15.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:16.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:16.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:17.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:17.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:18.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:18.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:19.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:19.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:20.171 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:27:20.170+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:27:20.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:20.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:21.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:21.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:22.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:22.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:23.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:23.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:24.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:24.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:25.172 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:27:25.172+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:27:25.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:25.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:26.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:26.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:27.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:27.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:28.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:28.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:29.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:29.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:30.173 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:27:30.173+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:27:30.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:30.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:31.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:31.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:32.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:32.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:33.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:33.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:34.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:34.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:35.174 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:27:35.173+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:27:35.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:35.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:36.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:36.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:37.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:37.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:38.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:38.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:39.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:39.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:40.175 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:27:40.174+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:27:40.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:40.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:41.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:41.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:42.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:42.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:43.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:43.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:44.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:44.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:45.176 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:27:45.176+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:27:45.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:45.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:46.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:46.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:47.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:47.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:48.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:48.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:49.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:49.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:50.177 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:27:50.176+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:27:50.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:50.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:51.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:51.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:52.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:52.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:53.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:53.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:54.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:54.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:55.178 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:27:55.177+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:27:55.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:55.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:56.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:56.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:57.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:57.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:58.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:58.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:27:59.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:27:59.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:00.179 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:28:00.179+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:28:00.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:00.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:01.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:01.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:02.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:02.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:03.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:03.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:04.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:04.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:05.180 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:28:05.180+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:28:05.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:05.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:06.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:06.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:07.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:07.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:08.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:08.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:09.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:09.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:10.181 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:28:10.181+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:28:10.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:10.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:11.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:11.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:12.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:12.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:13.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:13.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:14.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:14.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:15.182 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:28:15.182+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:28:15.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:15.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:16.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:16.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:17.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:17.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:18.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:18.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:19.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:19.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:20.183 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:28:20.182+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:28:20.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:20.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:21.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:21.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:22.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:22.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:23.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:23.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:24.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:24.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:25.184 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:28:25.183+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:28:25.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:25.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:26.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:26.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:27.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:27.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:28.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:28.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:29.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:29.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:30.184 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:28:30.184+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:28:30.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:30.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:31.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:31.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:32.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:32.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:33.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:33.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:34.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:34.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:35.185 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:28:35.184+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:28:35.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:35.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:36.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:36.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:37.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:37.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:38.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:38.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:39.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:39.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:40.186 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:28:40.185+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:28:40.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:40.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:41.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:41.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:42.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:42.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:43.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:43.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:44.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:44.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:45.187 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:28:45.186+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:28:45.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:45.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:46.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:46.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:47.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:47.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:48.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:48.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:49.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:49.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:50.188 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:28:50.188+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:28:50.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:50.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:51.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:51.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:52.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:52.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:53.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:53.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:54.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:54.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:55.189 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:28:55.190+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:28:55.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:55.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:56.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:56.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:57.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:57.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:58.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:58.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:28:59.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:28:59.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:00.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:29:00.191+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:29:00.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:00.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:01.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:01.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:02.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:02.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:03.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:03.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:04.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:04.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:05.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:29:05.191+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:29:05.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:05.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:06.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:06.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:07.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:07.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:08.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:08.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:09.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:09.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:10.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:29:10.191+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:29:10.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:10.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:11.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:11.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:12.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:12.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:13.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:13.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:14.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:14.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:15.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:29:15.192+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:29:15.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:15.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:16.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:16.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:17.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:17.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:18.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:18.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:19.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:19.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:20.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:29:20.193+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:29:20.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:20.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:21.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:21.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:22.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:22.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:23.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:23.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:24.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:24.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:25.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:29:25.194+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:29:25.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:25.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:26.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:26.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:27.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:27.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:28.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:28.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:29.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:29.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:30.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:29:30.196+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:29:30.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:30.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:31.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:31.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:32.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:32.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:33.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:33.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:34.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:34.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:35.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:29:35.197+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:29:35.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:35.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:36.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:36.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:37.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:37.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:38.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:38.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:39.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:39.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:40.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:29:40.197+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:29:40.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:40.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:41.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:41.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:42.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:42.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:43.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:43.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:44.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:44.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:45.199 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:29:45.199+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:29:45.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:45.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:46.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:46.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:47.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:47.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:48.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:48.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:49.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:49.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:50.200 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:29:50.199+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:29:50.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:50.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:51.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:51.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:52.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:52.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:53.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:53.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:54.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:54.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:55.201 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:29:55.201+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:29:55.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:55.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:56.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:56.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:57.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:57.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:58.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:58.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:29:59.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:29:59.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:00.202 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:30:00.202+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:30:00.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:00.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:01.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:01.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:02.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:02.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:03.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:03.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:04.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:04.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:05.203 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:30:05.203+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:30:05.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:05.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:06.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:06.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:07.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:07.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:08.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:08.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:09.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:09.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:10.204 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:30:10.203+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:30:10.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:10.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:11.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:11.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:12.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:12.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:13.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:13.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:14.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:14.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:15.205 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:30:15.205+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:30:15.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:15.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:16.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:16.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:17.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:17.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:18.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:18.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:19.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:19.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:20.206 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:30:20.205+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:30:20.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:20.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:21.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:21.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:22.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:22.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:23.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:23.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:24.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:24.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:25.207 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:30:25.206+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:30:25.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:25.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:26.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:26.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:27.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:27.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:28.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:28.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:29.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:29.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:30.208 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:30:30.207+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:30:30.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:30.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:31.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:31.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:32.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:32.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:33.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:33.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:34.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:34.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:35.209 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:30:35.208+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:30:35.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:35.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:36.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:36.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:37.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:37.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:38.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:38.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:39.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:39.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:40.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:30:40.209+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:30:40.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:40.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:41.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:41.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:42.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:42.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:43.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:43.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:44.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:44.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:45.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:30:45.210+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:30:45.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:45.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:46.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:46.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:47.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:47.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:48.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:48.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:49.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:49.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:50.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:30:50.211+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:30:50.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:50.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:51.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:51.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:52.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:52.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:53.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:53.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:54.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:54.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:55.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:30:55.212+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:30:55.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:55.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:56.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:56.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:57.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:57.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:58.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:58.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:30:59.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:30:59.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:00.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:31:00.213+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:31:00.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:00.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:01.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:01.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:02.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:02.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:03.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:03.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:04.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:04.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:05.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:31:05.214+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:31:05.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:05.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:06.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:06.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:07.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:07.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:08.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:08.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:09.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:09.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:10.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:31:10.215+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:31:10.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:10.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:11.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:11.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:12.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:12.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:13.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:13.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:14.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:14.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:15.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:31:15.216+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:31:15.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:15.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:16.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:16.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:17.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:17.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:18.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:18.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:19.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:19.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:20.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:31:20.217+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:31:20.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:20.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:21.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:21.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:22.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:22.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:23.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:23.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:24.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:24.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:25.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:31:25.217+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:31:25.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:25.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:26.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:26.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:27.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:27.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:28.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:28.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:29.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:29.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:30.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:31:30.218+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:31:30.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:30.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:31.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:31.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:32.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:32.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:33.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:33.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:34.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:34.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:35.220 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:31:35.219+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:31:35.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:35.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:36.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:36.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:37.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:37.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:38.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:38.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:39.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:39.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:40.221 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:31:40.220+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:31:40.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:40.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:41.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:41.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:42.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:42.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:43.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:43.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:44.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:44.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:45.221 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:31:45.222+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:31:45.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:45.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:46.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:46.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:47.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:47.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:48.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:48.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:49.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:49.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:50.222 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:31:50.223+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:31:50.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:50.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:51.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:51.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:52.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:52.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:53.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:53.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:54.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:54.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:55.223 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:31:55.223+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:31:55.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:55.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:56.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:56.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:57.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:57.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:58.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:58.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:31:59.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:31:59.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:00.225 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:32:00.224+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:32:00.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:00.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:01.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:01.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:02.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:02.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:03.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:03.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:04.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:04.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:05.225 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:32:05.225+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:32:05.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:05.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:06.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:06.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:07.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:07.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:08.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:08.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:09.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:09.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:10.226 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:32:10.225+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:32:10.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:10.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:11.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:11.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:12.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:12.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:13.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:13.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:14.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:14.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:15.227 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:32:15.227+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:32:15.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:15.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:16.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:16.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:17.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:17.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:18.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:18.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:19.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:19.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:20.229 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:32:20.228+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:32:20.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:20.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:21.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:21.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:22.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:22.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:23.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:23.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:24.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:24.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:25.231 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:32:25.230+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:32:25.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:25.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:26.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:26.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:27.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:27.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:28.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:28.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:29.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:29.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:30.231 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:32:30.231+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:32:30.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:30.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:31.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:31.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:32.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:32.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:33.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:33.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:34.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:34.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:35.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:35.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:35.232 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:32:35.232+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:32:36.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:36.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:37.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:37.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:38.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:38.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:39.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:39.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:40.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:40.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:40.233 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:32:40.232+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:32:41.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:41.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:42.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:41.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:42.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:42.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:43.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:43.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:44.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:44.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:45.234 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:32:45.233+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:32:46.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:46.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:46.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:46.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:48.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:48.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:49.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:49.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:50.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:50.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:50.235 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:32:50.235+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:32:51.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:51.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:51.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:51.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:52.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:52.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:54.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:54.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:55.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:55.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:55.236 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:32:55.235+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:32:56.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:56.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:57.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:57.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:58.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:58.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:58.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:58.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:32:59.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:32:59.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:00.237 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:33:00.236+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:33:01.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:01.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:02.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:02.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:03.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:03.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:04.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:04.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:05.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:05.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:05.238 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:33:05.237+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:33:06.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:06.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:07.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:07.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:08.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:08.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:09.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:09.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:10.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:10.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:10.239 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:33:10.238+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:33:11.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:11.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:12.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:12.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:13.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:13.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:14.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:14.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:15.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:15.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:15.240 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:33:15.240+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:33:16.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:16.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:17.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:17.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:18.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:18.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:19.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:19.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:20.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:20.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:20.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:33:20.240+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:33:21.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:21.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:22.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:22.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:23.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:23.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:24.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:24.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:25.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:25.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:25.242 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:33:25.242+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:33:26.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:26.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:27.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:27.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:28.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:28.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:29.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:29.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:30.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:30.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:30.243 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:33:30.242+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:33:31.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:31.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:32.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:32.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:33.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:33.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:34.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:34.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:35.244 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:33:35.243+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:33:35.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:35.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:36.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:36.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:37.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:37.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:38.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:38.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:39.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:39.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:40.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:40.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:40.245 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:33:40.244+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:33:41.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:41.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:42.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:42.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:43.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:43.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:44.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:44.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:45.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:45.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:45.246 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:33:45.246+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:33:46.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:46.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:47.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:47.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:48.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:48.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:49.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:49.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:50.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:50.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:50.247 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:33:50.246+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:33:51.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:51.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:52.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:52.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:53.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:53.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:54.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:54.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:55.248 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:33:55.248+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:33:55.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:55.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:56.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:56.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:57.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:57.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:58.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:58.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:33:59.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:33:59.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:00.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:00.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:01.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:01.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:02.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:02.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:03.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:03.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:04.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:04.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:05.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:05.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:05.250 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:34:05.250+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:34:06.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:06.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:07.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:07.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:08.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:08.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:09.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:09.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:10.251 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:34:10.251+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:34:10.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:10.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:11.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:11.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:12.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:12.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:13.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:13.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:14.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:14.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:15.252 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:34:15.252+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:34:15.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:15.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:16.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:16.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:17.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:17.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:18.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:18.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:19.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:19.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:20.253 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:34:20.253+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:34:20.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:20.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:21.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:21.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:22.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:22.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:23.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:23.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:24.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:24.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:25.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:25.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:25.254 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:34:25.254+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:34:26.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:26.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:27.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:27.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:28.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:28.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:29.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:29.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:30.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:30.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:30.255 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:34:30.254+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:34:31.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:31.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:32.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:32.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:33.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:33.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:34.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:34.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:35.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:35.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:35.256 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:34:35.256+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:34:36.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:36.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:37.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:37.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:38.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:38.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:39.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:39.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:40.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:40.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:40.256 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:34:40.256+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:34:41.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:41.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:42.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:42.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:43.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:43.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:44.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:44.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:45.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:45.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:45.257 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:34:45.257+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:34:46.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:46.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:47.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:47.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:48.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:48.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:49.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:49.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:50.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:50.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:50.258 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:34:50.258+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:34:51.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:51.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:52.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:52.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:53.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:53.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:54.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:54.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:55.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:55.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:55.259 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:34:55.258+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:34:56.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:56.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:57.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:57.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:58.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:58.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:34:59.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:34:59.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:00.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:00.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:00.260 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:35:00.259+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:35:01.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:01.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:02.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:02.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:03.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:03.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:04.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:04.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:05.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:05.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:05.261 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:35:05.261+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:35:06.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:06.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:07.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:07.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:08.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:08.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:09.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:09.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:10.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:10.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:10.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:35:10.261+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:35:11.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:11.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:12.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:12.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:13.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:13.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:14.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:14.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:15.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:15.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:15.263 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:35:15.263+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:35:15.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:15.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:17.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:17.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:18.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:18.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:19.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:19.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:20.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:20.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:20.264 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:35:20.264+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:35:21.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:21.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:22.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:22.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:23.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:23.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:24.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:24.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:25.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:25.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:25.265 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:35:25.265+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:35:26.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:26.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:27.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:27.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:28.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:28.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:29.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:29.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:30.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:30.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:30.266 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:35:30.265+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:35:31.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:31.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:32.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:32.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:33.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:33.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:33.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:33.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:34.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:34.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:35.267 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:35:35.266+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:35:35.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:35.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:36.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:36.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:37.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:37.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:38.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:38.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:39.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:39.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:40.268 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:35:40.268+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:35:41.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:41.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:42.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:42.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:43.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:43.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:44.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:44.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:45.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:45.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:45.269 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:35:45.268+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:35:46.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:46.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:47.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:47.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:48.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:48.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:49.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:49.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:50.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:50.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:50.270 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:35:50.269+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:35:51.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:51.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:52.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:52.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:53.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:53.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:54.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:54.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:55.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:55.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:55.270 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:35:55.270+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:35:56.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:56.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:57.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:57.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:58.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:58.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:35:59.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:35:59.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:00.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:00.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:00.272 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:36:00.271+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:36:01.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:01.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:02.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:02.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:03.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:03.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:04.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:04.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:05.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:05.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:05.273 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:36:05.272+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:36:06.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:06.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:07.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:07.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:08.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:08.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:09.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:09.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:10.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:10.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:10.274 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:36:10.273+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:36:11.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:11.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:12.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:12.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:13.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:13.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:14.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:14.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:15.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:15.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:15.275 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:36:15.274+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:36:16.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:16.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:17.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:17.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:18.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:18.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:19.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:19.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:20.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:20.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:20.276 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:36:20.276+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:36:21.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:21.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:22.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:22.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:23.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:23.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:24.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:24.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:25.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:25.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:25.277 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:36:25.276+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:36:26.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:26.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:27.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:27.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:28.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:28.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:29.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:29.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:30.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:30.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:30.278 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:36:30.278+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:36:31.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:31.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:32.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:32.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:33.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:33.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:34.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:34.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:35.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:35.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:35.279 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:36:35.278+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:36:36.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:36.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:37.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:37.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:38.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:38.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:39.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:39.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:40.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:40.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:40.280 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:36:40.279+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:36:41.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:41.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:42.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:42.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:43.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:43.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:44.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:44.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:45.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:45.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:45.281 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:36:45.280+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:36:46.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:46.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:47.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:47.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:48.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:48.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:49.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:49.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:50.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:50.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:50.282 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:36:50.281+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:36:51.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:51.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:52.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:52.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:53.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:53.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:54.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:54.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:55.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:55.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:55.283 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:36:55.282+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:36:56.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:56.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:57.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:57.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:58.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:58.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:36:59.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:36:59.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:00.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:00.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:00.284 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:37:00.284+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:37:01.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:01.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:02.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:02.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:03.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:03.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:04.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:04.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:05.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:05.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:05.285 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:37:05.285+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:37:06.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:06.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:07.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:07.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:08.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:08.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:09.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:09.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:10.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:10.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:10.286 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:37:10.286+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:37:11.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:11.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:12.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:12.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:13.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:13.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:14.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:14.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:15.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:15.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:15.287 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:37:15.286+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:37:16.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:16.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:17.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:17.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:18.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:18.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:19.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:19.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:20.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:20.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:20.288 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:37:20.287+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:37:21.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:21.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:22.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:22.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:23.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:23.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:24.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:24.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:25.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:25.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:25.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:37:25.288+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:37:26.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:26.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:27.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:27.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:28.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:28.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:29.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:29.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:30.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:30.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:30.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:37:30.289+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:37:30.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:30.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:31.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:31.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:32.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:32.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:33.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:33.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:34.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:34.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:35.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:37:35.290+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:37:35.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:35.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:36.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:36.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:37.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:37.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:38.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:38.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:39.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:39.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:40.291 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:37:40.291+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:37:40.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:40.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:41.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:41.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:42.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:42.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:44.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:44.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:45.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:45.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:45.292 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:37:45.292+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:37:46.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:46.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:47.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:47.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:48.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:48.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:49.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:49.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:50.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:50.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:50.293 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:37:50.294+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:37:51.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:51.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:52.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:52.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:53.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:53.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:54.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:54.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:55.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:55.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:55.294 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:37:55.293+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:37:55.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:55.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:57.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:57.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:58.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:58.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:59.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:59.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:37:59.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:37:59.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:00.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:38:00.295+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:38:01.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:01.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:01.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:01.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:02.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:02.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:03.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:03.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:04.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:04.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:05.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:38:05.295+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:38:05.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:05.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:06.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:06.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:07.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:07.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:08.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:08.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:09.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:09.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:10.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:38:10.297+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:38:10.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:10.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:11.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:11.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:12.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:12.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:13.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:13.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:14.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:14.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:15.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:38:15.297+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:38:15.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:15.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:16.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:16.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:17.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:17.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:18.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:18.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:19.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:19.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:20.299 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:38:20.298+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:38:20.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:20.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:21.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:21.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:22.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:22.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:24.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:24.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:25.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:25.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:25.300 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:38:25.300+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:38:25.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:25.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:27.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:27.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:28.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:28.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:28.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:28.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:30.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:29.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:30.301 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:38:30.300+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:38:30.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:30.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:32.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:32.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:32.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:32.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:33.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:33.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:34.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:34.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:35.302 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:38:35.301+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:38:35.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:35.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:36.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:36.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:37.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:37.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:39.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:39.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:40.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:40.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:40.303 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:38:40.303+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:38:40.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:40.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:41.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:41.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:42.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:42.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:43.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:43.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:44.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:44.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:45.304 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:38:45.304+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:38:45.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:45.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:46.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:46.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:47.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:47.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:48.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:48.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:50.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:50.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:50.305 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:38:50.305+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:38:51.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:51.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:51.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:51.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:53.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:53.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:53.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:53.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:54.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:54.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:55.306 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:38:55.306+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:38:55.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:55.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:56.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:56.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:57.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:57.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:58.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:58.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:38:59.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:38:59.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:00.307 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:39:00.307+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:39:00.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:00.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:01.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:01.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:02.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:02.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:03.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:03.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:04.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:04.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:05.308 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:39:05.307+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:39:05.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:05.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:06.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:06.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:07.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:07.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:09.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:09.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:10.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:10.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:10.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:39:10.308+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:39:11.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:11.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:12.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:12.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:13.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:13.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:14.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:14.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:15.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:15.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:15.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:39:15.309+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:39:16.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:16.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:17.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:17.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:18.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:18.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:19.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:19.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:20.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:20.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:20.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:39:20.310+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:39:21.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:21.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:22.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:22.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:23.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:23.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:24.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:24.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:25.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:25.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:25.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:39:25.311+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:39:26.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:26.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:27.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:27.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:28.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:28.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:29.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:29.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:30.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:30.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:30.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:39:30.312+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:39:31.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:31.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:32.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:32.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:33.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:33.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:34.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:34.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:35.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:35.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:35.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:39:35.313+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:39:36.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:36.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:37.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:37.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:38.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:38.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:39.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:39.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:40.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:40.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:40.315 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:39:40.314+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:39:41.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:41.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:42.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:42.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:43.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:43.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:44.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:44.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:45.315 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:39:45.315+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:39:45.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:45.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:46.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:46.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:47.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:47.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:48.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:48.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:49.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:49.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:50.317 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:39:50.316+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:39:50.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:50.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:51.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:51.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:52.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:52.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:53.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:53.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:54.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:54.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:55.318 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:39:55.317+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:39:55.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:55.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:56.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:56.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:57.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:57.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:58.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:58.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:39:59.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:39:59.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:00.319 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:40:00.318+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:40:00.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:00.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:01.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:01.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:02.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:02.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:03.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:03.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:04.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:04.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:05.320 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:40:05.319+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:40:05.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:05.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:06.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:06.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:07.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:07.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:08.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:08.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:09.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:09.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:10.321 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:40:10.320+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:40:10.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:10.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:11.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:11.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:12.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:12.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:13.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:13.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:14.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:14.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:15.322 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:40:15.321+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:40:15.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:15.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:16.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:16.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:17.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:17.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:18.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:18.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:19.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:19.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:20.323 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:40:20.322+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:40:20.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:20.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:21.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:21.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:22.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:22.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:23.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:23.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:24.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:24.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:25.324 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:40:25.324+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:40:25.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:25.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:26.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:26.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:27.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:27.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:28.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:28.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:29.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:29.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:30.325 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:40:30.325+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:40:30.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:30.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:31.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:31.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:32.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:32.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:33.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:33.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:34.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:34.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:35.327 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:40:35.327+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:40:35.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:35.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:36.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:36.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:37.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:37.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:38.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:38.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:39.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:39.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:40.328 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:40:40.328+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:40:40.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:40.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:41.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:41.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:42.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:42.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:43.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:43.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:44.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:44.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:45.329 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:40:45.329+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:40:45.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:45.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:46.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:46.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:47.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:47.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:48.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:48.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:49.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:49.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:50.329 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:40:50.330+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:40:50.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:50.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:51.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:51.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:52.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:52.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:53.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:53.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:54.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:54.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:55.330 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:40:55.329+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:40:55.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:55.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:56.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:56.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:57.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:57.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:58.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:58.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:40:59.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:40:59.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:00.331 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:41:00.330+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:41:00.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:00.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:01.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:01.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:02.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:02.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:03.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:03.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:04.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:04.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:05.332 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:41:05.331+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:41:05.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:05.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:06.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:06.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:07.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:07.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:08.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:08.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:09.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:09.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:10.333 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:41:10.332+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:41:10.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:10.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:11.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:11.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:12.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:12.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:13.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:13.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:14.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:14.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:15.334 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:41:15.333+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:41:15.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:15.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:16.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:16.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:17.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:17.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:18.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:18.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:19.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:19.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:20.334 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:41:20.334+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:41:20.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:20.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:21.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:21.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:22.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:22.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:23.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:23.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:24.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:24.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:25.335 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:41:25.334+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:41:25.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:25.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:26.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:26.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:27.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:27.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:28.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:28.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:29.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:29.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:30.336 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:41:30.335+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:41:30.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:30.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:31.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:31.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:32.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:32.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:33.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:33.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:34.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:34.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:35.337 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:41:35.336+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:41:35.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:35.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:36.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:36.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:37.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:37.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:38.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:38.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:39.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:39.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:40.337 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:41:40.337+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:41:40.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:40.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:41.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:41.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:42.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:42.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:43.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:43.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:44.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:44.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:45.339 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:41:45.338+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:41:45.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:45.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:46.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:46.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:47.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:47.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:48.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:48.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:49.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:49.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:50.340 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:41:50.340+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:41:50.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:50.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:51.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:51.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:52.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:52.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:53.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:53.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:54.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:54.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:55.342 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:41:55.341+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:41:55.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:55.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:56.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:56.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:57.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:57.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:58.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:58.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:41:59.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:41:59.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:00.343 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:42:00.342+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:42:00.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:00.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:01.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:01.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:02.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:02.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:03.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:03.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:04.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:04.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:05.344 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:42:05.343+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:42:05.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:05.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:06.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:06.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:07.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:07.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:08.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:08.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:09.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:09.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:10.345 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:42:10.344+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:42:10.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:10.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:11.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:11.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:12.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:12.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:13.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:13.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:14.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:14.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:15.346 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:42:15.345+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:42:15.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:15.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:16.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:16.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:17.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:17.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:18.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:18.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:19.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:19.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:20.347 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:42:20.346+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:42:20.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:20.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:21.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:21.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:22.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:22.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:23.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:23.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:24.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:24.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:25.348 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:42:25.347+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:42:25.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:25.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:26.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:26.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:27.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:27.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:28.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:28.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:29.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:29.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:30.349 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:42:30.348+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:42:30.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:30.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:31.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:31.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:32.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:32.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:33.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:33.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:34.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:34.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:35.349 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:42:35.349+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:42:35.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:35.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:36.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:36.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:37.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:37.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:38.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:38.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:39.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:39.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:40.350 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:42:40.350+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:42:40.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:40.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:41.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:41.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:42.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:42.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:43.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:43.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:44.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:44.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:45.352 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:42:45.351+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:42:45.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:45.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:46.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:46.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:47.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:47.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:48.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:48.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:49.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:49.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:50.353 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:42:50.352+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:42:50.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:50.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:51.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:51.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:53.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:53.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:54.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:54.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:55.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:55.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:55.354 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:42:55.353+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:42:56.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:56.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:57.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:57.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:58.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:58.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:42:59.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:42:59.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:00.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:00.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:00.355 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:43:00.354+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:43:01.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:01.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:02.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:02.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:03.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:03.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:04.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:04.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:05.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:05.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:05.356 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:43:05.355+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:43:06.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:06.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:07.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:07.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:08.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:08.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:09.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:09.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:10.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:10.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:10.357 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:43:10.356+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:43:11.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:11.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:12.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:12.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:13.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:13.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:14.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:14.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:15.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:15.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:15.358 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:43:15.358+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:43:16.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:16.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:17.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:17.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:18.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:18.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:19.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:19.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:20.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:20.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:20.359 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:43:20.358+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:43:21.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:21.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:22.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:22.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:23.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:23.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:24.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:24.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:25.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:25.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:25.360 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:43:25.359+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:43:26.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:26.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:27.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:27.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:28.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:28.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:29.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:29.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:30.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:30.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:30.360 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:43:30.360+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:43:31.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:31.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:32.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:32.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:33.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:33.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:34.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:34.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:35.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:35.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:35.361 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:43:35.361+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:43:36.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:36.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:37.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:37.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:38.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:38.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:39.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:39.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:40.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:40.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:40.363 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:43:40.362+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:43:41.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:41.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:42.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:42.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:43.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:43.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:44.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:44.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:45.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:45.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:45.364 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:43:45.364+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:43:46.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:46.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:47.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:47.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:48.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:48.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:49.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:49.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:50.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:50.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:50.364 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:43:50.365+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:43:51.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:51.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:52.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:52.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:53.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:53.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:54.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:54.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:55.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:55.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:55.365 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:43:55.365+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:43:56.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:56.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:57.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:57.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:58.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:58.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:43:59.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:43:59.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:00.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:00.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:00.366 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:44:00.366+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:44:01.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:01.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:02.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:02.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:03.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:03.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:04.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:04.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:04.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:04.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:05.367 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:44:05.367+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:44:05.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:05.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:06.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:06.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:07.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:07.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:08.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:08.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:09.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:09.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:10.368 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:44:10.367+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:44:10.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:10.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:11.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:11.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:12.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:12.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:13.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:13.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:14.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:14.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:15.369 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:44:15.368+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:44:15.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:15.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:16.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:16.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:17.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:17.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:18.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:18.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:19.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:19.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:20.370 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:44:20.370+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:44:20.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:20.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:21.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:21.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:22.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:22.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:23.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:23.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:24.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:24.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:25.371 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:44:25.370+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:44:25.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:25.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:26.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:26.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:27.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:27.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:28.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:28.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:29.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:29.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:30.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:44:30.372+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:44:30.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:30.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:31.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:31.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:32.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:32.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:33.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:33.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:34.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:34.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:35.373 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:44:35.372+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:44:35.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:35.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:36.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:36.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:37.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:37.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:38.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:38.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:39.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:39.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:40.374 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:44:40.373+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:44:40.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:40.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:41.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:41.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:42.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:42.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:43.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:43.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:44.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:44.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:45.375 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:44:45.375+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:44:45.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:45.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:46.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:46.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:47.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:47.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:48.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:48.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:49.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:49.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:50.376 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:44:50.376+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:44:50.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:50.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:51.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:51.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:52.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:52.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:53.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:53.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:54.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:54.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:55.377 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:44:55.376+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:44:55.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:55.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:56.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:56.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:57.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:57.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:58.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:58.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:44:59.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:44:59.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:00.378 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:45:00.377+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:45:00.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:00.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:01.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:01.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:02.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:02.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:03.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:03.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:04.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:04.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:05.379 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:45:05.378+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:45:05.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:05.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:06.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:06.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:07.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:07.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:08.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:08.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:09.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:09.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:10.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:45:10.380+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:45:10.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:10.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:11.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:11.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:12.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:12.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:13.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:13.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:14.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:14.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:15.381 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:45:15.380+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:45:15.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:15.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:16.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:16.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:17.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:17.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:18.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:18.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:19.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:19.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:20.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:45:20.381+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:45:20.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:20.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:21.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:21.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:22.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:22.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:23.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:23.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:24.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:24.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:25.384 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:45:25.383+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:45:25.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:25.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:26.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:26.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:27.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:27.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:28.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:28.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:29.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:29.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:30.384 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:45:30.383+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:45:30.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:30.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:31.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:31.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:33.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:32.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:34.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:34.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:35.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:35.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:35.385 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:45:35.384+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:45:36.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:36.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:37.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:37.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:38.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:38.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:39.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:39.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:40.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:40.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:40.386 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:45:40.386+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:45:41.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:41.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:42.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:42.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:43.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:43.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:44.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:44.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:45.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:45.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:45.387 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:45:45.386+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:45:46.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:46.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:47.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:47.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:48.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:48.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:49.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:49.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:50.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:50.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:50.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:45:50.387+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:45:51.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:51.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:52.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:52.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:53.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:53.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:54.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:54.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:55.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:55.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:55.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:45:55.389+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:45:56.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:56.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:57.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:57.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:58.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:58.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:45:59.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:45:59.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:00.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:00.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:00.390 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:46:00.389+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:46:01.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:01.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:02.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:02.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:03.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:03.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:04.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:04.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:05.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:05.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:05.391 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:46:05.390+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:46:06.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:06.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:07.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:07.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:08.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:08.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:09.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:09.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:10.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:10.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:11.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:11.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:12.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:12.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:13.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:13.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:14.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:14.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:15.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:15.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:15.394 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:46:15.393+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:46:16.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:16.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:16.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:16.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:18.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:18.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:18.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:18.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:20.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:20.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:20.394 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:46:20.394+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:46:21.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:21.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:22.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:22.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:23.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:23.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:24.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:24.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:25.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:25.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:25.395 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:46:25.395+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:46:26.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:26.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:27.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:27.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:28.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:28.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:29.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:29.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:30.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:30.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:30.396 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:46:30.396+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:46:31.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:31.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:32.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:32.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:32.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:32.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:34.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:34.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:35.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:35.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:35.397 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:46:35.396+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:46:35.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:35.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:37.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:37.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:37.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:37.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:38.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:38.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:39.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:39.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:40.398 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:46:40.398+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:46:40.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:40.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:41.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:41.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:42.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:42.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:43.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:43.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:45.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:45.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:45.398 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:46:45.398+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:46:46.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:46.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:46.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:46.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:47.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:47.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:48.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:48.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:49.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:49.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:50.399 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:46:50.398+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:46:51.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:51.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:51.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:51.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:52.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:52.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:53.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:53.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:54.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:54.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:55.399 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:46:55.399+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:46:55.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:55.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:56.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:56.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:57.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:57.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:58.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:58.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:46:59.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:46:59.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:00.401 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:47:00.400+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:47:00.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:00.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:01.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:01.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:02.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:02.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:03.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:03.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:04.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:04.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:05.402 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:47:05.401+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:47:05.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:05.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:06.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:06.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:07.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:07.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:08.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:08.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:09.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:09.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:10.403 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:47:10.403+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:47:10.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:10.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:11.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:11.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:12.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:12.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:13.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:13.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:14.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:14.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:15.404 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:47:15.403+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:47:15.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:15.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:16.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:16.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:17.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:17.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:18.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:18.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:19.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:19.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:20.405 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:47:20.404+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:47:20.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:20.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:21.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:21.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:22.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:22.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:23.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:23.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:24.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:24.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:25.406 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:47:25.405+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:47:25.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:25.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:26.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:26.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:27.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:27.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:28.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:28.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:29.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:29.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:30.407 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:47:30.407+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:47:30.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:30.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:31.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:31.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:32.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:32.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:33.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:33.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:34.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:34.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:35.408 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:47:35.407+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:47:35.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:35.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:36.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:36.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:37.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:37.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:38.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:38.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:39.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:39.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:40.409 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:47:40.409+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:47:40.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:40.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:41.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:41.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:42.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:42.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:43.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:43.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:44.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:44.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:45.410 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:47:45.409+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:47:45.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:45.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:46.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:46.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:47.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:47.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:48.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:48.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:49.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:49.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:50.411 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:47:50.411+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:47:50.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:50.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:51.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:51.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:52.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:52.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:53.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:53.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:54.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:54.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:55.412 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:47:55.411+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:47:55.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:55.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:56.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:56.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:57.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:57.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:58.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:58.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:47:59.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:47:59.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:00.413 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:48:00.412+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:48:00.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:00.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:01.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:01.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:02.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:02.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:03.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:03.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:04.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:04.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:05.414 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:48:05.413+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:48:05.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:05.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:06.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:06.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:07.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:07.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:08.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:08.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:09.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:09.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:10.415 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:48:10.415+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:48:10.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:10.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:11.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:11.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:12.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:12.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:13.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:13.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:14.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:14.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:15.416 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:48:15.415+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:48:15.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:15.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:16.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:16.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:17.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:17.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:18.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:18.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:19.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:19.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:20.417 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:48:20.416+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:48:20.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:20.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:21.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:21.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:22.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:22.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:23.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:23.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:24.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:24.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:25.418 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:48:25.417+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:48:25.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:25.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:26.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:26.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:27.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:27.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:28.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:28.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:29.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:29.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:30.419 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:48:30.418+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:48:30.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:30.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:31.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:31.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:32.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:32.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:33.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:33.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:34.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:34.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:35.420 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:48:35.419+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:48:35.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:35.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:36.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:36.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:37.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:37.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:38.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:38.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:39.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:39.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:40.421 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:48:40.420+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:48:40.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:40.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:41.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:41.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:42.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:42.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:43.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:43.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:44.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:44.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:45.422 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:48:45.421+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:48:45.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:45.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:46.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:46.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:47.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:47.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:48.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:48.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:49.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:49.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:50.422 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:48:50.422+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:48:50.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:50.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:51.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:51.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:52.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:52.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:53.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:53.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:54.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:54.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:55.423 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:48:55.423+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:48:55.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:55.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:56.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:56.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:57.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:57.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:58.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:58.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:48:59.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:48:59.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:00.424 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:49:00.424+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:49:00.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:00.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:01.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:01.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:02.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:02.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:03.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:03.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:04.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:04.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:05.426 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:49:05.425+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:49:05.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:05.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:06.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:06.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:07.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:07.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:08.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:08.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:09.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:09.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:10.427 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:49:10.426+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:49:10.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:10.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:11.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:11.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:12.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:12.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:13.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:13.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:14.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:14.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:15.428 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:49:15.427+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:49:15.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:15.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:16.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:16.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:17.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:17.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:18.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:18.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:19.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:19.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:20.428 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:49:20.428+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:49:20.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:20.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:21.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:21.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:22.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:22.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:23.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:23.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:24.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:24.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:25.429 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:49:25.428+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:49:25.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:25.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:26.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:26.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:27.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:27.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:28.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:28.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:29.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:29.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:30.430 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:49:30.430+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:49:30.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:30.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:31.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:31.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:32.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:32.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:33.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:33.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:34.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:34.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:35.431 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:49:35.431+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:49:35.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:35.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:36.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:36.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:37.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:37.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:38.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:38.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:39.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:39.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:40.432 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:49:40.432+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:49:40.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:40.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:41.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:41.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:42.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:42.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:43.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:43.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:44.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:44.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:45.433 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:49:45.434+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:49:45.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:45.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:46.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:46.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:47.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:47.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:48.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:48.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:49.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:49.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:50.434 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:49:50.433+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:49:50.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:50.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:51.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:51.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:52.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:52.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:53.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:53.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:54.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:54.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:55.435 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:49:55.434+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:49:55.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:55.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:56.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:56.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:57.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:57.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:58.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:58.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:49:59.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:49:59.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:00.435 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:50:00.435+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:50:00.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:00.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:01.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:01.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:02.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:02.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:03.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:03.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:04.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:04.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:05.436 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:50:05.436+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:50:05.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:05.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:06.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:06.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:07.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:07.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:08.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:08.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:09.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:09.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:10.438 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:50:10.437+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:50:10.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:10.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:11.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:11.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:12.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:12.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:13.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:13.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:14.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:14.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:15.439 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:50:15.438+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:50:15.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:15.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:16.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:16.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:17.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:17.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:18.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:18.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:19.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:19.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:20.440 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:50:20.439+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:50:20.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:20.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:21.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:21.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:22.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:22.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:23.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:23.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:24.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:24.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:25.441 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:50:25.441+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:50:25.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:25.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:26.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:26.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:27.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:27.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:28.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:28.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:29.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:29.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:30.442 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:50:30.442+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:50:30.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:30.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:31.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:31.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:32.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:32.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:33.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:33.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:34.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:34.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:35.443 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:50:35.442+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:50:35.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:35.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:36.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:36.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:37.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:37.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:38.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:38.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:39.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:39.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:40.444 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:50:40.443+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:50:40.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:40.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:41.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:41.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:42.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:42.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:43.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:43.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:45.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:45.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:45.445 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:50:45.445+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:50:46.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:46.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:47.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:46.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:47.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:47.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:48.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:48.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:50.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:50.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:50.446 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:50:50.445+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:50:51.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:51.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:52.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:52.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:53.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:53.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:53.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:53.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:54.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:54.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:55.447 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:50:55.447+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:50:55.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:55.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:56.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:56.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:57.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:57.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:58.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:58.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:50:59.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:50:59.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:00.448 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:51:00.448+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:51:00.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:00.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:01.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:01.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:02.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:02.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:04.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:04.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:04.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:04.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:05.449 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:51:05.448+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:51:06.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:06.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:06.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:06.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:07.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:07.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:08.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:08.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:09.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:09.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:10.450 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:51:10.450+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:51:10.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:10.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:11.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:11.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:12.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:12.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:14.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:14.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:15.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:15.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:15.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:51:15.450+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:51:16.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:16.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:17.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:17.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:18.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:18.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:19.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:19.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:20.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:20.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:20.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:51:20.451+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:51:21.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:21.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:22.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:22.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:23.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:23.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:24.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:24.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:25.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:25.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:25.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:51:25.452+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:51:26.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:26.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:27.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:27.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:28.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:28.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:29.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:29.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:30.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:30.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:30.453 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:51:30.453+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:51:31.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:31.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:32.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:32.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:33.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:33.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:34.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:34.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:35.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:35.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:35.455 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:51:35.454+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:51:36.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:36.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:37.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:37.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:38.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:38.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:39.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:39.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:40.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:40.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:40.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:51:40.455+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:51:41.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:41.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:42.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:42.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:43.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:43.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:44.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:44.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:45.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:45.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:45.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:51:45.456+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:51:46.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:46.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:47.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:47.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:48.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:48.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:49.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:49.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:50.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:50.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:50.457 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:51:50.456+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:51:51.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:51.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:52.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:52.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:53.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:53.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:54.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:54.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:55.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:55.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:55.458 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:51:55.457+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:51:56.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:56.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:57.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:57.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:58.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:58.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:51:59.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:51:59.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:00.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:00.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:00.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:52:00.458+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:52:01.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:01.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:02.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:02.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:03.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:03.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:04.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:04.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:05.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:05.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:05.460 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:52:05.459+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:52:06.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:06.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:07.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:07.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:08.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:08.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:09.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:09.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:10.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:10.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:10.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:52:10.460+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:52:11.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:11.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:12.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:12.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:13.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:13.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:14.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:14.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:15.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:15.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:15.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:52:15.461+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:52:16.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:16.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:17.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:17.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:18.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:18.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:19.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:19.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:20.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:20.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:20.462 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:52:20.462+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:52:21.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:21.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:22.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:22.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:23.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:23.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:24.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:24.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:25.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:25.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:25.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:52:25.462+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:52:26.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:26.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:27.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:27.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:28.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:28.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:29.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:29.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:30.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:30.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:30.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:52:30.464+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:52:31.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:31.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:32.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:32.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:33.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:33.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:34.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:34.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:35.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:35.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:35.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:52:35.465+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:52:36.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:36.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:37.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:37.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:38.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:38.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:39.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:39.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:40.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:40.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:40.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:52:40.466+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:52:41.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:41.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:42.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:42.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:43.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:43.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:44.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:44.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:45.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:45.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:45.467 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:52:45.467+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:52:46.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:46.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:47.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:47.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:48.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:48.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:49.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:49.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:50.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:50.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:50.468 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:52:50.468+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:52:51.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:51.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:52.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:52.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:53.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:53.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:54.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:54.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:55.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:55.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:55.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:52:55.469+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:52:56.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:56.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:57.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:57.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:58.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:58.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:52:59.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:52:59.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:00.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:00.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:00.470 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:53:00.470+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:53:01.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:01.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:02.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:02.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:03.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:03.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:04.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:04.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:05.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:05.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:05.471 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:53:05.471+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:53:06.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:06.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:07.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:07.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:08.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:08.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:09.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:09.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:10.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:10.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:10.472 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:53:10.472+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:53:11.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:11.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:12.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:12.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:13.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:13.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:14.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:14.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:15.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:15.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:15.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:53:15.474+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:53:16.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:16.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:17.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:17.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:18.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:18.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:19.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:19.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:20.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:20.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:20.475 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:53:20.474+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:53:21.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:21.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:22.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:22.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:23.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:23.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:24.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:24.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:25.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:53:25.475+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:53:25.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:25.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:26.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:26.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:27.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:27.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:28.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:28.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:29.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:29.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:30.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:53:30.476+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:53:30.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:30.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:31.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:31.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:32.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:32.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:33.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:33.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:34.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:34.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:35.478 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:53:35.477+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:53:35.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:35.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:36.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:36.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:37.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:37.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:38.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:38.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:39.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:39.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:40.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:53:40.479+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:53:40.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:40.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:41.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:41.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:42.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:42.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:43.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:43.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:44.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:44.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:45.480 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:53:45.480+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:53:45.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:45.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:46.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:46.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:47.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:47.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:48.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:48.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:49.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:49.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:50.481 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:53:50.481+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:53:50.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:50.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:51.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:51.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:52.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:52.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:53.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:53.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:54.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:54.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:55.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:53:55.482+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:53:55.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:55.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:56.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:56.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:57.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:57.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:58.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:58.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:53:59.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:53:59.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:00.484 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:54:00.484+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:54:00.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:00.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:01.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:01.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:02.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:02.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:03.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:03.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:04.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:04.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:05.485 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:54:05.485+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:54:05.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:05.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:06.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:06.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:07.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:07.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:08.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:08.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:09.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:09.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:10.486 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:54:10.486+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:54:10.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:10.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:11.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:11.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:12.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:12.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:13.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:13.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:14.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:14.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:15.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:54:15.487+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:54:15.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:15.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:16.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:16.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:17.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:17.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:18.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:18.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:19.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:19.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:20.488 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:54:20.488+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:54:20.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:20.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:21.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:21.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:22.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:22.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:23.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:23.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:24.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:24.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:25.488 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:54:25.488+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:54:25.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:25.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:26.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:26.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:27.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:27.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:28.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:28.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:29.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:29.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:30.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:54:30.489+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:54:30.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:30.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:31.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:31.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:32.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:32.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:33.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:33.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:34.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:34.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:35.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:54:35.491+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:54:35.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:35.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:36.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:36.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:37.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:37.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:38.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:38.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:39.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:39.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:40.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:54:40.493+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:54:40.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:40.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:41.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:41.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:42.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:42.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:43.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:43.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:44.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:44.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:45.493 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:54:45.494+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:54:45.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:45.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:46.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:46.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:47.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:47.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:48.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:48.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:49.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:49.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:50.494 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:54:50.494+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:54:50.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:50.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:51.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:51.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:52.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:52.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:53.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:53.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:54.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:54.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:55.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:54:55.495+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:54:55.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:55.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:56.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:56.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:57.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:57.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:58.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:58.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:54:59.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:54:59.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:00.496 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:55:00.496+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:55:00.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:00.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:01.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:01.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:02.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:02.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:03.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:03.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:04.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:04.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:05.497 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:55:05.497+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:55:05.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:05.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:06.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:06.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:07.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:07.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:08.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:08.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:09.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:09.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:10.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:55:10.499+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:55:10.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:10.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:11.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:11.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:12.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:12.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:13.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:13.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:14.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:14.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:15.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:55:15.500+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:55:15.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:15.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:16.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:16.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:17.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:17.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:18.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:18.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:19.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:19.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:20.501 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:55:20.501+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:55:20.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:20.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:21.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:21.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:22.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:22.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:23.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:23.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:24.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:24.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:25.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:55:25.502+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:55:25.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:25.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:26.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:26.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:27.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:27.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:28.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:28.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:29.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:29.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:30.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:55:30.503+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:55:30.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:30.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:31.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:31.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:32.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:32.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:33.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:33.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:34.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:34.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:35.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:55:35.504+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:55:35.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:35.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:36.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:36.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:37.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:37.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:38.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:38.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:39.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:39.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:40.505 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:55:40.505+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:55:40.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:40.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:41.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:41.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:42.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:42.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:43.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:43.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:44.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:44.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:45.506 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:55:45.506+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:55:45.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:45.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:46.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:46.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:47.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:47.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:48.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:48.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:49.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:49.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:50.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:50.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:50.507 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:55:50.507+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:55:51.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:51.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:52.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:52.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:53.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:53.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:54.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:54.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:55.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:55.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:55.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:55:55.509+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:55:56.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:56.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:57.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:57.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:58.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:58.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:55:59.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:55:59.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:00.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:00.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:00.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:56:00.510+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:56:01.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:01.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:02.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:02.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:03.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:03.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:04.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:04.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:05.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:05.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:05.510 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:56:05.511+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:56:06.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:06.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:07.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:07.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:08.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:08.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:09.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:09.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:10.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:10.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:10.511 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:56:10.512+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:56:11.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:11.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:12.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:12.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:13.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:13.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:14.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:14.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:15.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:15.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:15.513 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:56:15.513+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:56:16.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:16.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:17.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:17.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:18.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:18.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:19.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:19.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:20.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:20.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:20.514 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:56:20.514+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:56:21.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:21.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:22.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:22.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:23.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:23.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:24.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:24.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:25.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:25.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:25.515 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:56:25.515+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:56:26.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:26.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:27.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:27.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:28.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:28.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:29.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:29.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:30.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:30.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:30.516 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:56:30.516+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:56:31.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:31.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:32.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:32.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:33.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:33.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:34.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:34.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:35.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:35.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:35.517 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:56:35.517+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:56:36.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:36.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:37.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:37.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:38.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:38.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:39.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:39.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:40.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:40.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:40.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:56:40.519+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:56:41.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:41.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:42.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:42.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:43.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:43.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:44.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:44.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:45.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:45.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:45.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:56:45.520+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:56:46.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:46.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:47.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:47.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:48.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:48.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:49.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:49.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:50.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:50.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:50.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:56:50.521+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:56:51.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:51.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:52.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:52.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:53.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:53.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:54.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:54.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:55.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:55.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:55.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:56:55.523+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:56:56.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:56.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:57.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:57.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:58.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:58.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:56:59.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:56:59.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:00.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:00.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:00.524 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:57:00.524+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:57:01.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:01.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:02.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:02.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:03.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:03.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:04.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:04.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:05.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:05.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:05.525 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:57:05.525+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:57:06.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:06.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:07.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:07.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:08.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:08.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:09.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:09.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:10.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:10.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:10.526 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:57:10.526+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:57:11.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:11.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:11.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:11.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:12.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:12.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:14.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:14.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:15.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:15.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:15.527 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:57:15.528+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:57:16.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:16.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:17.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:17.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:18.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:18.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:19.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:19.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:20.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:20.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:20.529 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:57:20.529+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:57:21.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:21.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:22.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:22.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:23.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:23.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:24.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:24.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:25.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:25.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:25.529 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:57:25.530+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:57:26.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:26.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:27.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:27.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:28.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:28.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:29.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:29.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:30.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:30.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:30.530 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:57:30.531+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:57:31.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:31.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:32.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:32.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:33.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:33.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:34.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:34.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:35.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:35.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:35.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:57:35.532+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:57:36.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:36.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:37.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:37.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:38.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:38.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:39.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:39.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:40.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:40.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:40.533 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:57:40.533+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:57:41.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:41.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:42.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:42.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:43.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:43.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:44.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:44.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:45.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:45.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:45.534 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:57:45.535+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:57:46.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:46.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:47.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:47.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:48.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:48.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:49.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:49.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:50.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:50.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:50.535 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:57:50.536+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:57:51.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:51.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:52.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:52.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:53.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:53.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:54.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:54.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:55.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:55.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:55.536 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:57:55.537+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:57:55.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:55.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:56.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:56.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:58.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:58.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:57:59.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:57:59.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:00.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:00.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:00.537 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:58:00.538+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:58:00.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:00.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:01.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:01.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:03.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:03.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:03.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:03.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:04.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:04.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:05.539 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:58:05.540+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:58:05.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:05.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:06.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:06.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:07.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:07.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:08.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:08.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:09.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:09.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:10.540 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:58:10.542+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:58:10.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:10.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:12.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:12.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:13.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:13.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:14.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:14.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:15.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:15.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:15.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:58:15.543+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:58:16.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:16.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:17.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:17.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:18.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:18.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:18.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:18.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:19.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:19.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:20.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:58:20.544+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:58:20.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:20.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:21.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:21.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:22.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:22.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:23.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:23.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:24.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:24.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:25.544 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:58:25.544+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:58:25.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:25.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:26.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:26.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:27.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:27.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:28.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:28.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:29.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:29.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:30.545 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:58:30.545+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:58:30.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:30.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:31.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:31.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:32.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:32.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:33.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:33.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:34.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:34.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:35.546 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:58:35.546+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:58:35.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:35.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:36.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:36.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:37.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:37.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:38.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:38.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:39.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:39.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:40.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:58:40.547+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:58:40.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:40.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:41.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:41.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:42.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:42.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:43.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:43.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:44.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:44.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:45.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:58:45.548+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:58:45.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:45.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:46.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:46.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:47.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:47.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:48.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:48.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:49.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:49.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:50.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:58:50.549+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:58:50.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:50.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:51.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:51.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:52.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:52.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:53.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:53.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:54.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:54.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:55.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:58:55.550+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:58:55.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:55.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:56.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:56.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:57.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:57.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:58.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:58.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:58:59.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:58:59.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:00.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:59:00.551+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:59:00.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:00.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:01.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:01.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:02.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:02.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:03.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:03.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:04.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:04.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:05.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:59:05.552+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:59:05.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:05.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:06.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:06.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:07.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:07.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:08.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:08.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:09.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:09.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:10.553 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:59:10.553+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:59:10.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:10.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:11.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:11.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:12.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:12.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:13.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:13.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:14.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:14.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:15.554 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:59:15.554+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:59:15.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:15.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:16.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:16.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:17.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:17.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:18.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:18.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:19.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:19.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:20.555 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:59:20.556+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:59:20.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:20.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:21.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:21.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:22.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:22.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:23.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:23.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:24.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:24.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:25.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:25.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:25.556 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:59:25.557+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:59:26.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:26.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:27.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:27.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:28.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:28.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:29.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:29.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:30.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:30.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:30.557 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:59:30.558+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:59:31.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:31.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:32.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:32.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:33.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:33.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:34.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:34.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:35.559 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:59:35.559+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:59:35.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:35.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:36.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:36.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:37.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:37.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:38.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:38.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:39.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:39.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:40.560 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:59:40.560+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:59:40.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:40.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:41.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:41.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:42.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:42.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:43.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:43.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:44.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:44.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:45.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:59:45.561+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:59:45.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:45.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:46.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:46.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:47.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:47.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:48.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:48.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:49.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:49.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:50.562 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:59:50.562+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:59:50.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:50.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:51.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:51.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:52.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:52.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:53.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:53.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:54.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:54.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:55.563 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T10:59:55.563+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T10:59:55.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:55.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:56.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:56.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:57.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:57.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:58.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:58.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T10:59:59.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T10:59:59.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:00.564 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:00:00.564+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:00:00.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:00.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:01.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:01.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:02.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:02.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:03.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:03.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:04.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:04.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:05.565 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:00:05.566+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:00:05.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:05.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:06.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:06.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:07.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:07.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:08.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:08.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:09.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:09.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:10.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:00:10.567+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:00:10.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:10.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:11.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:11.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:12.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:12.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:13.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:13.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:14.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:14.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:15.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:00:15.568+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:00:15.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:15.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:16.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:16.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:17.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:17.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:18.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:18.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:19.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:19.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:20.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:00:20.569+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:00:20.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:20.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:21.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:21.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:22.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:22.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:23.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:23.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:24.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:24.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:25.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:00:25.570+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:00:25.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:25.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:26.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:26.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:27.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:27.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:28.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:28.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:29.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:29.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:30.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:00:30.571+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:00:30.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:30.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:31.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:31.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:32.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:32.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:33.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:33.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:34.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:34.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:35.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:00:35.572+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:00:35.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:35.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:36.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:36.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:37.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:37.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:38.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:38.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:39.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:39.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:40.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:00:40.573+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:00:40.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:40.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:41.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:41.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:42.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:42.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:43.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:43.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:44.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:44.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:45.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:00:45.573+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:00:45.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:45.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:46.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:46.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:47.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:47.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:48.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:48.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:49.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:49.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:50.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:00:50.574+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:00:50.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:50.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:51.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:51.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:52.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:52.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:53.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:53.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:54.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:54.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:55.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:00:55.575+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:00:55.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:55.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:56.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:56.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:57.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:57.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:58.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:58.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:00:59.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:00:59.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:00.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:01:00.577+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:01:00.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:00.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:01.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:01.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:02.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:02.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:03.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:03.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:04.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:04.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:05.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:01:05.578+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:01:05.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:05.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:06.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:06.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:07.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:07.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:08.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:08.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:09.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:09.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:10.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:01:10.579+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:01:10.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:10.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:11.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:11.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:12.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:12.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:13.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:13.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:14.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:14.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:15.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:01:15.582+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:01:15.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:15.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:16.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:16.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:17.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:17.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:18.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:18.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:19.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:19.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:20.582 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:01:20.583+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:01:20.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:20.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:21.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:21.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:22.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:22.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:23.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:23.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:24.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:24.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:25.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:01:25.584+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:01:25.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:25.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:26.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:26.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:27.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:27.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:28.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:28.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:29.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:29.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:30.585 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:01:30.587+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:01:30.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:30.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:31.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:31.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:32.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:32.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:33.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:33.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:34.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:34.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:35.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:01:35.588+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:01:35.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:35.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:36.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:36.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:37.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:37.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:38.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:38.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:39.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:39.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:40.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:01:40.588+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:01:40.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:40.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:41.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:41.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:42.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:42.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:43.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:43.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:44.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:44.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:45.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:01:45.590+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:01:45.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:45.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:46.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:46.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:47.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:47.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:48.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:48.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:49.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:49.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:50.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:01:50.592+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:01:50.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:50.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:51.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:51.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:52.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:52.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:53.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:53.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:54.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:54.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:55.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:01:55.593+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:01:55.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:55.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:56.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:56.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:57.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:57.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:58.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:58.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:01:59.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:01:59.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:00.594 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:02:00.594+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:02:00.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:00.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:01.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:01.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:02.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:02.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:03.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:03.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:04.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:04.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:05.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:02:05.595+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:02:05.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:05.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:06.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:06.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:07.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:07.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:08.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:08.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:09.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:09.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:10.597 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:02:10.597+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:02:10.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:10.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:11.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:11.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:12.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:12.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:13.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:13.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:14.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:14.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:15.597 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:02:15.598+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:02:15.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:15.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:16.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:16.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:17.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:17.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:18.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:18.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:19.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:19.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:20.598 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:02:20.599+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:02:20.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:20.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:21.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:21.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:22.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:22.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:23.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:23.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:24.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:24.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:25.600 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:02:25.600+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:02:25.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:25.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:26.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:26.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:27.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:27.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:28.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:28.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:29.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:29.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:30.601 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:02:30.602+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:02:30.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:30.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:31.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:31.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:32.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:32.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:33.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:33.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:34.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:34.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:35.603 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:02:35.603+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:02:35.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:35.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:36.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:36.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:37.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:37.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:38.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:38.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:39.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:39.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:40.605 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:02:40.605+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:02:40.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:40.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:41.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:41.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:42.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:42.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:43.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:43.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:44.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:44.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:45.606 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:02:45.606+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:02:45.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:45.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:46.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:46.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:47.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:47.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:48.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:48.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:49.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:49.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:50.607 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:02:50.607+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:02:50.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:50.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:51.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:51.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:52.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:52.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:53.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:53.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:54.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:54.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:55.608 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:02:55.608+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:02:55.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:55.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:56.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:56.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:57.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:57.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:58.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:58.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:02:59.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:02:59.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:00.609 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:03:00.609+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:03:00.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:00.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:01.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:01.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:02.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:02.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:03.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:03.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:04.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:04.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:05.610 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:03:05.610+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:03:05.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:05.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:06.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:06.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:07.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:07.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:08.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:08.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:09.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:09.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:10.611 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:03:10.611+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:03:10.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:10.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:11.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:11.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:12.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:12.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:13.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:13.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:14.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:14.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:15.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:03:15.612+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:03:15.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:15.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:16.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:16.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:17.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:17.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:18.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:18.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:19.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:19.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:20.613 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:03:20.613+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:03:20.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:20.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:21.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:21.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:22.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:22.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:23.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:23.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:24.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:24.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:25.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:03:25.614+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:03:25.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:25.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:26.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:26.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:27.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:27.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:28.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:28.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:29.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:29.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:30.615 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:03:30.615+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:03:30.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:30.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:31.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:31.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:32.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:32.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:33.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:33.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:34.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:34.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:35.616 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:03:35.616+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:03:35.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:35.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:36.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:36.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:37.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:37.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:38.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:38.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:39.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:39.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:40.617 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:03:40.617+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:03:40.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:40.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:41.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:41.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:42.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:42.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:43.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:43.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:44.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:44.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:45.618 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:03:45.618+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:03:45.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:45.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:46.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:46.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:47.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:47.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:48.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:48.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:49.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:49.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:50.619 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:03:50.619+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:03:50.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:50.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:51.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:51.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:52.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:52.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:53.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:53.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:54.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:54.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:55.620 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:03:55.620+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:03:55.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:55.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:56.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:56.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:57.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:57.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:58.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:58.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:03:59.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:03:59.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:00.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:00.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:00.621 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:04:00.621+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:04:01.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:01.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:02.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:02.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:03.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:03.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:04.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:04.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:05.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:05.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:05.622 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:04:05.622+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:04:06.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:06.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:07.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:07.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:08.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:08.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:09.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:09.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:10.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:10.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:11.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:11.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:12.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:12.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:13.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:13.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:14.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:14.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:15.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:04:15.595+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:04:15.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:15.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:16.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:16.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:17.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:17.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:18.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:18.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:19.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:19.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:20.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:04:20.596+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:04:20.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:20.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:21.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:21.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:22.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:22.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:23.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:23.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:24.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:24.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:25.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:04:25.596+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:04:25.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:25.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:26.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:26.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:27.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:27.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:28.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:28.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:29.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:29.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:30.597 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:04:30.597+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:04:30.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:30.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:31.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:31.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:32.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:32.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:33.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:33.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:34.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:34.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:35.597 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:04:35.599+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:04:35.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:35.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:36.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:36.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:37.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:37.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:38.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:38.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:39.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:39.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:40.598 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:04:40.600+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:04:40.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:40.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:41.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:41.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:42.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:42.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:43.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:43.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:44.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:44.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:45.599 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:04:45.600+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:04:45.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:45.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:46.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:46.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:48.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:48.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:49.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:49.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:50.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:50.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:50.600 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:04:50.600+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:04:51.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:51.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:52.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:52.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:53.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:53.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:54.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:54.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:55.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:55.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:55.601 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:04:55.601+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:04:56.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:56.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:57.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:57.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:58.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:58.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:04:59.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:04:59.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:00.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:00.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:00.602 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:05:00.602+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:05:01.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:01.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:02.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:02.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:03.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:03.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:04.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:04.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:05.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:05.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:05.603 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:05:05.603+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:05:06.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:06.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:07.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:07.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:08.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:08.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:09.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:09.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:10.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:10.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:10.604 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:05:10.604+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:05:11.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:11.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:12.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:12.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:13.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:13.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:14.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:14.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:15.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:15.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:15.605 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:05:15.605+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:05:16.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:16.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:17.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:17.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:18.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:18.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:19.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:19.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:20.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:20.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:20.606 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:05:20.606+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:05:21.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:21.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:22.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:22.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:23.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:23.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:24.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:24.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:25.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:25.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:25.607 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:05:25.607+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:05:26.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:26.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:27.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:27.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:28.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:28.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:29.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:29.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:30.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:30.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:30.607 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:05:30.608+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:05:31.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:31.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:32.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:32.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:33.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:33.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:34.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:34.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:35.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:35.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:35.608 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:05:35.608+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:05:36.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:36.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:37.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:37.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:38.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:38.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:39.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:39.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:40.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:40.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:40.609 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:05:40.609+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:05:41.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:41.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:42.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:42.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:43.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:43.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:44.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:44.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:45.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:45.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:45.609 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:05:45.610+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:05:46.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:46.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:47.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:47.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:48.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:48.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:49.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:49.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:50.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:50.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:50.610 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:05:50.610+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:05:51.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:51.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:52.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:52.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:53.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:53.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:54.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:54.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:55.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:55.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:55.611 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:05:55.611+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:05:56.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:56.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:57.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:57.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:58.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:58.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:05:59.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:05:59.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:00.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:00.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:00.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:06:00.612+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:06:01.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:01.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:02.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:02.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:03.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:03.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:04.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:04.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:05.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:05.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:05.613 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:06:05.614+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:06:06.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:06.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:07.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:07.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:08.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:08.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:09.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:09.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:10.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:10.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:10.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:06:10.614+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:06:11.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:11.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:12.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:12.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:13.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:13.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:14.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:14.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:15.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:15.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:15.615 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:06:15.615+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:06:16.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:16.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:17.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:17.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:18.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:18.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:19.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:19.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:20.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:20.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:20.616 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:06:20.616+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:06:21.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:21.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:22.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:22.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:23.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:23.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:24.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:24.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:25.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:25.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:25.617 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:06:25.617+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:06:26.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:26.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:27.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:27.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:28.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:28.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:29.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:29.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:30.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:30.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:30.618 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:06:30.619+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:06:31.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:31.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:32.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:32.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:33.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:33.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:34.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:34.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:35.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:35.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:35.619 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:06:35.620+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:06:36.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:36.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:37.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:37.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:38.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:38.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:39.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:39.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:40.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:40.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:40.622 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:06:40.622+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:06:41.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:41.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:42.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:42.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:43.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:43.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:44.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:44.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:45.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:45.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:45.623 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:06:45.623+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:06:46.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:46.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:47.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:47.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:48.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:48.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:49.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:49.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:50.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:50.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:50.624 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:06:50.624+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:06:51.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:51.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:52.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:52.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:53.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:53.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:54.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:54.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:55.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:55.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:55.625 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:06:55.625+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:06:56.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:56.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:57.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:57.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:58.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:58.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:06:59.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:06:59.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:00.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:00.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:00.626 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:07:00.626+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:07:01.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:01.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:02.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:02.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:03.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:03.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:04.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:04.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:05.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:05.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:05.627 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:07:05.627+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:07:06.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:06.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:07.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:07.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:08.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:08.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:09.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:09.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:10.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:10.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:10.628 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:07:10.628+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:07:11.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:11.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:12.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:12.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:13.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:13.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:14.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:14.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:15.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:15.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:15.629 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:07:15.629+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:07:16.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:16.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:17.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:17.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:18.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:18.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:19.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:19.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:20.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:20.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:20.630 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:07:20.630+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:07:21.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:21.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:22.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:22.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:23.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:23.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:24.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:24.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:25.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:25.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:25.631 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:07:25.632+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:07:26.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:26.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:27.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:27.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:28.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:28.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:29.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:29.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:30.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:30.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:30.632 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:07:30.633+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:07:31.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:31.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:32.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:32.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:33.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:33.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:34.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:34.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:35.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:35.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:35.633 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:07:35.633+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:07:36.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:36.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:37.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:37.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:38.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:38.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:39.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:39.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:40.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:40.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:40.634 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:07:40.635+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:07:41.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:41.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:42.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:42.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:43.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:43.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:44.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:44.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:45.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:45.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:45.634 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:07:45.636+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:07:46.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:46.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:47.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:47.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:48.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:48.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:49.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:49.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:50.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:50.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:50.635 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:07:50.635+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:07:51.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:51.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:52.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:52.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:53.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:53.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:54.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:54.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:55.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:55.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:55.636 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:07:55.637+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:07:56.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:56.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:57.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:57.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:58.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:58.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:07:59.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:07:59.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:00.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:00.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:00.637 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:08:00.637+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:08:01.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:01.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:02.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:02.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:03.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:03.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:04.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:04.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:05.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:05.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:05.638 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:08:05.639+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:08:06.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:06.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:07.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:07.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:08.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:08.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:09.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:09.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:10.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:10.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:10.639 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:08:10.640+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:08:11.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:11.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:12.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:12.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:13.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:13.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:14.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:14.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:15.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:15.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:15.640 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:08:15.640+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:08:16.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:16.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:17.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:17.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:18.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:18.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:19.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:19.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:20.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:20.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:20.641 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:08:20.641+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:08:21.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:21.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:22.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:22.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:23.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:23.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:24.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:24.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:25.642 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:08:25.642+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:08:25.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:25.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:26.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:26.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:27.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:27.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:28.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:28.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:29.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:29.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:30.643 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:08:30.643+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:08:30.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:30.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:31.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:31.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:32.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:32.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:33.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:33.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:34.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:34.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:35.644 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:08:35.644+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:08:35.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:35.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:36.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:36.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:37.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:37.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:38.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:38.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:39.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:39.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:40.645 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:08:40.645+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:08:40.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:40.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:41.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:41.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:42.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:42.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:43.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:43.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:44.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:44.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:45.646 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:08:45.646+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:08:46.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:46.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:46.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:46.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:47.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:47.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:48.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:48.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:50.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:50.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:50.647 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:08:50.647+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:08:50.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:50.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:52.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:52.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:53.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:53.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:54.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:54.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:55.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:55.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:55.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:08:55.648+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:08:56.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:56.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:57.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:57.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:58.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:58.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:08:59.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:08:59.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:00.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:00.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:00.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:09:00.649+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:09:01.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:01.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:02.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:02.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:03.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:03.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:04.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:04.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:05.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:05.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:05.649 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:09:05.650+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:09:06.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:06.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:07.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:07.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:08.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:08.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:09.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:09.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:10.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:10.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:10.650 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:09:10.651+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:09:11.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:11.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:12.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:12.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:13.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:13.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:14.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:14.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:15.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:15.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:15.652 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:09:15.652+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:09:16.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:16.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:17.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:17.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:18.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:18.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:19.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:19.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:20.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:20.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:20.652 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:09:20.653+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:09:21.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:21.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:22.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:22.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:23.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:23.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:24.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:24.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:24.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:24.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:25.654 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:09:25.654+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:09:25.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:25.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:26.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:26.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:27.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:27.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:28.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:28.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:29.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:29.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:30.655 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:09:30.656+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:09:30.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:30.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:31.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:31.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:32.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:32.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:33.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:33.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:34.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:34.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:35.656 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:09:35.656+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:09:35.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:35.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:36.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:36.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:37.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:37.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:38.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:38.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:39.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:39.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:40.657 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:09:40.657+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:09:40.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:40.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:41.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:41.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:42.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:42.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:43.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:43.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:44.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:44.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:45.658 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:09:45.658+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:09:45.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:45.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:47.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:47.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:48.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:48.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:48.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:48.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:49.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:49.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:50.659 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:09:50.659+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:09:50.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:50.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:51.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:51.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:52.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:52.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:53.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:53.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:54.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:54.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:55.659 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:09:55.660+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:09:55.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:55.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:56.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:56.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:57.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:57.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:58.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:58.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:09:59.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:09:59.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:00.661 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:10:00.661+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:10:00.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:00.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:01.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:01.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:02.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:02.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:03.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:03.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:04.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:04.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:05.662 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:10:05.662+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:10:05.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:05.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:06.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:06.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:07.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:07.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:08.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:08.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:09.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:09.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:10.663 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:10:10.663+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:10:10.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:10.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:11.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:11.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:12.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:12.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:13.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:13.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:14.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:14.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:15.664 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:10:15.665+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:10:15.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:15.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:16.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:16.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:17.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:17.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:18.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:18.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:19.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:19.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:20.665 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:10:20.665+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:10:20.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:20.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:21.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:21.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:22.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:22.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:23.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:23.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:24.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:24.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:25.666 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:10:25.666+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:10:25.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:25.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:26.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:26.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:27.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:27.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:28.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:28.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:29.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:29.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:30.667 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:10:30.668+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:10:30.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:30.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:31.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:31.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:32.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:32.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:33.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:33.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:34.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:34.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:35.668 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:10:35.669+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:10:35.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:35.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:36.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:36.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:37.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:37.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:38.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:38.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:39.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:39.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:40.669 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:10:40.670+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:10:40.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:40.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:41.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:41.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:42.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:42.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:43.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:43.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:44.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:44.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:45.670 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:10:45.670+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:10:45.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:45.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:46.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:46.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:47.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:47.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:48.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:48.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:49.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:49.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:50.671 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:10:50.671+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:10:50.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:50.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:51.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:51.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:52.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:52.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:53.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:53.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:54.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:54.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:55.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:10:55.673+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:10:55.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:55.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:56.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:56.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:57.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:57.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:58.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:58.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:10:59.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:10:59.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:00.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:11:00.673+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:11:00.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:00.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:01.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:01.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:02.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:02.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:03.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:03.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:04.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:04.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:05.674 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:11:05.674+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:11:05.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:05.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:06.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:06.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:07.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:07.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:08.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:08.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:09.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:09.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:10.675 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:11:10.675+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:11:10.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:10.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:11.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:11.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:12.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:12.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:13.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:13.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:14.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:14.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:15.676 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:11:15.676+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:11:15.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:15.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:16.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:16.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:17.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:17.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:18.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:18.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:19.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:19.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:20.677 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:11:20.677+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:11:20.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:20.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:21.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:21.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:22.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:22.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:23.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:23.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:24.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:24.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:25.678 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:11:25.678+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:11:25.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:25.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:26.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:26.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:27.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:27.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:28.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:28.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:29.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:29.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:30.679 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:11:30.679+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:11:30.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:30.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:31.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:31.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:32.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:32.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:33.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:33.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:34.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:34.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:35.680 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:11:35.680+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:11:35.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:35.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:36.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:36.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:37.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:37.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:38.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:38.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:39.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:39.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:40.681 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:11:40.681+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:11:40.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:40.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:41.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:41.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:42.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:42.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:43.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:43.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:44.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:44.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:45.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:45.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:45.682 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:11:45.683+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:11:46.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:46.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:47.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:47.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:48.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:48.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:49.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:49.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:50.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:50.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:50.683 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:11:50.684+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:11:51.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:51.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:52.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:52.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:53.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:53.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:54.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:54.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:55.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:55.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:55.684 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:11:55.684+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:11:56.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:56.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:57.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:57.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:58.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:58.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:11:59.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:11:59.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:00.685 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:12:00.685+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:12:00.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:00.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:01.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:01.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:02.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:02.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:03.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:03.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:04.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:04.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:05.686 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:12:05.686+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:12:05.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:05.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:06.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:06.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:07.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:07.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:08.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:08.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:09.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:09.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:10.687 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:12:10.687+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:12:10.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:10.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:11.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:11.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:12.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:12.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:13.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:13.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:14.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:14.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:15.688 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:12:15.688+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:12:15.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:15.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:16.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:16.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:17.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:17.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:18.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:18.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:19.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:19.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:20.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:12:20.689+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:12:20.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:20.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:21.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:21.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:22.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:22.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:23.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:23.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:24.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:24.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:25.690 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:12:25.691+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:12:25.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:25.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:27.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:27.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:27.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:27.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:29.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:29.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:29.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:29.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:30.691 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:12:30.691+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:12:30.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:30.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:31.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:31.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:33.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:33.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:33.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:33.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:34.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:34.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:35.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:12:35.692+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:12:35.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:35.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:36.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:36.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:37.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:37.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:39.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:39.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:40.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:40.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:40.693 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:12:40.693+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:12:41.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:41.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:42.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:42.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:43.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:43.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:44.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:44.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:45.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:45.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:45.694 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:12:45.695+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:12:46.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:46.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:47.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:47.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:48.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:48.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:49.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:49.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:50.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:50.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:50.695 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:12:50.696+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:12:51.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:51.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:52.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:52.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:53.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:53.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:54.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:54.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:55.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:55.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:55.696 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:12:55.696+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:12:56.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:56.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:57.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:57.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:58.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:58.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:12:59.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:12:59.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:00.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:00.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:00.697 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:13:00.697+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:13:01.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:01.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:02.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:02.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:03.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:03.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:04.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:04.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:05.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:05.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:05.698 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:13:05.698+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:13:06.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:06.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:07.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:07.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:08.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:08.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:09.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:09.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:10.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:10.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:10.700 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:13:10.700+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:13:11.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:11.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:12.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:12.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:13.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:13.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:14.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:14.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:15.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:15.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:15.700 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:13:15.701+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:13:16.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:16.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:17.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:17.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:18.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:18.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:19.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:19.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:20.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:20.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:20.701 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:13:20.701+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:13:21.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:21.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:22.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:22.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:23.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:23.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:24.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:24.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:25.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:25.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:25.702 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:13:25.703+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:13:26.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:26.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:27.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:27.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:28.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:28.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:29.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:29.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:30.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:30.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:30.703 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:13:30.703+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:13:31.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:31.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:32.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:32.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:33.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:33.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:34.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:34.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:35.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:35.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:35.704 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:13:35.704+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:13:36.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:36.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:37.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:37.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:38.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:38.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:39.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:39.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:40.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:40.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:40.704 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:13:40.706+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:13:41.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:41.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:42.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:42.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:43.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:43.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:44.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:44.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:45.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:45.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:45.705 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:13:45.706+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:13:46.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:46.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:47.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:47.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:48.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:48.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:49.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:49.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:50.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:50.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:50.706 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:13:50.706+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:13:51.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:51.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:52.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:52.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:53.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:53.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:54.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:54.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:55.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:55.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:55.707 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:13:55.707+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:13:56.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:56.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:57.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:57.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:58.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:58.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:13:59.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:13:59.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:00.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:00.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:00.708 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:14:00.708+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:14:01.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:01.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:02.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:02.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:03.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:03.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:04.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:04.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:05.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:05.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:05.709 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:14:05.709+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:14:06.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:06.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:07.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:07.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:08.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:08.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:09.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:09.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:10.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:10.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:10.710 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:14:10.711+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:14:11.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:11.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:12.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:12.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:13.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:13.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:14.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:14.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:15.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:15.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:15.711 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:14:15.712+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:14:16.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:16.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:17.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:17.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:18.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:18.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:19.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:19.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:20.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:20.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:20.712 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:14:20.712+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:14:21.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:21.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:22.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:22.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:23.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:23.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:24.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:24.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:25.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:25.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:25.713 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:14:25.714+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:14:26.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:26.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:27.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:27.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:28.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:28.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:29.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:29.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:30.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:30.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:30.714 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:14:30.714+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:14:31.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:31.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:32.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:32.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:33.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:33.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:34.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:34.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:35.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:35.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:35.715 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:14:35.715+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:14:36.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:36.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:37.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:37.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:38.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:38.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:39.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:39.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:40.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:40.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:40.716 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:14:40.716+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:14:41.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:41.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:42.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:42.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:43.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:43.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:44.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:44.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:45.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:45.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:45.717 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:14:45.717+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:14:46.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:46.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:47.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:47.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:48.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:48.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:49.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:49.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:50.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:50.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:50.718 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:14:50.718+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:14:51.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:51.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:52.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:52.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:53.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:53.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:54.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:54.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:55.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:55.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:55.719 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:14:55.720+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:14:56.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:56.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:57.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:57.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:58.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:58.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:14:59.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:14:59.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:00.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:00.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:00.720 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:15:00.720+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:15:01.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:01.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:02.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:02.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:03.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:03.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:04.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:04.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:05.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:05.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:05.721 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:15:05.721+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:15:06.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:06.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:07.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:07.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:08.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:08.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:09.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:09.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:10.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:10.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:10.722 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:15:10.722+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:15:11.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:11.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:12.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:12.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:13.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:13.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:14.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:14.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:15.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:15.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:15.723 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:15:15.723+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:15:16.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:16.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:17.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:17.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:18.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:18.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:19.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:19.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:20.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:20.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:20.724 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:15:20.724+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:15:21.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:21.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:22.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:22.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:23.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:23.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:24.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:24.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:25.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:25.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:25.725 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:15:25.725+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:15:26.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:26.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:27.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:27.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:28.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:28.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:29.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:29.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:30.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:30.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:30.726 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:15:30.726+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:15:31.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:31.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:32.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:32.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:33.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:33.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:34.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:34.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:35.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:35.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:35.727 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:15:35.728+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:15:36.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:36.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:37.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:37.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:38.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:38.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:39.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:39.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:40.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:40.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:40.728 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:15:40.728+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:15:41.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:41.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:42.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:42.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:43.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:43.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:44.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:44.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:45.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:45.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:45.729 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:15:45.729+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:15:46.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:46.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:47.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:47.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:48.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:48.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:49.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:49.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:50.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:50.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:50.730 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:15:50.731+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:15:51.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:51.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:52.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:52.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:53.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:53.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:54.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:54.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:55.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:55.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:55.731 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:15:55.731+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:15:56.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:56.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:57.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:57.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:58.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:58.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:15:59.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:15:59.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:00.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:00.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:00.732 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:16:00.732+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:16:01.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:01.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:02.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:02.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:03.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:03.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:04.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:04.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:05.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:05.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:05.733 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:16:05.733+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:16:06.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:06.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:07.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:07.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:08.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:08.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:09.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:09.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:10.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:10.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:10.734 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:16:10.735+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:16:11.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:11.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:12.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:12.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:13.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:13.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:14.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:14.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:15.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:15.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:15.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:16:15.735+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:16:16.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:16.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:17.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:17.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:18.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:18.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:19.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:19.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:20.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:16:20.736+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:16:20.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:20.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:21.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:21.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:22.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:22.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:23.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:23.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:24.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:24.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:25.737 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:16:25.737+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:16:25.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:25.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:26.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:26.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:27.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:27.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:28.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:28.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:29.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:29.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:30.738 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:16:30.738+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:16:30.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:30.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:31.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:31.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:32.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:32.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:33.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:33.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:34.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:34.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:35.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:16:35.739+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:16:35.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:35.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:36.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:36.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:37.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:37.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:38.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:38.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:39.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:39.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:40.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:16:40.740+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:16:40.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:40.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:41.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:41.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:42.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:42.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:43.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:43.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:44.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:44.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:45.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:16:45.742+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:16:45.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:45.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:46.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:46.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:47.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:47.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:48.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:48.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:49.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:49.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:50.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:50.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:50.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:16:50.742+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:16:51.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:51.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:52.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:52.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:53.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:53.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:54.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:54.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:55.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:16:55.743+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:16:55.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:55.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:56.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:56.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:57.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:57.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:58.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:58.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:16:59.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:16:59.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:00.743 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:17:00.744+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:17:00.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:00.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:01.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:01.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:02.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:02.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:03.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:03.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:04.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:04.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:05.744 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:17:05.744+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:17:05.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:05.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:06.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:06.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:07.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:07.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:08.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:08.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:09.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:09.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:10.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:17:10.745+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:17:10.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:10.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:11.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:11.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:12.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:12.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:13.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:13.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:14.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:14.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:15.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:15.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:15.746 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:17:15.746+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:17:16.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:16.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:17.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:17.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:18.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:18.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:19.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:19.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:20.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:20.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:20.747 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:17:20.747+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:17:21.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:21.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:22.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:22.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:23.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:23.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:24.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:24.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:25.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:25.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:25.748 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:17:25.748+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:17:26.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:26.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:27.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:27.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:28.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:28.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:29.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:29.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:30.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:30.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:30.749 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:17:30.749+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:17:31.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:31.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:32.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:32.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:33.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:33.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:34.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:34.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:35.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:35.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:35.750 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:17:35.750+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:17:36.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:36.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:37.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:37.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:38.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:38.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:39.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:39.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:40.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:40.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:40.750 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:17:40.751+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:17:41.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:41.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:42.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:42.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:43.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:43.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:44.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:44.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:45.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:45.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:45.751 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:17:45.752+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:17:46.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:46.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:47.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:47.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:48.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:48.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:49.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:49.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:50.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:50.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:50.752 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:17:50.753+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:17:51.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:51.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:52.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:52.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:53.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:53.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:54.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:54.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:55.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:55.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:55.754 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:17:55.754+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:17:56.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:56.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:57.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:57.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:58.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:58.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:17:59.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:17:59.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:00.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:00.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:00.755 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:18:00.755+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:18:01.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:01.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:02.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:02.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:03.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:03.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:04.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:04.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:05.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:05.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:05.756 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:18:05.756+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:18:06.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:06.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:07.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:07.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:08.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:08.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:09.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:09.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:10.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:10.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:10.757 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:18:10.757+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:18:11.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:11.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:12.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:12.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:13.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:13.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:14.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:14.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:15.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:15.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:15.758 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:18:15.758+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:18:16.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:16.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:17.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:17.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:18.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:18.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:19.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:19.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:20.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:20.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:20.759 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:18:20.759+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:18:21.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:21.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:22.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:22.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:23.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:23.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:24.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:24.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:25.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:25.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:25.760 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:18:25.760+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:18:26.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:26.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:27.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:27.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:28.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:28.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:29.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:29.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:30.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:30.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:30.761 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:18:30.761+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:18:31.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:31.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:32.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:32.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:33.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:33.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:34.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:34.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:35.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:35.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:35.762 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:18:35.762+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:18:36.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:36.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:37.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:37.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:38.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:38.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:39.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:39.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:40.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:40.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:40.763 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:18:40.763+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:18:41.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:41.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:42.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:42.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:43.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:43.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:44.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:44.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:45.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:45.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:45.764 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:18:45.764+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:18:46.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:46.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:47.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:47.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:48.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:48.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:49.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:49.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:50.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:50.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:50.765 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:18:50.765+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:18:51.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:51.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:52.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:52.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:53.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:53.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:54.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:54.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:55.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:55.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:55.766 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:18:55.766+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:18:56.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:56.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:57.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:57.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:58.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:58.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:18:59.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:18:59.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:00.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:00.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:00.767 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:19:00.767+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:19:01.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:01.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:02.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:02.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:03.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:03.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:04.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:04.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:05.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:05.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:05.768 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:19:05.768+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:19:06.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:06.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:07.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:07.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:08.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:08.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:09.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:09.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:10.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:10.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:10.769 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:19:10.769+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:19:11.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:11.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:12.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:12.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:13.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:13.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:14.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:14.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:15.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:15.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:15.770 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:19:15.770+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:19:16.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:16.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:17.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:17.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:18.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:18.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:19.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:19.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:20.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:20.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:20.771 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:19:20.771+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:19:21.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:21.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:22.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:22.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:23.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:23.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:24.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:24.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:25.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:25.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:25.772 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:19:25.772+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:19:26.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:26.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:27.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:27.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:28.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:28.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:29.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:29.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:30.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:30.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:30.773 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:19:30.773+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:19:31.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:31.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:32.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:32.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:33.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:33.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:34.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:34.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:35.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:35.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:35.774 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:19:35.774+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:19:36.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:36.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:37.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:37.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:38.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:38.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:39.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:39.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:40.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:40.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:40.775 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:19:40.776+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:19:41.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:41.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:42.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:42.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:43.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:43.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:44.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:44.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:45.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:45.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:45.776 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:19:45.777+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:19:46.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:46.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:47.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:47.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:48.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:48.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:49.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:49.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:50.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:50.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:50.777 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:19:50.779+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:19:51.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:51.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:52.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:52.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:53.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:53.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:54.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:54.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:55.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:55.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:55.778 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:19:55.780+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:19:56.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:56.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:57.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:57.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:58.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:58.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:19:59.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:19:59.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:00.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:00.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:00.779 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:20:00.781+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:20:01.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:01.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:02.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:02.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:03.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:03.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:04.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:04.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:05.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:05.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:05.780 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:20:05.781+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:20:06.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:06.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:06.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:06.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:08.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:08.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:09.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:09.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:10.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:10.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:10.781 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:20:10.781+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:20:11.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:11.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:11.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:11.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:13.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:13.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:14.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:14.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:15.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:15.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:15.782 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:20:15.783+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:20:16.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:16.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:17.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:17.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:18.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:18.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:19.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:19.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:19.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:19.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:20.783 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:20:20.784+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:20:20.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:20.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:21.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:21.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:22.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:22.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:23.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:23.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:24.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:24.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:25.784 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:20:25.785+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:20:25.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:25.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:26.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:26.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:27.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:27.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:28.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:28.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:29.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:29.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:30.785 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:20:30.786+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:20:30.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:30.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:32.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:32.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:33.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:33.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:33.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:33.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:34.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:34.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:35.787 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:20:35.787+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:20:35.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:35.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:36.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:36.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:37.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:37.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:38.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:38.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:39.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:39.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:40.787 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:20:40.788+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:20:40.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:40.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:41.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:41.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:42.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:42.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:44.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:44.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:45.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:45.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:45.788 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:20:45.789+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:20:46.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:46.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:47.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:47.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:48.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:48.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:49.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:49.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:50.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:50.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:50.789 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:20:50.789+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:20:51.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:51.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:52.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:52.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:53.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:53.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:53.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:53.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:54.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:54.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:55.790 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:20:55.790+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:20:55.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:55.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:56.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:56.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:57.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:57.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:58.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:58.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:20:59.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:20:59.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:00.791 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:21:00.791+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:21:00.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:00.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:01.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:01.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:02.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:02.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:03.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:04.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:05.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:05.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:05.792 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:21:05.792+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:21:06.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:06.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:07.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:07.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:08.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:08.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:09.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:09.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:10.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:10.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:10.793 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:21:10.793+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:21:11.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:11.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:12.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:12.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:13.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:13.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:14.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:14.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:15.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:15.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:15.794 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:21:15.795+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:21:16.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:16.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:17.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:17.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:18.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:18.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:19.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:19.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:20.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:20.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:20.795 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:21:20.796+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:21:21.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:21.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:22.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:22.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:23.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:23.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:24.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:24.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:25.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:25.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:25.796 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:21:25.797+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:21:26.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:26.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:27.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:27.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:28.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:28.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:29.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:29.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:30.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:30.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:30.797 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:21:30.798+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:21:31.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:31.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:32.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:32.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:33.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:33.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:34.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:34.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:35.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:35.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:35.798 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:21:35.798+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:21:36.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:36.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:37.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:37.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:38.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:38.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:39.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:39.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:40.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:40.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:40.799 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:21:40.799+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:21:41.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:41.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:42.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:42.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:43.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:43.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:44.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:44.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:45.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:45.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:45.800 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:21:45.801+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:21:46.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:46.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:47.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:47.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:48.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:48.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:49.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:49.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:50.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:50.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:50.801 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:21:50.801+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:21:51.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:51.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:52.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:52.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:53.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:53.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:54.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:54.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:55.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:55.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:55.802 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:21:55.802+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:21:55.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:55.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:56.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:56.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:57.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:57.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:59.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:59.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:21:59.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:21:59.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:00.803 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:22:00.804+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:22:00.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:00.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:01.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:01.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:02.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:02.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:03.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:03.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:04.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:04.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:05.804 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:22:05.804+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:22:05.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:05.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:06.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:06.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:08.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:08.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:08.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:08.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:09.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:09.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:10.805 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:22:10.805+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:22:10.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:10.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:11.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:11.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:13.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:13.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:14.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:14.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:15.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:15.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:15.806 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:22:15.806+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:22:16.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:16.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:17.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:17.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:18.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:18.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:19.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:19.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:20.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:20.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:20.807 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:22:20.807+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:22:20.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:20.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:21.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:21.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:22.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:22.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:24.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:24.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:24.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:24.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:25.808 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:22:25.808+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:22:25.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:25.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:26.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:26.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:27.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:27.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:29.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:29.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:29.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:29.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:30.809 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:22:30.809+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:22:31.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:31.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:32.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:32.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:33.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:33.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:34.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:34.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:35.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:35.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:35.810 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:22:35.810+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:22:36.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:36.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:36.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:36.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:38.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:38.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:39.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:39.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:40.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:40.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:40.811 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:22:40.811+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:22:41.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:41.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:42.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:42.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:43.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:43.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:44.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:44.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:45.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:45.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:45.812 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:22:45.812+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:22:46.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:46.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:46.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:46.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:47.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:47.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:49.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:49.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:50.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:50.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:50.813 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:22:50.814+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:22:51.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:51.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:52.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:52.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:53.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:53.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:54.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:54.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:55.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:55.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:55.814 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:22:55.814+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:22:56.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:56.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:57.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:57.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:58.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:58.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:22:59.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:22:59.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:00.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:00.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:00.815 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:23:00.817+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:23:01.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:01.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:02.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:02.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:03.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:03.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:04.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:04.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:05.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:05.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:05.816 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:23:05.818+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:23:06.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:06.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:07.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:07.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:08.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:08.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:09.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:09.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:10.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:10.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:10.817 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:23:10.817+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:23:11.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:11.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:12.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:12.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:13.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:13.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:14.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:14.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:15.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:15.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:15.818 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:23:15.819+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:23:16.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:16.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:17.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:17.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:18.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:18.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:19.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:19.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:20.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:20.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:20.819 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:23:20.820+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:23:21.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:21.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:22.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:22.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:23.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:23.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:24.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:24.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:25.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:25.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:25.820 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:23:25.821+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:23:26.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:26.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:27.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:27.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:28.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:28.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:29.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:29.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:30.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:30.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:30.821 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:23:30.822+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:23:31.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:31.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:32.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:32.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:33.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:33.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:34.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:34.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:35.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:35.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:35.822 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:23:35.823+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:23:36.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:36.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:37.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:37.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:38.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:38.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:39.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:39.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:40.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:40.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:40.823 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:23:40.824+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:23:41.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:41.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:42.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:42.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:43.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:43.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:44.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:44.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:45.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:45.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:45.824 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:23:45.825+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:23:46.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:46.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:47.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:47.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:48.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:48.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:49.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:49.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:50.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:50.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:50.825 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:23:50.826+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:23:51.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:51.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:52.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:52.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:53.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:53.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:54.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:54.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:55.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:55.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:55.826 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:23:55.826+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:23:56.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:56.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:57.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:57.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:58.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:58.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:23:59.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:23:59.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:00.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:00.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:00.827 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:24:00.827+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:24:01.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:01.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:02.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:02.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:03.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:03.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:04.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:04.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:05.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:05.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:05.828 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:24:05.828+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:24:06.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:06.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:07.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:07.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:08.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:08.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:09.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:09.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:10.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:10.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:10.829 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:24:10.829+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:24:11.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:11.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:12.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:12.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:13.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:13.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:14.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:14.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:15.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:15.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:15.830 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:24:15.830+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:24:16.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:16.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:17.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:17.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:18.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:18.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:19.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:19.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:20.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:20.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:20.831 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:24:20.832+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:24:21.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:21.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:22.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:22.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:23.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:23.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:24.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:24.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:25.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:25.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:25.832 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:24:25.833+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:24:26.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:26.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:27.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:27.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:28.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:28.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:29.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:29.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:30.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:30.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:30.833 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:24:30.833+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:24:31.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:31.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:32.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:32.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:33.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:33.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:34.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:34.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:34.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:34.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:35.834 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:24:35.834+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:24:35.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:35.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:36.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:36.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:38.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:38.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:38.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:38.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:40.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:40.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:40.835 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:24:40.835+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:24:41.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:41.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:42.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:42.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:43.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:43.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:44.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:44.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:45.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:45.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:45.836 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:24:45.836+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:24:46.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:46.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:47.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:47.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:48.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:48.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:49.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:49.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:50.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:50.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:50.837 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:24:50.837+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:24:51.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:51.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:52.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:52.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:53.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:53.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:54.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:54.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:55.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:55.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:55.838 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:24:55.839+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:24:56.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:56.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:57.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:57.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:58.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:58.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:24:59.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:24:59.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:00.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:00.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:00.839 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:25:00.839+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:25:01.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:01.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:02.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:02.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:03.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:03.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:04.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:04.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:05.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:05.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:05.840 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:25:05.840+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:25:06.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:06.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:07.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:07.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:08.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:08.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:09.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:09.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:10.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:10.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:10.841 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:25:10.841+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:25:11.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:11.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:12.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:12.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:13.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:13.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:14.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:14.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:15.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:15.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:15.842 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:25:15.842+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:25:16.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:16.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:17.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:17.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:18.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:18.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:19.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:19.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:20.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:20.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:20.843 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:25:20.843+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:25:21.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:21.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:22.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:22.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:23.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:23.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:24.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:24.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:25.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:25.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:25.844 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:25:25.844+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:25:26.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:26.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:27.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:27.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:28.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:28.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:29.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:29.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:30.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:30.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:30.845 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:25:30.845+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:25:31.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:31.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:32.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:32.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:33.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:33.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:34.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:34.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:35.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:35.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:35.846 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:25:35.846+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:25:36.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:36.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:37.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:37.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:38.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:38.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:39.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:39.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:40.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:40.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:40.847 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:25:40.848+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:25:41.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:41.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:42.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:42.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:43.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:43.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:44.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:44.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:45.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:45.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:45.848 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:25:45.849+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:25:46.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:46.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:47.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:47.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:48.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:48.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:49.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:49.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:50.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:50.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:50.849 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:25:50.849+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:25:51.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:51.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:52.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:52.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:53.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:53.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:54.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:54.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:55.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:55.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:55.850 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:25:55.851+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:25:56.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:56.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:57.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:57.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:58.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:58.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:25:59.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:25:59.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:00.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:00.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:00.851 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:26:00.852+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:26:01.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:01.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:02.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:02.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:03.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:03.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:04.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:04.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:05.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:05.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:05.852 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:26:05.853+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:26:06.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:06.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:07.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:07.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:08.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:08.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:09.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:09.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:10.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:10.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:11.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:11.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:12.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:12.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:13.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:13.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:14.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:14.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:15.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:15.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:15.854 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:26:15.856+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:26:16.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:16.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:17.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:17.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:18.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:18.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:19.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:19.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:20.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:20.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:20.855 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:26:20.856+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:26:21.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:21.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:22.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:22.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:23.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:23.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:24.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:24.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:25.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:25.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:25.856 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:26:25.856+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:26:26.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:26.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:27.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:27.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:28.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:28.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:29.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:29.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:30.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:30.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:30.856 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:26:30.857+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:26:31.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:31.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:32.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:32.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:33.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:33.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:34.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:34.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:35.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:35.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:35.857 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:26:35.857+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:26:36.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:36.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:37.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:37.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:38.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:38.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:39.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:39.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:40.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:40.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:40.858 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:26:40.858+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:26:41.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:41.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:42.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:42.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:43.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:43.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:44.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:44.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:45.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:45.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:45.859 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:26:45.859+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:26:46.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:46.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:47.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:47.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:48.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:48.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:49.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:49.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:50.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:50.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:50.860 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:26:50.860+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:26:51.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:51.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:52.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:52.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:53.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:53.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:54.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:54.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:55.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:55.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:55.861 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:26:55.861+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:26:56.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:56.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:57.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:57.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:58.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:58.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:26:59.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:26:59.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:00.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:00.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:00.862 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:27:00.863+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:27:01.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:01.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:02.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:02.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:03.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:03.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:04.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:04.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:05.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:05.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:05.863 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:27:05.863+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:27:06.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:06.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:07.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:07.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:08.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:08.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:09.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:09.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:10.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:10.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:10.864 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:27:10.865+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:27:11.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:11.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:12.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:12.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:13.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:13.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:14.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:14.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:15.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:15.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:15.865 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:27:15.865+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:27:16.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:16.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:17.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:17.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:18.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:18.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:19.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:19.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:20.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:20.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:20.866 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:27:20.866+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:27:21.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:21.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:22.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:22.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:23.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:23.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:24.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:24.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:25.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:25.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:25.867 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:27:25.867+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:27:26.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:26.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:27.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:27.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:28.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:28.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:29.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:29.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:30.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:30.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:30.868 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:27:30.869+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:27:31.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:31.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:32.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:32.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:33.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:33.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:34.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:34.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:35.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:35.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:35.869 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:27:35.870+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:27:36.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:36.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:37.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:37.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:38.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:38.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:39.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:39.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:40.870 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:27:40.870+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:27:40.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:40.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:41.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:41.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:42.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:42.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:43.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:43.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:45.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:45.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:45.871 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:27:45.872+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:27:46.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:46.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:47.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:47.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:48.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:48.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:48.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:48.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:49.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:49.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:50.872 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:27:50.873+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:27:50.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:50.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:52.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:52.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:52.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:52.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:53.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:53.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:54.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:54.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:55.873 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:27:55.874+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:27:55.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:55.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:56.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:56.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:57.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:57.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:58.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:58.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:27:59.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:27:59.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:00.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:00.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:00.874 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:28:00.875+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:28:01.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:01.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:02.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:02.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:03.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:03.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:04.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:04.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:05.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:05.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:05.875 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:28:05.876+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:28:06.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:06.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:07.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:07.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:08.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:08.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:09.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:09.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:10.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:10.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:10.876 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:28:10.876+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:28:11.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:11.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:12.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:12.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:13.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:13.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:14.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:14.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:15.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:15.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:15.877 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:28:15.877+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:28:16.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:16.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:17.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:17.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:18.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:18.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:19.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:19.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:20.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:20.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:20.877 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:28:20.878+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:28:21.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:21.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:22.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:22.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:23.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:23.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:24.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:24.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:25.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:25.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:25.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:28:25.878+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:28:26.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:26.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:27.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:27.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:28.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:28.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:29.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:29.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:30.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:30.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:30.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:28:30.879+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:28:31.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:31.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:32.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:32.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:33.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:33.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:34.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:34.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:35.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:35.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:35.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:28:35.880+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:28:36.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:36.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:37.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:37.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:38.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:38.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:39.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:39.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:40.881 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:28:40.882+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:28:40.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:40.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:41.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:41.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:42.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:42.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:43.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:43.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:44.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:44.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:45.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:45.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:45.882 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:28:45.883+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:28:46.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:46.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:47.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:47.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:48.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:48.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:49.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:49.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:50.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:50.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:50.884 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:28:50.885+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:28:51.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:51.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:52.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:52.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:53.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:53.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:54.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:54.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:55.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:55.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:55.885 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:28:55.886+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:28:56.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:56.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:57.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:57.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:58.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:58.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:28:59.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:28:59.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:00.886 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:29:00.887+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:29:00.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:00.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:01.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:01.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:02.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:02.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:03.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:03.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:04.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:04.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:05.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:29:05.888+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:29:05.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:05.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:06.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:06.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:07.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:07.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:08.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:08.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:09.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:09.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:10.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:29:10.888+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:29:10.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:10.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:11.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:11.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:12.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:12.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:13.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:13.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:14.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:14.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:15.889 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:29:15.890+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:29:15.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:15.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:16.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:16.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:17.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:17.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:18.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:18.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:19.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:19.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:20.890 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:29:20.890+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:29:20.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:20.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:21.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:21.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:22.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:22.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:23.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:23.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:24.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:24.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:25.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:25.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:25.890 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:29:25.892+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:29:26.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:26.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:27.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:27.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:28.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:28.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:29.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:29.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:30.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:30.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:30.891 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:29:30.893+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:29:31.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:31.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:32.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:32.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:33.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:33.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:34.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:34.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:35.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:35.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:35.892 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:29:35.893+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:29:36.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:36.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:37.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:37.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:38.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:38.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:39.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:39.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:40.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:40.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:40.893 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:29:40.893+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:29:41.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:41.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:42.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:42.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:43.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:43.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:44.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:44.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:45.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:45.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:45.894 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:29:45.894+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:29:46.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:46.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:47.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:47.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:48.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:48.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:49.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:49.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:50.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:50.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:50.895 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:29:50.896+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:29:51.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:51.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:52.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:52.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:53.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:53.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:54.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:54.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:55.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:55.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:55.895 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:29:55.896+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:29:56.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:56.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:57.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:57.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:29:58.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:29:58.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:00.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:00.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:00.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:30:00.897+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:30:01.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:01.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:01.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:01.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:02.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:02.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:04.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:04.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:04.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:04.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:05.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:30:05.898+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:30:05.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:05.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:06.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:06.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:07.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:07.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:08.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:08.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:09.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:09.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:10.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:10.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:10.898 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:30:10.899+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:30:11.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:11.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:12.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:12.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:13.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:13.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:14.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:14.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:15.899 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:30:15.899+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:30:15.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:15.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:16.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:16.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:17.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:17.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:18.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:18.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:19.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:19.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:20.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:20.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:20.900 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:30:20.901+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:30:21.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:21.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:22.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:22.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:23.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:23.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:24.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:24.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:25.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:25.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:25.902 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:30:25.902+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:30:26.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:26.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:27.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:27.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:28.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:28.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:29.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:29.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:30.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:30.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:30.904 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:30:30.903+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:30:31.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:31.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:32.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:32.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:33.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:33.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:34.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:34.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:35.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:35.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:35.904 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:30:35.904+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:30:36.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:36.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:37.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:37.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:38.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:38.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:39.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:39.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:40.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:40.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:40.905 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:30:40.905+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:30:41.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:41.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:42.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:42.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:43.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:43.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:44.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:44.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:45.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:45.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:45.906 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:30:45.906+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:30:46.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:46.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:47.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:47.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:48.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:48.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:49.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:49.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:50.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:50.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:50.908 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:30:50.907+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:30:51.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:51.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:52.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:52.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:53.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:53.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:54.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:54.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:55.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:55.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:55.908 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:30:55.908+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:30:56.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:56.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:57.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:57.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:58.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:58.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:30:59.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:30:59.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:00.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:00.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:00.909 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:31:00.909+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:31:01.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:01.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:02.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:02.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:03.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:03.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:04.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:04.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:05.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:05.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:05.911 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:31:05.911+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:31:06.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:06.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:07.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:07.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:08.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:08.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:09.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:09.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:10.914 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:31:10.911+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:31:10.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:10.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:11.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:11.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:12.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:12.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:13.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:13.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:14.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:14.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:15.912 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:31:15.912+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:31:15.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:15.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:16.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:16.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:17.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:17.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:18.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:18.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:19.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:19.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:20.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:20.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:20.913 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:31:20.913+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:31:21.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:21.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:22.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:22.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:23.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:23.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:24.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:24.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:25.914 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:31:25.914+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:31:25.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:25.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:26.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:26.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:27.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:27.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:28.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:28.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:29.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:29.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:30.915 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:31:30.915+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:31:30.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:30.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:31.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:31.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:33.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:33.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:34.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:34.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:34.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:34.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:35.916 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:31:35.916+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:31:35.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:35.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:36.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:36.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:37.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:37.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:38.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:38.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:39.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:39.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:40.917 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:31:40.917+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:31:41.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:41.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:42.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:42.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:43.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:43.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:44.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:44.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:44.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:44.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:45.918 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:31:45.918+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:31:45.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:45.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:46.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:46.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:47.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:47.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:48.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:48.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:49.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:49.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:50.919 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:31:50.919+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:31:50.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:50.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:51.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:51.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:52.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:52.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:53.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:53.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:54.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:54.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:55.920 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:31:55.921+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:31:55.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:55.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:56.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:56.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:57.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:57.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:31:58.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:31:58.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:00.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:00.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:00.921 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:32:00.921+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:32:01.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:01.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:02.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:02.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:03.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:03.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:04.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:04.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:05.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:05.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:05.922 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:32:05.922+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:32:05.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:05.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:06.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:06.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:08.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:08.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:09.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:09.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:10.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:10.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:10.923 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:32:10.924+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:32:11.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:11.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:12.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:12.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:13.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:13.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:14.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:14.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:15.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:15.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:15.924 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:32:15.924+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:32:16.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:16.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:17.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:17.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:18.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:18.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:19.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:19.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:20.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:20.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:20.925 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:32:20.925+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:32:21.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:21.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:22.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:22.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:23.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:23.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:24.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:24.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:25.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:25.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:25.926 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:32:25.926+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:32:26.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:26.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:27.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:27.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:28.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:28.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:29.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:29.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:30.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:30.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:30.927 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:32:30.928+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:32:31.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:31.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:32.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:32.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:33.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:33.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:34.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:34.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:35.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:35.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:35.928 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:32:35.929+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:32:36.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:36.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:37.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:37.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:38.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:38.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:39.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:39.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:40.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:40.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:40.929 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:32:40.930+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:32:41.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:41.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:42.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:42.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:43.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:43.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:44.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:44.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:45.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:45.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:45.933 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:32:45.931+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:32:46.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:46.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:47.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:47.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:48.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:48.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:49.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:49.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:50.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:50.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:50.930 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:32:50.931+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:32:51.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:51.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:52.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:52.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:53.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:53.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:54.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:54.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:55.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:55.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:55.931 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:32:55.932+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:32:56.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:56.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:57.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:57.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:58.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:58.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:32:59.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:32:59.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:00.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:00.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:00.932 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:33:00.932+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:33:01.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:01.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:02.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:02.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:03.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:03.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:04.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:04.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:05.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:05.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:05.933 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:33:05.934+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:33:06.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:06.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:07.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:07.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:08.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:08.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:09.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:09.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:10.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:10.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:10.934 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:33:10.934+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:33:11.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:11.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:12.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:12.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:13.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:13.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:14.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:14.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:15.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:15.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:15.935 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:33:15.935+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:33:16.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:16.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:17.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:17.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:18.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:18.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:19.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:19.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:20.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:20.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:20.936 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:33:20.936+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:33:21.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:21.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:22.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:22.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:23.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:23.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:24.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:24.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:25.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:25.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:25.937 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:33:25.937+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:33:26.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:26.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:27.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:27.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:28.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:28.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:29.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:29.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:30.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:30.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:30.938 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:33:30.938+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:33:31.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:31.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:32.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:32.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:33.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:33.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:34.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:34.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:35.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:35.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:35.939 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:33:35.940+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:33:36.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:36.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:37.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:37.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:38.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:38.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:39.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:39.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:40.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:40.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:40.940 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:33:40.940+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:33:41.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:41.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:42.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:42.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:43.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:43.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:44.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:44.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:45.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:45.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:45.941 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:33:45.941+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:33:46.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:46.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:47.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:47.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:48.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:48.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:49.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:49.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:50.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:50.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:50.942 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:33:50.942+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:33:51.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:51.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:52.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:52.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:53.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:53.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:54.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:54.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:55.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:55.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:55.943 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:33:55.943+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:33:56.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:56.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:57.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:57.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:58.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:58.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:33:59.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:33:59.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:00.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:00.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:00.944 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:34:00.944+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:34:01.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:01.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:02.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:02.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:03.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:03.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:04.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:04.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:05.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:05.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:05.945 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:34:05.945+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:34:06.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:06.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:07.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:07.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:08.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:08.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:09.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:09.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:10.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:10.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:10.945 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:34:10.946+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:34:11.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:11.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:12.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:12.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:13.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:13.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:14.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:14.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:15.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:15.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:15.947 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:34:15.947+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:34:16.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:16.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:17.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:17.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:18.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:18.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:19.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:19.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:20.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:20.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:20.947 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:34:20.947+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:34:21.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:21.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:22.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:22.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:23.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:23.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:24.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:24.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:25.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:25.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:25.948 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:34:25.948+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:34:26.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:26.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:27.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:27.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:28.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:28.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:29.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:29.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:30.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:30.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:30.949 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:34:30.949+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:34:31.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:31.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:32.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:32.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:33.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:33.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:34.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:34.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:35.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:35.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:35.950 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:34:35.951+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:34:36.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:36.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:37.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:37.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:38.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:38.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:39.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:39.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:40.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:40.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:40.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:34:40.952+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:34:41.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:41.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:42.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:42.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:43.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:43.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:44.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:44.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:45.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:45.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:45.953 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:34:45.953+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:34:46.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:46.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:47.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:47.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:48.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:48.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:49.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:49.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:50.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:50.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:50.954 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:34:50.955+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:34:51.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:51.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:52.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:52.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:53.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:53.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:54.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:54.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:55.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:55.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:55.955 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:34:55.956+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:34:56.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:56.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:57.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:57.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:58.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:58.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:34:59.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:34:59.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:00.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:00.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:00.956 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:35:00.956+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:35:01.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:01.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:02.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:02.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:03.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:03.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:04.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:04.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:05.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:05.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:05.957 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:35:05.957+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:35:06.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:06.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:07.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:07.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:08.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:08.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:09.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:09.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:10.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:10.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:10.958 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:35:10.959+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:35:11.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:11.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:12.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:12.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:13.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:13.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:14.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:14.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:15.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:15.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:15.959 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:35:15.959+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:35:16.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:16.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:17.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:17.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:18.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:18.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:19.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:19.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:20.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:20.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:20.959 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:35:20.960+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:35:21.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:21.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:22.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:22.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:23.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:23.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:24.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:24.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:25.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:25.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:25.961 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:35:25.961+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:35:26.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:26.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:27.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:27.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:28.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:28.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:29.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:29.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:30.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:30.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:30.962 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:35:30.962+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:35:31.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:31.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:32.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:32.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:33.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:33.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:34.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:34.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:35.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:35.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:35.963 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:35:35.964+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:35:36.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:36.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:37.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:37.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:38.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:38.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:39.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:39.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:40.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:40.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:40.964 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:35:40.964+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:35:41.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:41.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:42.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:42.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:43.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:43.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:44.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:44.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:45.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:45.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:45.965 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:35:45.966+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:35:46.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:46.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:47.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:47.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:48.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:48.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:49.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:49.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:50.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:50.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:50.965 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:35:50.967+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:35:51.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:51.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:52.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:52.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:53.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:53.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:54.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:54.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:55.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:55.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:55.966 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:35:55.968+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:35:56.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:56.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:57.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:57.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:58.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:58.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:35:59.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:35:59.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:00.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:00.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:00.967 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:36:00.969+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:36:01.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:01.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:02.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:02.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:03.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:03.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:04.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:04.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:05.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:05.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:05.968 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:36:05.969+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:36:06.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:06.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:07.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:07.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:08.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:08.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:09.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:09.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:10.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:10.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:10.969 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:36:10.970+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:36:11.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:11.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:12.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:12.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:13.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:13.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:14.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:14.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:15.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:15.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:15.970 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:36:15.970+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:36:16.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:16.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:17.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:17.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:18.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:18.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:19.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:19.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:20.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:20.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:20.971 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:36:20.971+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:36:21.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:21.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:22.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:22.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:23.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:23.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:24.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:24.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:25.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:25.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:25.972 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:36:25.972+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:36:26.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:26.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:27.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:27.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:28.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:28.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:29.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:29.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:30.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:30.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:30.973 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:36:30.974+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:36:31.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:31.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:32.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:32.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:33.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:33.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:34.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:34.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:35.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:35.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:35.974 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:36:35.974+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:36:36.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:36.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:37.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:37.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:38.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:38.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:39.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:39.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:40.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:40.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:40.975 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:36:40.975+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:36:41.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:41.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:42.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:42.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:43.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:43.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:44.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:44.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:45.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:45.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:45.976 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:36:45.977+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:36:46.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:46.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:47.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:47.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:48.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:48.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:49.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:49.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:50.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:50.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:50.977 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:36:50.978+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:36:51.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:51.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:52.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:52.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:53.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:53.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:54.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:54.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:55.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:55.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:55.978 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:36:55.979+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:36:56.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:56.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:57.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:57.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:58.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:58.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:36:59.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:36:59.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:00.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:00.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:00.979 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:37:00.980+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:37:01.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:01.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:02.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:02.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:03.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:03.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:04.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:04.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:05.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:05.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:05.980 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:37:05.980+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:37:06.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:06.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:07.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:07.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:08.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:08.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:09.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:09.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:10.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:10.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:10.981 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:37:10.982+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:37:11.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:11.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:12.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:12.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:13.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:13.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:14.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:14.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:15.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:15.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:16.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:16.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:17.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:17.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:18.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:18.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:19.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:19.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:20.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:20.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:20.983 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:37:20.984+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:37:21.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:21.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:22.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:22.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:23.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:23.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:24.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:24.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:25.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:25.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:25.984 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:37:25.985+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:37:26.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:26.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:27.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:27.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:28.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:28.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:29.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:29.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:30.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:30.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:30.985 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:37:30.986+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:37:31.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:31.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:32.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:32.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:33.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:33.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:34.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:34.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:35.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:35.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:35.986 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:37:35.986+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:37:36.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:36.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:37.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:37.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:38.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:38.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:39.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:39.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:40.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:40.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:40.987 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:37:40.988+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:37:41.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:41.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:42.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:42.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:43.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:43.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:44.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:44.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:45.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:45.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:45.988 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:37:45.989+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:37:46.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:46.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:47.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:47.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:48.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:48.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:49.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:49.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:50.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:50.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:50.989 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:37:50.989+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:37:51.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:51.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:52.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:52.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:53.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:53.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:54.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:54.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:55.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:55.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:55.990 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:37:55.991+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:37:56.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:56.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:57.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:57.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:58.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:58.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:37:59.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:37:59.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:00.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:00.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:00.991 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:38:00.992+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:38:01.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:01.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:02.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:02.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:03.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:03.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:04.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:04.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:05.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:05.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:05.992 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:38:05.993+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:38:06.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:06.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:07.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:07.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:08.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:08.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:09.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:09.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:10.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:10.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:10.993 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:38:10.994+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:38:11.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:11.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:12.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:12.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:13.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:13.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:14.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:14.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:15.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:15.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:15.994 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:38:15.995+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:38:16.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:16.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:17.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:17.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:18.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:18.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:19.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:19.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:20.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:20.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:20.995 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:38:20.995+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:38:21.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:21.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:22.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:22.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:23.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:23.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:24.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:24.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:25.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:25.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:25.996 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:38:25.997+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:38:26.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:26.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:27.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:27.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:28.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:28.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:29.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:29.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:30.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:30.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:30.997 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:38:30.998+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:38:31.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:31.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:32.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:32.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:33.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:33.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:34.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:34.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:35.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:35.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:35.998 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:38:35.998+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:38:36.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:36.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:37.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:37.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:38.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:38.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:39.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:39.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:40.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:40.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:40.999 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:38:40.999+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:38:41.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:41.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:42.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:42.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:43.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:43.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:44.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:44.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:45.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:45.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:46.000 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:38:46.000+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:38:46.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:46.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:47.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:47.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:48.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:48.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:49.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:49.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:50.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:50.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:51.000 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:38:51.001+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:38:51.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:51.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:52.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:52.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:53.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:53.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:54.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:54.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:55.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:55.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:56.001 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:38:56.002+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:38:56.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:56.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:57.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:57.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:58.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:58.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:38:59.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:38:59.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:00.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:00.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:01.003 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:39:01.004+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:39:01.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:01.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:02.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:02.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:03.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:03.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:04.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:04.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:05.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:05.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:06.003 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:39:06.005+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:39:06.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:06.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:07.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:07.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:08.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:08.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:09.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:09.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:10.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:10.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:11.004 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:39:11.006+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:39:11.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:11.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:12.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:12.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:13.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:13.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:14.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:14.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:15.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:15.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:16.005 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:39:16.005+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:39:16.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:16.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:17.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:17.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:18.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:18.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:19.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:19.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:20.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:20.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:21.008 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:39:21.006+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:39:21.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:21.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:22.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:22.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:23.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:23.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:24.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:24.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:25.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:25.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:26.006 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:39:26.007+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:39:26.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:26.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:27.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:27.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:28.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:28.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:29.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:29.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:30.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:30.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:31.007 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:39:31.008+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:39:31.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:31.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:32.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:32.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:33.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:33.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:34.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:34.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:35.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:35.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:36.009 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:39:36.009+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:39:36.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:36.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:37.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:37.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:38.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:38.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:39.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:39.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:40.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:40.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:41.010 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:39:41.010+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:39:41.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:41.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:42.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:42.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:43.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:43.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:44.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:44.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:45.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:45.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:46.011 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:39:46.011+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:39:46.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:46.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:47.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:47.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:48.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:48.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:49.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:49.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:50.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:50.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:51.011 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:39:51.012+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:39:51.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:51.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:52.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:52.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:53.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:53.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:54.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:54.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:55.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:55.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:56.012 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:39:56.013+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:39:56.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:56.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:57.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:57.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:58.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:58.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:39:59.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:39:59.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:00.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:00.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:01.014 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:40:01.014+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:40:01.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:01.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:02.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:02.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:03.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:03.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:04.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:04.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:05.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:05.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:06.015 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:40:06.016+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:40:06.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:06.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:07.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:07.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:08.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:08.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:09.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:09.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:10.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:10.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:11.016 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:40:11.016+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:40:11.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:11.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:12.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:12.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:13.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:13.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:14.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:14.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:15.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:15.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:16.017 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:40:16.018+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:40:16.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:16.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:17.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:17.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:18.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:18.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:19.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:19.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:20.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:20.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:21.018 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:40:21.018+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:40:21.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:21.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:22.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:22.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:23.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:23.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:24.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:24.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:25.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:25.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:26.019 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:40:26.019+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:40:26.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:26.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:27.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:27.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:28.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:28.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:29.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:29.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:30.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:30.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:31.020 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:40:31.021+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:40:31.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:31.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:32.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:32.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:33.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:33.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:34.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:34.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:35.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:35.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:36.021 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:40:36.021+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:40:36.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:36.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:37.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:37.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:38.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:38.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:39.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:39.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:40.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:40.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:41.022 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:40:41.022+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:40:41.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:41.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:42.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:42.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:43.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:43.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:44.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:44.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:45.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:45.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:46.022 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:40:46.023+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:40:46.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:46.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:47.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:47.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:48.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:48.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:49.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:49.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:50.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:50.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:51.023 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:40:51.024+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:40:51.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:51.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:52.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:52.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:53.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:53.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:54.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:54.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:55.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:55.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:56.024 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:40:56.025+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:40:56.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:56.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:57.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:57.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:58.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:58.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:40:59.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:40:59.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:00.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:00.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:01.026 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:41:01.026+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:41:01.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:01.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:02.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:02.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:03.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:03.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:04.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:04.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:05.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:05.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:06.027 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:41:06.027+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:41:06.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:06.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:07.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:07.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:08.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:08.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:09.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:09.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:10.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:10.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:11.028 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:41:11.028+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:41:11.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:11.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:12.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:12.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:13.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:13.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:14.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:14.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:15.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:15.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:16.029 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:41:16.029+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:41:16.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:16.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:17.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:17.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:18.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:18.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:19.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:19.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:20.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:20.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:21.030 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:41:21.031+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:41:21.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:21.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:22.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:22.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:23.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:23.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:24.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:24.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:25.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:25.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:26.031 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:41:26.032+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:41:26.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:26.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:27.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:27.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:28.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:28.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:29.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:29.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:30.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:30.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:31.032 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:41:31.032+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:41:31.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:31.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:32.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:32.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:33.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:33.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:34.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:34.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:35.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:35.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:36.032 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:41:36.033+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:41:36.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:36.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:37.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:37.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:38.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:38.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:39.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:39.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:40.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:40.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:41.034 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:41:41.034+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:41:41.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:41.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:42.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:42.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:43.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:43.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:44.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:44.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:45.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:45.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:46.035 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:41:46.035+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:41:46.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:46.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:47.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:47.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:48.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:48.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:49.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:49.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:50.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:50.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:51.035 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:41:51.036+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:41:51.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:51.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:52.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:52.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:53.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:53.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:54.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:54.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:55.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:55.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:56.037 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:41:56.037+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:41:56.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:56.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:57.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:57.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:58.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:58.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:41:59.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:41:59.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:00.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:00.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:01.038 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:42:01.038+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:42:01.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:01.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:02.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:02.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:03.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:03.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:04.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:04.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:05.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:05.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:06.038 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:42:06.040+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:42:06.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:06.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:07.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:07.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:08.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:08.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:09.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:09.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:10.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:10.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:11.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:11.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:11.039 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:42:11.041+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:42:12.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:12.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:13.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:13.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:14.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:14.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:15.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:15.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:16.040 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:42:16.040+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:42:16.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:16.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:17.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:17.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:18.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:18.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:19.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:19.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:20.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:20.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:21.041 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:42:21.042+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:42:21.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:21.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:22.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:22.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:23.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:23.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:24.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:24.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:25.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:25.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:26.042 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:42:26.042+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:42:26.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:26.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:27.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:27.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:28.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:28.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:29.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:29.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:30.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:30.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:31.043 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:42:31.043+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:42:31.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:31.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:32.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:32.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:33.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:33.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:34.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:34.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:35.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:35.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:36.044 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:42:36.045+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:42:36.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:36.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:37.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:37.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:38.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:38.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:39.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:39.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:40.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:40.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:41.045 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:42:41.046+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:42:41.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:41.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:42.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:42.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:42.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:42.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:43.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:43.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:44.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:44.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:45.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:45.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:46.046 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:42:46.046+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:42:46.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:46.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:47.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:47.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:48.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:48.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:49.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:49.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:50.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:50.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:51.046 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:42:51.047+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:42:51.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:51.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:52.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:52.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:53.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:53.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:54.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:54.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:55.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:55.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:56.047 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:42:56.048+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:42:56.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:56.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:58.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:58.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:58.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:58.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:42:59.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:42:59.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:00.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:00.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:01.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:43:01.048+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:43:01.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:01.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:02.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:02.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:03.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:03.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:04.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:04.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:05.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:05.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:06.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:43:06.050+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:43:06.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:06.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:07.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:07.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:08.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:08.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:09.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:09.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:10.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:10.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:11.050 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:43:11.051+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:43:11.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:11.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:12.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:12.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:13.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:13.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:14.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:14.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:15.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:15.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:16.052 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:43:16.052+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:43:16.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:16.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:17.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:17.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:18.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:18.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:19.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:19.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:20.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:20.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:21.053 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:43:21.054+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:43:21.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:21.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:22.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:22.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:23.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:23.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:24.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:24.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:25.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:25.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:26.054 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:43:26.055+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:43:26.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:26.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:27.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:27.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:28.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:28.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:29.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:29.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:30.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:30.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:31.055 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:43:31.056+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:43:31.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:31.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:32.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:32.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:33.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:33.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:34.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:34.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:35.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:35.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:36.056 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:43:36.057+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:43:36.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:36.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:37.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:37.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:38.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:38.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:39.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:39.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:40.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:40.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:41.057 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:43:41.058+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:43:41.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:41.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:42.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:42.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:43.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:43.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:44.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:44.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:45.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:45.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:46.058 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:43:46.058+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:43:46.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:46.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:47.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:47.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:48.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:48.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:49.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:49.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:50.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:50.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:51.059 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:43:51.059+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:43:51.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:51.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:52.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:52.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:53.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:53.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:54.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:54.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:55.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:55.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:56.060 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:43:56.061+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:43:56.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:56.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:57.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:57.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:43:58.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:43:58.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:00.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:00.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:01.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:01.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:01.060 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:44:01.061+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:44:01.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:01.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:02.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:02.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:03.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:03.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:04.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:04.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:05.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:05.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:06.062 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:44:06.062+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:44:06.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:06.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:07.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:07.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:08.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:08.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:09.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:09.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:10.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:10.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:11.063 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:44:11.064+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:44:11.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:11.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:12.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:12.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:13.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:13.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:14.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:14.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:15.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:15.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:16.063 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:44:16.064+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:44:16.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:16.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:17.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:17.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:18.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:18.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:19.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:19.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:20.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:20.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:21.064 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:44:21.065+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:44:21.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:21.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:22.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:22.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:23.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:23.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:24.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:24.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:25.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:25.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:26.066 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:44:26.066+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:44:26.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:26.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:27.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:27.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:28.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:28.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:29.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:29.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:30.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:30.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:31.066 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:44:31.067+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:44:31.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:31.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:33.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:33.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:33.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:33.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:34.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:34.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:35.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:35.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:36.067 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:44:36.068+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:44:36.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:36.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:37.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:37.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:38.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:38.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:39.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:39.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:40.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:40.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:41.068 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:44:41.069+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:44:41.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:41.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:42.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:42.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:43.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:43.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:44.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:44.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:45.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:45.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:46.069 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:44:46.070+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:44:46.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:46.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:47.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:47.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:48.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:48.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:49.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:49.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:50.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:50.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:51.070 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:44:51.071+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:44:51.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:51.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:52.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:52.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:53.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:53.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:54.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:54.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:55.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:55.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:56.071 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:44:56.072+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:44:56.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:56.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:57.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:57.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:58.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:58.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:44:59.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:44:59.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:00.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:00.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:01.073 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:45:01.074+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:45:01.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:01.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:02.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:02.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:03.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:03.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:05.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:05.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:06.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:06.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:06.074 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:45:06.075+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:45:07.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:07.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:08.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:08.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:09.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:09.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:10.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:10.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:11.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:11.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:11.074 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:45:11.076+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:45:12.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:12.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:13.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:13.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:14.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:14.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:15.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:15.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:16.075 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:45:16.077+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:45:16.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:16.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:17.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:17.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:18.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:18.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:19.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:19.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:20.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:20.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:21.076 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:45:21.076+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:45:21.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:21.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:22.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:22.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:23.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:23.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:24.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:24.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:25.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:25.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:26.077 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:45:26.077+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:45:26.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:26.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:27.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:27.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:28.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:28.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:29.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:29.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:30.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:30.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:31.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:31.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:31.077 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:45:31.078+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:45:31.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:31.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:33.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:33.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:34.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:34.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:35.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:35.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:36.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:36.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:36.079 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:45:36.079+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:45:36.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:36.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:37.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:37.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:38.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:38.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:39.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:39.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:40.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:40.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:41.080 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:45:41.080+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:45:41.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:41.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:42.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:42.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:43.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:43.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:44.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:44.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:45.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:45.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:46.081 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:45:46.081+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:45:46.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:46.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:47.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:47.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:49.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:49.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:49.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:49.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:50.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:50.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:51.082 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:45:51.082+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:45:52.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:52.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:53.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:53.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:54.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:54.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:55.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:55.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:56.083 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:45:56.083+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:45:56.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:56.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:57.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:57.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:58.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:58.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:45:59.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:45:59.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:00.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:00.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:01.084 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:46:01.084+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:46:01.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:01.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:02.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:02.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:03.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:03.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:04.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:04.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:05.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:05.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:06.085 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:46:06.085+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:46:06.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:06.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:07.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:07.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:08.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:08.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:09.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:09.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:10.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:10.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:11.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:46:11.087+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:46:11.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:11.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:12.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:12.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:13.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:13.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:14.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:14.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:15.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:15.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:16.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:46:16.087+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:46:16.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:16.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:17.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:17.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:18.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:18.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:19.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:19.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:20.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:20.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:21.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:46:21.088+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:46:21.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:21.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:22.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:22.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:23.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:23.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:24.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:24.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:25.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:25.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:26.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:46:26.089+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:46:26.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:26.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:27.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:27.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:28.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:28.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:29.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:29.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:30.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:30.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:31.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:46:31.090+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:46:31.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:31.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:32.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:32.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:33.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:33.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:34.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:34.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:35.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:35.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:36.091 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:46:36.091+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:46:36.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:36.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:37.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:37.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:38.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:38.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:39.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:39.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:40.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:40.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:41.092 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:46:41.093+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:46:41.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:41.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:42.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:42.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:43.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:43.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:44.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:44.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:45.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:45.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:46.093 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:46:46.093+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:46:46.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:46.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:47.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:47.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:48.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:48.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:49.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:49.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:50.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:50.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:51.093 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:46:51.094+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:46:51.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:51.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:52.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:52.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:53.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:53.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:54.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:54.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:55.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:55.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:56.095 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:46:56.096+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:46:56.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:56.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:57.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:57.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:58.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:58.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:46:59.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:46:59.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:00.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:00.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:01.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:01.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:01.096 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:47:01.096+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:47:02.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:02.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:03.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:03.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:04.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:04.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:05.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:05.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:06.097 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:47:06.097+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:47:06.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:06.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:07.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:07.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:08.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:08.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:09.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:09.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:10.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:10.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:11.097 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:47:11.098+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:47:11.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:11.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:12.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:12.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:13.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:13.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:14.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:14.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:15.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:15.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:16.099 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:47:16.099+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:47:16.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:16.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:17.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:17.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:18.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:18.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:19.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:19.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:20.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:20.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:21.100 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:47:21.100+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:47:21.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:21.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:22.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:22.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:23.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:23.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:24.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:24.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:25.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:25.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:26.101 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:47:26.101+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:47:26.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:26.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:27.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:27.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:28.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:28.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:29.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:29.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:30.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:30.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:31.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:47:31.101+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:47:31.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:31.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:32.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:32.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:33.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:33.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:34.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:34.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:35.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:35.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:36.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:47:36.103+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:47:36.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:36.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:37.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:37.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:38.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:38.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:39.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:39.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:40.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:40.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:41.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:47:41.103+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:47:41.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:41.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:42.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:42.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:43.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:43.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:44.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:44.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:45.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:45.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:46.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:47:46.105+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:47:46.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:46.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:47.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:47.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:48.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:48.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:49.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:49.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:50.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:50.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:51.106 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:47:51.105+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:47:51.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:51.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:52.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:52.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:53.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:53.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:54.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:54.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:55.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:55.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:56.107 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:47:56.107+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:47:56.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:56.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:57.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:57.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:58.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:58.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:47:59.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:47:59.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:00.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:00.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:01.108 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:48:01.109+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:48:01.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:01.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:02.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:02.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:03.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:03.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:04.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:04.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:05.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:05.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:06.108 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:48:06.109+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:48:06.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:06.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:07.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:07.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:08.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:08.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:09.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:09.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:10.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:10.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:11.110 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:48:11.109+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:48:11.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:11.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:12.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:12.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:13.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:13.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:14.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:14.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:15.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:15.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:16.111 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:48:16.110+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:48:16.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:16.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:17.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:17.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:18.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:18.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:19.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:19.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:20.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:20.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:21.111 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:48:21.111+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:48:21.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:21.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:22.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:22.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:23.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:23.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:24.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:24.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:25.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:25.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:26.113 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:48:26.112+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:48:26.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:26.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:27.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:27.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:28.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:28.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:29.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:29.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:30.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:30.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:31.114 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:48:31.113+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:48:31.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:31.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:32.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:32.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:33.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:33.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:34.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:34.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:35.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:35.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:36.115 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:48:36.115+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:48:36.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:36.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:37.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:37.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:38.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:38.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:39.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:39.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:40.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:40.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:41.116 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:48:41.116+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:48:41.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:41.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:42.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:42.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:43.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:43.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:44.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:44.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:45.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:45.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:46.117 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:48:46.117+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:48:46.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:46.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:47.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:47.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:48.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:48.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:49.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:49.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:50.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:50.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:51.118 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:48:51.117+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:48:51.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:51.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:52.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:52.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:53.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:53.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:54.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:54.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:55.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:55.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:56.119 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:48:56.119+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:48:56.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:56.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:57.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:57.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:58.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:58.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:48:59.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:48:59.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:00.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:00.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:01.120 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:49:01.119+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:49:01.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:01.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:02.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:02.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:03.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:03.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:04.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:04.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:05.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:05.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:06.121 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:49:06.121+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:49:06.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:06.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:07.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:07.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:08.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:08.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:09.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:09.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:10.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:10.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:11.122 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:49:11.121+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:49:11.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:11.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:12.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:12.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:13.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:13.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:14.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:14.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:15.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:15.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:16.123 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:49:16.123+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:49:16.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:16.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:17.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:17.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:18.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:18.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:19.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:19.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:20.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:20.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:21.124 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:49:21.123+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:49:21.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:21.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:22.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:22.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:23.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:23.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:24.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:24.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:25.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:25.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:26.125 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:49:26.124+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:49:26.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:26.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:27.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:27.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:28.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:28.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:29.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:29.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:30.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:30.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:31.125 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:49:31.125+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:49:31.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:31.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:32.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:32.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:33.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:33.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:34.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:34.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:35.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:35.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:36.127 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:49:36.126+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:49:36.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:36.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:37.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:37.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:38.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:38.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:39.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:39.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:40.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:40.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:41.128 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:49:41.127+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:49:41.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:41.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:42.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:42.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:43.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:43.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:44.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:44.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:45.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:45.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:46.129 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:49:46.128+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:49:46.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:46.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:47.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:47.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:48.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:48.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:49.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:49.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:50.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:50.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:51.129 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:49:51.129+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:49:51.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:51.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:52.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:52.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:53.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:53.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:54.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:54.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:55.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:55.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:56.131 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:49:56.130+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:49:56.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:56.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:57.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:57.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:58.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:58.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:49:59.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:49:59.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:00.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:00.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:01.132 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:50:01.131+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:50:01.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:01.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:02.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:02.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:03.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:03.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:04.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:04.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:05.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:05.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:06.133 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:50:06.133+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:50:06.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:06.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:07.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:07.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:08.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:08.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:09.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:09.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:10.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:10.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:11.134 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:50:11.133+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:50:11.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:11.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:12.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:12.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:13.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:13.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:14.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:14.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:15.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:15.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:16.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:50:16.135+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:50:16.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:16.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:17.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:17.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:18.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:18.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:19.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:19.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:20.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:20.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:21.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:50:21.136+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:50:21.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:21.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:22.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:22.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:23.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:23.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:24.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:24.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:25.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:25.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:26.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:50:26.136+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:50:26.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:26.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:27.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:27.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:28.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:28.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:29.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:29.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:30.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:30.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:31.138 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:50:31.137+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:50:31.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:31.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:32.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:32.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:33.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:33.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:34.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:34.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:35.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:35.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:36.139 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:50:36.138+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:50:36.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:36.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:37.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:37.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:38.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:38.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:39.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:39.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:40.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:40.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:41.140 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:50:41.139+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:50:41.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:41.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:42.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:42.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:43.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:43.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:44.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:44.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:45.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:45.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:46.141 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:50:46.140+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:50:46.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:46.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:47.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:47.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:48.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:48.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:49.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:49.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:50.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:50.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:51.142 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:50:51.141+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:50:51.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:51.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:52.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:52.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:53.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:53.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:54.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:54.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:55.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:55.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:56.143 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:50:56.143+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:50:56.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:56.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:57.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:57.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:58.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:58.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:50:59.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:50:59.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:00.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:00.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:01.144 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:51:01.144+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:51:01.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:01.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:02.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:02.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:03.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:03.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:04.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:04.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:05.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:05.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:06.144 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:51:06.145+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:51:06.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:06.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:07.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:07.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:08.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:08.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:09.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:09.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:10.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:10.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:11.145 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:51:11.145+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:51:11.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:11.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:12.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:12.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:13.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:13.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:14.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:14.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:15.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:15.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:16.146 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:51:16.145+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:51:16.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:16.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:17.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:17.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:18.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:18.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:19.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:19.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:20.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:20.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:21.147 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:51:21.147+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:51:21.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:21.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:22.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:22.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:23.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:23.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:24.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:24.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:25.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:25.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:26.148 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:51:26.148+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:51:27.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:27.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:27.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:27.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:28.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:28.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:29.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:29.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:30.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:30.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:31.149 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:51:31.149+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:51:31.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:31.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:32.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:32.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:33.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:33.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:34.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:34.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:35.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:35.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:36.150 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:51:36.149+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:51:36.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:36.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:37.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:37.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:38.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:38.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:39.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:39.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:40.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:40.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:41.151 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:51:41.150+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:51:41.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:41.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:42.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:42.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:43.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:43.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:44.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:44.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:45.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:45.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:46.151 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:51:46.151+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:51:46.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:46.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:47.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:47.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:48.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:48.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:49.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:49.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:50.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:50.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:51.153 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:51:51.153+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:51:51.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:51.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:52.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:52.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:53.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:53.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:54.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:54.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:55.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:55.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:56.154 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:51:56.154+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:51:56.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:56.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:57.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:57.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:51:58.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:51:58.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:00.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:00.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:00.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:00.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:01.155 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:52:01.155+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:52:02.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:02.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:03.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:03.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:04.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:04.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:04.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:04.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:05.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:05.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:06.156 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:52:06.156+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:52:06.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:06.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:07.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:07.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:08.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:08.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:09.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:09.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:10.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:10.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:11.157 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:52:11.157+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:52:11.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:11.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:12.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:12.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:13.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:13.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:14.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:14.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:15.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:15.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:16.158 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:52:16.157+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:52:16.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:16.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:17.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:17.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:18.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:18.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:19.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:19.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:20.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:20.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:21.159 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:52:21.158+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:52:21.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:21.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:23.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:23.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:24.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:24.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:25.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:25.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:26.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:26.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:26.160 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:52:26.159+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:52:27.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:27.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:28.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:28.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:29.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:29.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:30.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:30.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:31.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:31.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:31.160 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:52:31.160+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:52:32.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:32.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:33.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:33.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:33.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:33.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:35.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:35.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:35.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:35.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:36.161 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:52:36.161+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:52:36.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:36.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:38.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:38.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:39.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:39.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:40.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:40.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:40.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:40.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:41.162 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:52:41.162+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:52:41.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:41.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:43.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:43.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:44.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:44.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:45.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:45.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:46.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:46.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:46.163 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:52:46.163+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:52:47.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:47.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:48.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:48.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:49.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:49.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:50.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:50.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:51.165 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:52:51.165+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:52:51.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:51.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:52.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:52.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:53.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:53.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:54.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:54.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:55.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:55.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:56.166 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:52:56.166+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:52:56.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:56.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:57.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:57.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:58.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:58.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:52:59.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:52:59.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:00.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:00.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:01.167 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:53:01.167+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:53:01.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:01.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:02.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:02.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:03.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:03.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:04.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:04.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:05.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:05.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:06.167 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:53:06.167+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:53:06.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:06.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:07.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:07.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:08.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:08.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:09.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:09.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:10.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:10.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:11.169 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:53:11.168+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:53:11.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:11.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:12.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:12.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:13.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:13.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:14.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:14.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:15.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:15.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:16.170 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:53:16.170+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:53:16.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:16.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:17.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:17.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:18.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:18.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:19.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:19.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:20.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:20.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:21.171 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:53:21.171+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:53:21.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:21.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:22.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:22.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:23.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:23.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:24.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:24.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:25.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:25.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:26.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:26.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:26.171 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:53:26.172+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:53:27.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:27.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:28.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:28.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:29.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:29.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:30.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:30.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:31.173 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:53:31.172+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:53:31.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:31.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:32.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:32.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:33.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:33.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:34.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:34.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:35.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:35.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:36.174 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:53:36.174+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:53:36.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:36.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:37.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:37.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:38.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:38.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:39.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:39.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:40.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:40.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:41.175 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:53:41.174+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:53:41.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:41.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:42.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:42.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:43.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:43.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:44.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:44.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:45.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:45.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:46.175 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:53:46.175+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:53:46.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:46.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:47.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:47.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:48.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:48.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:49.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:49.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:50.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:50.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:51.176 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:53:51.176+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:53:51.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:51.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:52.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:52.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:53.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:53.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:54.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:54.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:55.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:55.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:56.177 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:53:56.177+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:53:56.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:56.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:57.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:57.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:58.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:58.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:53:59.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:53:59.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:00.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:00.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:01.179 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:54:01.178+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:54:01.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:01.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:02.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:02.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:03.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:03.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:04.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:04.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:05.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:05.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:06.180 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:54:06.180+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:54:06.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:06.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:07.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:07.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:08.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:08.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:09.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:09.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:10.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:10.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:11.181 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:54:11.181+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:54:11.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:11.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:12.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:12.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:13.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:13.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:14.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:14.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:15.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:15.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:16.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:16.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:17.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:17.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:17.867 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:54:17.868+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:54:18.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:18.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:19.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:19.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:20.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:20.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:21.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:21.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:22.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:22.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:22.869 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:54:22.869+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:54:23.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:23.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:24.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:24.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:25.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:25.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:26.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:26.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:27.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:27.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:27.870 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:54:27.870+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:54:28.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:28.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:29.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:29.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:30.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:30.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:31.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:31.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:32.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:32.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:32.871 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:54:32.871+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:54:33.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:33.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:34.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:34.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:35.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:35.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:36.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:36.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:37.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:37.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:37.873 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:54:37.873+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:54:38.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:38.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:39.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:39.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:40.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:40.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:41.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:41.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:42.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:42.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:42.874 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:54:42.874+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:54:43.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:43.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:44.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:44.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:45.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:45.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:46.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:46.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:47.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:47.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:47.875 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:54:47.875+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:54:48.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:48.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:49.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:49.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:50.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:50.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:51.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:51.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:52.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:52.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:52.876 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:54:52.876+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:54:53.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:53.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:54.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:54.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:55.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:55.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:56.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:56.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:57.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:57.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:57.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:54:57.877+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:54:58.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:58.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:54:59.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:54:59.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:00.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:00.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:01.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:01.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:02.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:02.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:02.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:55:02.878+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:55:02.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:02.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:03.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:03.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:04.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:04.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:05.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:05.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:07.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:07.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:07.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:55:07.879+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:55:07.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:07.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:08.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:08.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:09.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:09.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:10.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:10.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:11.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:11.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:12.880 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:55:12.879+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:55:12.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:12.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:13.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:13.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:14.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:14.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:15.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:15.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:16.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:16.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:17.880 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:55:17.880+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:55:17.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:17.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:18.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:18.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:20.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:20.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:21.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:21.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:22.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:22.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:23.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:23.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:24.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:24.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:25.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:25.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:25.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:25.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:26.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:55:26.194+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:55:26.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:26.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:28.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:28.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:28.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:28.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:29.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:29.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:30.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:30.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:31.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:55:31.195+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:55:31.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:31.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:32.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:32.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:33.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:33.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:34.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:34.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:36.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:36.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:36.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:55:36.196+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:55:37.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:37.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:38.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:38.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:38.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:38.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:40.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:40.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:41.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:41.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:41.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:55:41.197+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:55:42.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:42.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:42.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:42.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:44.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:44.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:44.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:44.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:46.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:46.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:46.199 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:55:46.198+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:55:46.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:46.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:47.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:47.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:48.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:48.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:49.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:49.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:50.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:50.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:51.199 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:55:51.199+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:55:51.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:51.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:52.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:52.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:53.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:53.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:55.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:55.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:56.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:56.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:56.201 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:55:56.200+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:55:57.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:57.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:57.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:57.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:58.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:58.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:55:59.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:55:59.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:00.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:00.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:01.201 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:56:01.201+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:56:01.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:01.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:02.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:02.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:03.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:03.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:04.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:04.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:05.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:05.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:06.202 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:56:06.202+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:56:06.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:06.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:07.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:07.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:08.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:08.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:10.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:10.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:11.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:11.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:11.203 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:56:11.203+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:56:12.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:12.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:13.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:13.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:13.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:13.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:14.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:14.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:15.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:15.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:16.205 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:56:16.204+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:56:16.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:16.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:17.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:17.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:18.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:18.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:19.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:19.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:20.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:20.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:21.206 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:56:21.205+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:56:21.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:21.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:23.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:23.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:24.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:24.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:25.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:25.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:26.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:26.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:26.207 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:56:26.207+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:56:27.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:27.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:28.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:28.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:29.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:29.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:30.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:30.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:31.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:31.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:31.208 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:56:31.208+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:56:32.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:32.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:33.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:33.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:34.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:34.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:35.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:35.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:36.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:36.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:36.209 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:56:36.209+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:56:37.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:37.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:38.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:38.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:39.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:39.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:40.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:40.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:41.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:41.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:41.209 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:56:41.209+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:56:42.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:42.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:43.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:43.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:44.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:44.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:45.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:45.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:46.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:46.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:46.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:56:46.210+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:56:47.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:47.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:48.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:48.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:49.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:49.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:50.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:50.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:51.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:51.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:51.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:56:51.211+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:56:52.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:52.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:53.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:53.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:54.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:54.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:55.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:55.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:56.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:56.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:56.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:56:56.212+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:56:57.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:57.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:58.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:58.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:56:59.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:56:59.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:00.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:00.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:01.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:01.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:01.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:57:01.213+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:57:02.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:02.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:03.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:03.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:04.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:04.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:05.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:05.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:06.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:06.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:06.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:57:06.214+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:57:07.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:07.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:08.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:08.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:09.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:09.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:10.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:10.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:11.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:11.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:11.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:57:11.215+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:57:12.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:12.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:13.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:13.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:14.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:14.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:15.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:15.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:16.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:16.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:16.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:57:16.216+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:57:17.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:17.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:18.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:18.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:19.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:19.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:20.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:20.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:20.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:20.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:21.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:57:21.218+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:57:22.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:22.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:23.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:23.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:24.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:24.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:25.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:25.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:26.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:26.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:26.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:57:26.219+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:57:26.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:26.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:28.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:28.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:29.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:29.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:30.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:30.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:31.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:31.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:31.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:57:31.218+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:57:32.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:32.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:33.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:33.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:34.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:34.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:35.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:35.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:36.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:36.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:36.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:57:36.219+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:57:37.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:37.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:38.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:38.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:38.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:38.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:39.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:39.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:40.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:40.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:41.220 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:57:41.220+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:57:41.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:41.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:42.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:42.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:43.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:43.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:44.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:44.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:46.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:46.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:46.221 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:57:46.221+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:57:47.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:47.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:48.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:48.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:49.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:49.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:50.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:50.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:51.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:51.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:51.222 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:57:51.222+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:57:51.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:51.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:53.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:53.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:54.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:54.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:55.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:55.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:55.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:55.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:56.223 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:57:56.223+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:57:56.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:56.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:57.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:57.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:58.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:58.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:57:59.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:57:59.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:00.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:00.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:01.225 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:58:01.224+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:58:02.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:02.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:02.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:02.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:03.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:03.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:04.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:04.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:05.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:05.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:06.226 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:58:06.225+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:58:06.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:06.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:07.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:07.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:08.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:08.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:09.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:09.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:10.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:10.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:11.227 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:58:11.227+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:58:11.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:11.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:12.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:12.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:13.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:13.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:14.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:14.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:15.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:15.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:16.228 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:58:16.228+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:58:16.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:16.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:17.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:17.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:18.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:18.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:19.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:19.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:20.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:20.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:21.228 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:58:21.228+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:58:21.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:21.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:22.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:22.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:23.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:23.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:24.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:24.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:25.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:25.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:26.230 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:58:26.229+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:58:26.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:26.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:27.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:27.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:28.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:28.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:29.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:29.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:30.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:30.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:31.231 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:58:31.231+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:58:31.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:31.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:32.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:32.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:33.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:33.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:34.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:34.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:35.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:35.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:36.232 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:58:36.232+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:58:36.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:36.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:37.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:37.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:38.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:38.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:39.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:39.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:40.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:40.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:41.232 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:58:41.232+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:58:41.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:41.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:42.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:42.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:43.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:43.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:44.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:44.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:45.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:45.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:46.233 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:58:46.233+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:58:46.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:46.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:47.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:47.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:48.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:48.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:49.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:49.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:50.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:50.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:51.235 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:58:51.235+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:58:51.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:51.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:52.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:52.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:53.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:53.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:54.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:54.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:55.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:55.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:56.236 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:58:56.236+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:58:56.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:56.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:57.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:57.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:58.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:58.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:58:59.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:58:59.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:00.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:00.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:01.237 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:59:01.237+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:59:01.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:01.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:02.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:02.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:03.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:03.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:04.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:04.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:05.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:05.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:06.238 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:59:06.238+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:59:06.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:06.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:07.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:07.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:08.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:08.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:09.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:09.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:10.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:10.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:11.238 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:59:11.238+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:59:11.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:11.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:12.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:12.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:13.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:13.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:14.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:14.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:15.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:15.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:16.240 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:59:16.240+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:59:16.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:16.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:17.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:17.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:18.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:18.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:19.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:19.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:20.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:20.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:21.240 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:59:21.240+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:59:21.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:21.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:22.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:22.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:23.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:23.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:24.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:24.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:25.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:25.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:26.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:59:26.241+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:59:26.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:26.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:27.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:27.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:28.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:28.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:29.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:29.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:30.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:30.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:31.242 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:59:31.242+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:59:31.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:31.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:32.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:32.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:33.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:33.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:34.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:34.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:35.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:35.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:36.244 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:59:36.243+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:59:36.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:36.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:37.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:37.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:38.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:38.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:40.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:40.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:40.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:40.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:41.245 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:59:41.245+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:59:41.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:41.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:42.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:42.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:43.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:43.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:44.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:44.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:46.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:46.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:46.245 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:59:46.245+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:59:46.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:46.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:47.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:47.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:48.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:48.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:49.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:49.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:50.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:50.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:51.246 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:59:51.246+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:59:51.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:51.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:52.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:52.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:53.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:53.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:55.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:55.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:56.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:56.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:56.248 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T11:59:56.248+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T11:59:57.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:57.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:58.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:58.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T11:59:59.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T11:59:59.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:00.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:00.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:01.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:01.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:01.249 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:00:01.249+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:00:02.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:02.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:02.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:02.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:04.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:04.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:05.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:05.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:06.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:06.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:06.250 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:00:06.250+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:00:07.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:07.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:08.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:08.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:08.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:08.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:09.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:09.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:11.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:11.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:11.251 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:00:11.251+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:00:12.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:12.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:13.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:13.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:14.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:14.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:15.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:15.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:16.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:16.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:16.251 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:00:16.251+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:00:17.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:17.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:18.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:18.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:18.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:18.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:20.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:20.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:21.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:21.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:21.252 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:00:21.252+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:00:22.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:22.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:22.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:22.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:23.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:23.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:25.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:25.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:26.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:26.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:26.253 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:00:26.254+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:00:27.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:27.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:28.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:28.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:28.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:28.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:29.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:29.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:30.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:30.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:31.254 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:00:31.255+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:00:32.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:32.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:33.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:33.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:34.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:34.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:35.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:35.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:36.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:36.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:36.255 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:00:36.255+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:00:37.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:37.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:38.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:38.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:39.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:39.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:40.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:40.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:41.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:41.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:41.255 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:00:41.255+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:00:42.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:42.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:43.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:43.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:44.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:44.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:45.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:45.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:46.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:46.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:46.257 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:00:46.257+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:00:47.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:47.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:48.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:48.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:49.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:49.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:50.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:50.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:51.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:51.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:51.258 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:00:51.258+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:00:52.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:52.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:53.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:53.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:54.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:54.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:55.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:55.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:56.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:56.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:56.259 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:00:56.259+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:00:57.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:57.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:58.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:58.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:00:59.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:00:59.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:00.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:00.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:00.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:00.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:01.260 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:01:01.260+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:01:02.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:02.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:03.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:03.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:04.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:04.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:05.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:05.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:06.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:06.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:06.260 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:01:06.261+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:01:07.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:07.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:08.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:08.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:09.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:09.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:10.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:10.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:11.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:11.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:11.261 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:01:11.261+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:01:12.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:12.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:13.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:13.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:14.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:14.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:15.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:15.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:16.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:16.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:16.263 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:01:16.263+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:01:17.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:17.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:18.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:18.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:19.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:19.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:20.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:20.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:21.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:21.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:21.264 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:01:21.263+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:01:22.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:22.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:23.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:23.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:24.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:24.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:25.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:25.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:26.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:26.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:26.265 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:01:26.265+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:01:27.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:27.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:28.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:28.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:29.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:29.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:30.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:30.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:31.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:31.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:31.266 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:01:31.266+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:01:32.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:32.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:33.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:33.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:34.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:34.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:35.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:35.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:36.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:36.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:36.266 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:01:36.266+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:01:37.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:37.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:38.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:38.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:39.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:39.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:40.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:40.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:41.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:41.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:41.268 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:01:41.268+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:01:42.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:42.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:43.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:43.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:44.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:44.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:45.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:45.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:46.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:46.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:46.268 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:01:46.268+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:01:47.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:47.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:48.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:48.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:49.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:49.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:50.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:50.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:51.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:51.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:51.270 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:01:51.269+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:01:52.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:52.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:53.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:53.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:54.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:54.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:55.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:55.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:56.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:56.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:56.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:01:56.271+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:01:57.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:57.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:58.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:58.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:01:59.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:01:59.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:00.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:00.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:01.272 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:02:01.272+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:02:01.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:01.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:02.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:02.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:03.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:03.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:04.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:04.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:05.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:05.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:06.273 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:02:06.273+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:02:06.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:06.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:07.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:07.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:08.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:08.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:09.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:09.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:10.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:10.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:11.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:11.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:11.274 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:02:11.274+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:02:12.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:12.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:13.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:13.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:14.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:14.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:15.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:15.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:16.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:16.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:16.275 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:02:16.274+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:02:17.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:17.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:18.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:18.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:19.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:19.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:20.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:20.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:21.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:21.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:21.275 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:02:21.275+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:02:22.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:22.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:23.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:23.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:24.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:24.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:25.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:25.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:26.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:26.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:26.276 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:02:26.276+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:02:27.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:27.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:28.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:28.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:29.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:29.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:30.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:30.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:31.278 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:02:31.277+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:02:31.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:31.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:32.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:32.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:33.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:33.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:34.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:34.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:35.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:35.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:36.278 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:02:36.278+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:02:36.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:36.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:37.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:37.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:38.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:38.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:39.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:39.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:40.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:40.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:41.279 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:02:41.279+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:02:41.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:41.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:42.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:42.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:43.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:43.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:44.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:44.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:45.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:45.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:46.280 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:02:46.280+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:02:46.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:46.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:47.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:47.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:48.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:48.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:49.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:49.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:50.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:50.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:51.282 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:02:51.282+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:02:51.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:51.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:52.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:52.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:53.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:53.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:54.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:54.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:55.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:55.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:56.282 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:02:56.282+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:02:56.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:56.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:57.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:57.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:58.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:58.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:02:59.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:02:59.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:00.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:00.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:01.283 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:03:01.283+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:03:01.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:01.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:02.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:02.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:03.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:03.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:04.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:04.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:05.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:05.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:06.284 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:03:06.284+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:03:06.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:06.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:07.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:07.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:08.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:08.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:09.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:09.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:10.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:10.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:11.285 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:03:11.285+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:03:11.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:11.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:12.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:12.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:13.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:13.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:14.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:14.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:15.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:15.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:16.286 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:03:16.286+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:03:16.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:16.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:17.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:17.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:18.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:18.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:19.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:19.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:20.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:20.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:21.288 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:03:21.288+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:03:21.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:21.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:22.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:22.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:23.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:23.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:24.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:24.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:25.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:25.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:26.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:03:26.290+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:03:26.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:26.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:27.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:27.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:28.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:28.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:29.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:29.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:30.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:30.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:31.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:03:31.290+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:03:31.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:31.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:32.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:32.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:33.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:33.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:34.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:34.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:35.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:35.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:36.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:03:36.291+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:03:36.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:36.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:37.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:37.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:38.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:38.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:39.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:39.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:40.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:40.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:41.291 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:03:41.291+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:03:41.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:41.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:42.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:42.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:43.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:43.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:44.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:44.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:45.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:45.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:46.293 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:03:46.292+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:03:46.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:46.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:47.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:47.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:48.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:48.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:49.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:49.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:50.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:50.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:51.294 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:03:51.293+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:03:51.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:51.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:52.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:52.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:53.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:53.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:54.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:54.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:55.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:55.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:56.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:03:56.295+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:03:56.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:56.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:57.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:57.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:58.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:58.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:03:59.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:03:59.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:00.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:00.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:01.296 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:04:01.296+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:04:01.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:01.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:02.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:02.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:03.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:03.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:04.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:04.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:05.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:05.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:06.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:04:06.297+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:04:06.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:06.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:07.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:07.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:08.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:08.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:09.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:09.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:10.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:10.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:11.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:04:11.298+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:04:11.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:11.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:12.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:12.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:13.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:13.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:14.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:14.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:15.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:15.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:16.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:04:16.298+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:04:16.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:16.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:17.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:17.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:18.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:18.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:19.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:19.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:20.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:20.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:21.300 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:04:21.299+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:04:21.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:21.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:22.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:22.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:23.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:23.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:24.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:24.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:25.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:25.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:26.300 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:04:26.300+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:04:26.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:26.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:27.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:27.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:28.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:28.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:30.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:30.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:31.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:31.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:31.302 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:04:31.301+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:04:32.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:32.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:33.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:33.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:34.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:34.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:35.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:35.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:36.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:36.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:36.302 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:04:36.302+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:04:37.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:37.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:37.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:37.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:39.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:39.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:39.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:39.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:40.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:40.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:41.303 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:04:41.303+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:04:42.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:42.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:43.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:43.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:44.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:44.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:45.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:45.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:46.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:46.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:46.305 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:04:46.305+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:04:47.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:47.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:48.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:48.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:49.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:49.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:50.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:50.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:51.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:51.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:51.306 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:04:51.306+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:04:52.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:52.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:52.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:52.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:54.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:54.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:54.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:54.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:55.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:55.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:56.306 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:04:56.306+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:04:56.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:56.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:57.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:57.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:58.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:58.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:04:59.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:04:59.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:00.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:00.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:01.308 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:05:01.308+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:05:01.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:01.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:02.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:02.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:03.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:03.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:05.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:05.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:06.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:06.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:06.308 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:05:06.308+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:05:06.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:06.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:08.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:08.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:09.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:09.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:10.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:10.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:11.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:11.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:11.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:05:11.309+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:05:12.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:12.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:13.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:13.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:14.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:14.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:15.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:15.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:16.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:16.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:16.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:05:16.310+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:05:17.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:17.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:18.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:18.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:19.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:19.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:20.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:20.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:21.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:21.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:21.311 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:05:21.312+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:05:22.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:22.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:23.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:23.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:24.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:24.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:25.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:25.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:26.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:26.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:26.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:05:26.312+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:05:27.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:27.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:28.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:28.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:29.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:29.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:30.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:30.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:31.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:31.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:31.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:05:31.314+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:05:32.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:32.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:33.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:33.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:34.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:34.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:35.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:35.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:36.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:36.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:36.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:05:36.314+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:05:37.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:37.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:38.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:38.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:39.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:39.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:40.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:40.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:41.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:41.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:41.315 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:05:41.315+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:05:42.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:42.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:43.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:43.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:44.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:44.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:45.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:45.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:46.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:46.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:46.317 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:05:46.316+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:05:47.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:47.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:48.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:48.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:49.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:49.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:50.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:50.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:51.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:51.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:51.318 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:05:51.317+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:05:52.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:52.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:53.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:53.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:54.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:54.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:55.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:55.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:56.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:56.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:56.318 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:05:56.318+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:05:57.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:57.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:58.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:58.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:05:59.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:05:59.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:00.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:00.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:01.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:01.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:01.319 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:06:01.319+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:06:02.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:02.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:03.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:03.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:04.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:04.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:05.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:05.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:06.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:06.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:06.321 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:06:06.321+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:06:07.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:07.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:08.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:08.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:09.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:09.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:10.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:10.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:11.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:11.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:11.321 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:06:11.321+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:06:12.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:12.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:13.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:13.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:14.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:14.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:15.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:15.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:16.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:16.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:16.322 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:06:16.322+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:06:17.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:17.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:18.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:18.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:19.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:19.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:20.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:20.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:21.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:21.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:21.323 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:06:21.323+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:06:22.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:22.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:23.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:23.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:24.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:24.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:25.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:25.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:26.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:26.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:26.324 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:06:26.324+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:06:27.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:27.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:28.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:28.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:29.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:29.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:30.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:30.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:31.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:31.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:31.325 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:06:31.325+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:06:32.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:32.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:33.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:33.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:34.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:34.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:35.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:35.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:36.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:36.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:36.326 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:06:36.327+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:06:37.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:37.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:38.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:38.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:39.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:39.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:40.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:40.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:41.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:41.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:41.327 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:06:41.328+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:06:42.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:42.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:43.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:43.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:44.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:44.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:45.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:45.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:46.327 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:06:46.327+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:06:46.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:46.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:47.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:47.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:48.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:48.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:49.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:49.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:50.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:50.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:51.328 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:06:51.328+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:06:51.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:51.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:52.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:52.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:53.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:53.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:54.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:54.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:55.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:55.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:56.329 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:06:56.329+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:06:56.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:56.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:57.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:57.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:58.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:58.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:06:59.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:06:59.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:00.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:00.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:01.330 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:07:01.330+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:07:01.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:01.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:02.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:02.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:03.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:03.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:04.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:04.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:05.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:05.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:06.331 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:07:06.331+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:07:06.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:06.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:07.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:07.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:08.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:08.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:09.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:09.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:10.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:10.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:11.332 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:07:11.332+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:07:11.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:11.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:12.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:12.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:13.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:13.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:14.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:14.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:15.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:15.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:16.333 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:07:16.333+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:07:16.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:16.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:17.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:17.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:18.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:18.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:19.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:19.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:20.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:20.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:21.334 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:07:21.334+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:07:21.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:21.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:22.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:22.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:23.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:23.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:24.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:24.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:25.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:25.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:26.335 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:07:26.335+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:07:26.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:26.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:27.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:27.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:28.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:28.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:29.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:29.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:30.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:30.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:31.336 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:07:31.336+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:07:31.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:31.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:32.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:32.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:33.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:33.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:34.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:34.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:35.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:35.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:36.337 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:07:36.337+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:07:36.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:36.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:37.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:37.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:38.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:38.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:39.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:39.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:40.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:40.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:41.339 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:07:41.338+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:07:41.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:41.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:42.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:42.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:43.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:43.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:44.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:44.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:45.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:45.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:46.340 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:07:46.340+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:07:46.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:46.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:47.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:47.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:48.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:48.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:49.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:49.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:50.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:50.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:51.341 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:07:51.341+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:07:51.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:51.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:52.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:52.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:53.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:53.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:54.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:54.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:55.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:55.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:56.341 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:07:56.341+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:07:56.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:56.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:57.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:57.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:58.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:58.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:07:59.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:07:59.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:00.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:00.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:01.343 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:08:01.342+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:08:01.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:01.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:02.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:02.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:03.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:03.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:04.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:04.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:05.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:05.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:06.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:06.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:06.343 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:08:06.343+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:08:07.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:07.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:08.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:08.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:09.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:09.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:10.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:10.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:11.344 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:08:11.345+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:08:11.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:11.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:12.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:12.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:13.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:13.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:14.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:14.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:15.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:15.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:16.345 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:08:16.346+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:08:16.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:16.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:17.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:17.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:18.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:18.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:19.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:19.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:20.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:20.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:21.346 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:08:21.347+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:08:21.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:21.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:22.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:22.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:23.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:23.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:24.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:24.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:25.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:25.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:26.347 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:08:26.347+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:08:26.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:26.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:27.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:27.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:28.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:28.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:29.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:29.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:30.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:30.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:31.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:31.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:31.348 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:08:31.348+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:08:32.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:32.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:33.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:33.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:34.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:34.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:35.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:35.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:36.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:36.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:36.349 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:08:36.349+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:08:37.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:37.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:38.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:38.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:39.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:39.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:40.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:40.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:41.350 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:08:41.350+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:08:41.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:41.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:42.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:42.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:43.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:43.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:44.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:44.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:45.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:45.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:46.351 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:08:46.351+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:08:46.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:46.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:47.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:47.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:48.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:48.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:49.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:49.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:50.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:50.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:51.352 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:08:51.353+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:08:51.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:51.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:52.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:52.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:53.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:53.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:54.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:54.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:55.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:55.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:56.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:56.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:56.353 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:08:56.353+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:08:57.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:57.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:58.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:58.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:08:59.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:08:59.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:00.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:00.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:01.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:01.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:01.354 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:09:01.354+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:09:02.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:02.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:03.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:03.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:04.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:04.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:05.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:05.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:06.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:06.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:06.355 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:09:06.355+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:09:07.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:07.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:08.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:08.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:09.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:09.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:10.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:10.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:11.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:11.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:11.356 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:09:11.356+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:09:12.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:12.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:13.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:13.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:14.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:14.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:15.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:15.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:16.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:16.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:16.357 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:09:16.357+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:09:17.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:17.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:18.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:18.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:19.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:19.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:20.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:20.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:21.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:21.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:21.358 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:09:21.358+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:09:22.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:22.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:23.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:23.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:24.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:24.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:25.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:25.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:26.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:26.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:26.359 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:09:26.359+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:09:27.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:27.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:28.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:28.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:29.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:29.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:30.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:30.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:31.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:31.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:31.360 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:09:31.360+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:09:32.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:32.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:33.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:33.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:34.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:34.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:35.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:35.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:36.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:36.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:36.362 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:09:36.363+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:09:37.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:37.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:38.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:38.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:39.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:39.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:40.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:40.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:41.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:41.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:41.363 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:09:41.364+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:09:42.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:42.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:43.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:43.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:44.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:44.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:45.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:45.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:46.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:46.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:46.363 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:09:46.365+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:09:47.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:47.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:48.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:48.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:49.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:49.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:50.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:50.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:51.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:51.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:51.364 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:09:51.364+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:09:52.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:52.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:53.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:53.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:54.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:54.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:55.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:55.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:56.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:56.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:56.365 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:09:56.365+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:09:57.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:57.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:58.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:58.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:09:59.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:09:59.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:00.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:00.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:01.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:01.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:01.366 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:10:01.366+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:10:02.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:02.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:03.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:03.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:04.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:04.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:05.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:05.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:06.368 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:10:06.368+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:10:06.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:06.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:07.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:07.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:08.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:08.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:09.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:09.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:10.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:10.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:11.368 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:10:11.368+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:10:11.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:11.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:12.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:12.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:13.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:13.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:14.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:14.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:15.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:15.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:16.369 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:10:16.370+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:10:16.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:16.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:17.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:17.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:18.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:18.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:19.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:19.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:20.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:20.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:21.370 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:10:21.370+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:10:21.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:21.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:22.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:22.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:23.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:23.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:24.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:24.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:25.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:25.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:26.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:10:26.372+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:10:26.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:26.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:27.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:27.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:28.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:28.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:29.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:29.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:30.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:30.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:31.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:10:31.373+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:10:31.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:31.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:32.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:32.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:33.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:33.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:34.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:34.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:35.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:35.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:36.374 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:10:36.374+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:10:36.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:36.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:37.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:37.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:38.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:38.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:39.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:39.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:40.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:40.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:41.375 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:10:41.375+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:10:41.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:41.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:42.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:42.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:43.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:43.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:44.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:44.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:45.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:45.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:46.375 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:10:46.376+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:10:46.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:46.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:47.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:47.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:48.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:48.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:49.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:49.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:50.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:50.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:51.376 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:10:51.377+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:10:51.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:51.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:52.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:52.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:53.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:53.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:54.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:54.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:55.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:55.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:56.377 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:10:56.377+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:10:56.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:56.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:57.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:57.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:58.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:58.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:10:59.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:10:59.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:00.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:00.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:01.379 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:11:01.379+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:11:01.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:01.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:02.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:02.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:03.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:03.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:04.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:04.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:05.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:05.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:06.379 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:11:06.379+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:11:06.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:06.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:07.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:07.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:08.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:08.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:09.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:09.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:10.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:10.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:11.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:11:11.380+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:11:11.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:11.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:12.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:12.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:13.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:13.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:14.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:14.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:15.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:15.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:16.381 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:11:16.381+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:11:16.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:16.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:17.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:17.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:18.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:18.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:19.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:19.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:20.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:20.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:21.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:11:21.382+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:11:21.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:21.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:22.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:22.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:23.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:23.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:24.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:24.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:25.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:25.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:26.383 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:11:26.383+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:11:26.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:26.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:27.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:27.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:28.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:28.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:29.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:29.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:30.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:30.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:31.385 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:11:31.385+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:11:31.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:31.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:32.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:32.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:33.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:33.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:34.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:34.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:35.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:35.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:36.385 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:11:36.385+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:11:36.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:36.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:37.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:37.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:38.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:38.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:39.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:39.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:40.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:40.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:41.386 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:11:41.386+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:11:41.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:41.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:42.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:42.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:43.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:43.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:44.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:44.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:45.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:45.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:46.387 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:11:46.387+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:11:46.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:46.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:47.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:47.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:48.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:48.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:49.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:49.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:50.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:50.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:51.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:11:51.389+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:11:51.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:51.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:52.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:52.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:53.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:53.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:54.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:54.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:55.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:55.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:56.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:11:56.389+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:11:56.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:56.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:57.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:57.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:58.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:58.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:11:59.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:11:59.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:00.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:00.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:01.390 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:12:01.390+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:12:01.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:01.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:02.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:02.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:03.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:03.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:04.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:04.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:05.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:05.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:06.391 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:12:06.391+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:12:06.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:06.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:07.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:07.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:08.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:08.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:09.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:09.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:10.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:10.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:11.392 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:12:11.392+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:12:11.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:11.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:12.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:12.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:13.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:13.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:14.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:14.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:15.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:15.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:16.393 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:12:16.393+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:12:16.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:16.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:17.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:17.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:18.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:18.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:19.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:19.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:20.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:20.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:21.395 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:12:21.394+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:12:21.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:21.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:22.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:22.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:23.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:23.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:24.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:24.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:25.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:25.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:26.395 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:12:26.395+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:12:26.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:26.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:27.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:27.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:28.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:28.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:29.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:29.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:30.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:30.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:31.396 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:12:31.396+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:12:32.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:32.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:32.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:32.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:33.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:33.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:34.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:34.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:35.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:35.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:36.397 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:12:36.397+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:12:37.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:37.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:37.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:37.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:39.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:39.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:40.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:40.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:41.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:41.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:41.398 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:12:41.399+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:12:42.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:42.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:43.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:43.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:44.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:44.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:45.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:45.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:46.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:46.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:46.399 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:12:46.400+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:12:47.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:47.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:48.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:48.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:49.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:49.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:50.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:50.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:50.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:50.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:51.399 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:12:51.399+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:12:51.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:51.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:52.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:52.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:53.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:53.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:54.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:54.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:55.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:55.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:56.400 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:12:56.400+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:12:56.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:56.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:57.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:57.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:58.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:58.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:12:59.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:12:59.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:00.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:00.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:01.401 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:13:01.401+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:13:01.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:01.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:02.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:02.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:03.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:03.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:04.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:04.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:05.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:05.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:06.402 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:13:06.402+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:13:06.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:06.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:07.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:07.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:08.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:08.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:09.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:09.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:10.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:10.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:11.403 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:13:11.404+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:13:11.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:11.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:12.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:12.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:13.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:13.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:15.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:15.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:16.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:16.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:16.404 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:13:16.405+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:13:16.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:16.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:17.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:17.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:18.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:18.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:20.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:20.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:21.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:21.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:21.405 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:13:21.406+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:13:21.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:21.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:22.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:22.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:24.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:24.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:24.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:24.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:26.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:26.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:26.406 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:13:26.406+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:13:27.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:27.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:28.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:28.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:29.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:29.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:30.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:30.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:31.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:31.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:31.409 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:13:31.407+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:13:32.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:32.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:33.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:33.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:34.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:34.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:35.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:35.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:36.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:36.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:36.408 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:13:36.408+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:13:37.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:37.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:38.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:38.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:39.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:39.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:40.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:40.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:41.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:41.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:41.410 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:13:41.410+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:13:42.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:42.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:43.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:43.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:44.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:44.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:45.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:45.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:46.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:46.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:46.411 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:13:46.410+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:13:47.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:47.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:48.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:48.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:49.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:49.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:50.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:50.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:51.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:51.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:51.411 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:13:51.411+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:13:52.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:52.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:53.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:53.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:54.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:54.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:55.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:55.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:56.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:56.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:56.411 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:13:56.411+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:13:57.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:57.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:58.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:58.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:13:59.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:13:59.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:00.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:00.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:01.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:01.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:01.412 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:14:01.412+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:14:02.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:02.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:03.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:03.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:04.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:04.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:05.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:05.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:06.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:06.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:06.413 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:14:06.413+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:14:07.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:07.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:08.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:08.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:09.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:09.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:10.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:10.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:11.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:11.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:11.414 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:14:11.414+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:14:12.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:12.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:13.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:13.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:14.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:14.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:15.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:15.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:16.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:16.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:16.415 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:14:16.415+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:14:17.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:17.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:18.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:18.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:19.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:19.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:20.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:20.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:21.416 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:14:21.416+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:14:21.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:21.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:22.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:22.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:23.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:23.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:24.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:24.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:25.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:25.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:26.417 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:14:26.417+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:14:26.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:26.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:27.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:27.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:28.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:28.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:29.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:29.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:30.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:30.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:31.419 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:14:31.419+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:14:31.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:31.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:32.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:32.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:33.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:33.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:34.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:34.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:35.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:35.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:36.420 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:14:36.420+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:14:36.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:36.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:37.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:37.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:38.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:38.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:39.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:39.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:40.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:40.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:41.421 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:14:41.421+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:14:41.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:41.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:42.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:42.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:43.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:43.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:44.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:44.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:45.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:45.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:46.422 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:14:46.422+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:14:46.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:46.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:47.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:47.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:48.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:48.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:49.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:49.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:50.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:50.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:51.423 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:14:51.423+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:14:51.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:51.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:52.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:52.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:53.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:53.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:54.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:54.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:55.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:55.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:56.425 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:14:56.425+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:14:56.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:56.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:57.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:57.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:58.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:58.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:14:59.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:14:59.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:00.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:00.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:01.425 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:15:01.426+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:15:01.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:01.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:02.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:02.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:03.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:03.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:04.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:04.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:05.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:05.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:06.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:06.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:06.426 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:15:06.426+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:15:07.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:07.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:08.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:08.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:09.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:09.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:10.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:10.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:11.427 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:15:11.427+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:15:11.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:11.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:12.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:12.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:13.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:13.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:14.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:14.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:15.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:15.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:16.428 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:15:16.428+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:15:16.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:16.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:17.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:17.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:18.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:18.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:19.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:19.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:20.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:20.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:21.429 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:15:21.429+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:15:21.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:21.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:22.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:22.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:23.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:23.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:24.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:24.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:25.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:25.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:26.430 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:15:26.430+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:15:26.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:26.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:27.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:27.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:28.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:28.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:29.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:29.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:30.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:30.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:31.432 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:15:31.432+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:15:31.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:31.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:32.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:32.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:33.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:33.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:34.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:34.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:35.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:35.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:36.432 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:15:36.432+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:15:36.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:36.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:37.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:37.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:38.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:38.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:39.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:39.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:40.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:40.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:41.433 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:15:41.434+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:15:41.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:41.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:42.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:42.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:43.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:43.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:44.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:44.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:45.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:45.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:46.434 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:15:46.435+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:15:46.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:46.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:47.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:47.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:48.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:48.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:49.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:49.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:50.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:50.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:51.434 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:15:51.435+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:15:51.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:51.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:52.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:52.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:53.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:53.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:54.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:54.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:55.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:55.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:56.435 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:15:56.435+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:15:56.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:56.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:57.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:57.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:58.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:58.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:15:59.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:15:59.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:00.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:00.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:01.437 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:16:01.437+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:16:01.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:01.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:02.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:02.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:03.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:03.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:04.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:04.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:05.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:05.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:06.437 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:16:06.437+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:16:06.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:06.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:07.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:07.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:08.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:08.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:09.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:09.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:10.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:10.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:11.439 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:16:11.439+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:16:11.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:11.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:12.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:12.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:13.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:13.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:14.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:14.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:15.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:15.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:16.439 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:16:16.439+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:16:16.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:16.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:17.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:17.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:18.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:18.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:19.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:19.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:20.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:20.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:21.440 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:16:21.440+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:16:21.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:21.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:22.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:22.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:23.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:23.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:24.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:24.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:25.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:25.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:26.441 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:16:26.441+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:16:26.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:26.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:27.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:27.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:28.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:28.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:29.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:29.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:30.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:30.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:31.442 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:16:31.442+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:16:31.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:31.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:32.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:32.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:33.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:33.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:34.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:34.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:35.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:35.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:36.443 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:16:36.443+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:16:36.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:36.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:37.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:37.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:38.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:38.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:39.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:39.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:40.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:40.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:41.444 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:16:41.444+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:16:41.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:41.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:42.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:42.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:43.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:43.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:44.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:44.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:45.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:45.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:46.445 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:16:46.445+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:16:46.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:46.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:47.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:47.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:48.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:48.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:49.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:49.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:50.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:50.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:51.446 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:16:51.446+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:16:51.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:51.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:52.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:52.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:53.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:53.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:54.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:54.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:55.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:55.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:56.447 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:16:56.447+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:16:56.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:56.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:57.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:57.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:58.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:58.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:16:59.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:16:59.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:00.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:00.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:01.448 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:17:01.448+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:17:01.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:01.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:02.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:02.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:03.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:03.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:04.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:04.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:05.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:05.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:06.449 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:17:06.449+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:17:06.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:06.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:07.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:07.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:08.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:08.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:09.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:09.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:10.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:10.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:11.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:17:11.450+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:17:11.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:11.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:12.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:12.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:13.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:13.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:14.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:14.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:15.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:15.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:16.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:17:16.451+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:17:16.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:16.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:17.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:17.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:18.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:18.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:19.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:19.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:20.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:20.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:21.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:21.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:22.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:22.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:23.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:23.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:24.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:24.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:25.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:25.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:26.454 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:17:26.454+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:17:26.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:26.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:27.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:27.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:28.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:28.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:29.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:29.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:30.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:30.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:31.454 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:17:31.455+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:17:31.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:31.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:32.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:32.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:33.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:33.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:34.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:34.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:35.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:35.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:36.455 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:17:36.455+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:17:36.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:36.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:37.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:37.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:38.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:38.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:39.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:39.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:40.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:40.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:41.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:17:41.456+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:17:41.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:41.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:42.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:42.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:43.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:43.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:44.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:44.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:45.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:45.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:46.457 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:17:46.457+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:17:46.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:46.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:47.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:47.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:48.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:48.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:49.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:49.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:50.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:50.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:51.458 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:17:51.458+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:17:51.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:51.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:52.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:52.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:53.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:53.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:54.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:54.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:55.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:55.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:56.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:17:56.459+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:17:56.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:56.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:57.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:57.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:58.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:58.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:17:59.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:17:59.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:00.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:00.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:01.460 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:18:01.460+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:18:01.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:01.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:02.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:02.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:03.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:03.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:04.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:04.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:05.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:05.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:06.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:18:06.461+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:18:06.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:06.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:07.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:07.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:08.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:08.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:09.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:09.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:10.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:10.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:11.462 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:18:11.462+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:18:11.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:11.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:12.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:12.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:13.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:13.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:14.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:14.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:15.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:15.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:16.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:18:16.463+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:18:16.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:16.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:17.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:17.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:18.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:18.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:19.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:19.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:20.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:20.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:21.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:18:21.464+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:18:21.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:21.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:22.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:22.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:23.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:23.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:24.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:24.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:25.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:25.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:26.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:18:26.465+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:18:26.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:26.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:27.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:27.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:28.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:28.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:29.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:29.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:30.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:30.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:31.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:18:31.466+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:18:31.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:31.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:32.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:32.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:33.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:33.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:34.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:34.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:35.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:35.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:36.467 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:18:36.468+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:18:36.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:36.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:37.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:37.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:38.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:38.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:39.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:39.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:40.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:40.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:41.468 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:18:41.469+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:18:41.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:41.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:42.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:42.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:43.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:43.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:44.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:44.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:45.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:45.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:46.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:18:46.470+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:18:46.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:46.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:47.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:47.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:48.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:48.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:49.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:49.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:50.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:50.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:51.470 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:18:51.471+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:18:51.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:51.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:52.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:52.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:53.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:53.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:54.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:54.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:55.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:55.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:56.470 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:18:56.470+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:18:56.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:56.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:57.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:57.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:58.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:58.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:18:59.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:18:59.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:00.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:00.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:01.471 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:19:01.471+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:19:01.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:01.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:02.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:02.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:03.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:03.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:04.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:04.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:05.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:05.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:06.472 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:19:06.472+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:19:06.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:06.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:07.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:07.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:08.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:08.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:09.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:09.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:10.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:10.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:11.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:11.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:11.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:19:11.473+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:19:12.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:12.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:13.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:13.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:14.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:14.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:15.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:15.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:16.474 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:19:16.474+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:19:16.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:16.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:17.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:17.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:18.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:18.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:19.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:19.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:20.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:20.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:21.475 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:19:21.475+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:19:21.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:21.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:22.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:22.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:23.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:23.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:24.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:24.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:25.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:25.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:26.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:19:26.476+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:19:26.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:26.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:27.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:27.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:28.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:28.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:29.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:29.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:30.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:30.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:31.477 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:19:31.477+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:19:31.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:31.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:32.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:32.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:33.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:33.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:34.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:34.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:35.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:35.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:36.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:19:36.479+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:19:36.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:36.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:37.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:37.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:38.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:38.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:39.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:39.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:40.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:40.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:41.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:19:41.480+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:19:41.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:41.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:42.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:42.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:43.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:43.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:44.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:44.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:45.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:45.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:46.481 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:19:46.481+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:19:46.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:46.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:47.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:47.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:48.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:48.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:49.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:49.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:50.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:50.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:51.481 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:19:51.481+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:19:51.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:51.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:52.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:52.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:53.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:53.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:54.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:54.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:55.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:55.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:56.483 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:19:56.483+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:19:56.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:56.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:57.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:57.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:58.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:58.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:19:59.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:19:59.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:00.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:00.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:01.483 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:20:01.484+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:20:01.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:01.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:02.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:02.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:03.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:03.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:04.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:04.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:05.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:05.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:06.484 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:20:06.484+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:20:06.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:06.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:07.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:07.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:08.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:08.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:09.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:09.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:10.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:10.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:11.485 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:20:11.485+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:20:11.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:11.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:12.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:12.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:13.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:13.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:14.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:14.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:15.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:15.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:16.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:20:16.487+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:20:16.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:16.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:17.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:17.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:18.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:18.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:19.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:19.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:20.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:20.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:21.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:20:21.487+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:20:21.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:21.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:22.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:22.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:23.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:23.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:24.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:24.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:25.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:25.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:26.488 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:20:26.488+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:20:26.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:26.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:27.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:27.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:28.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:28.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:29.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:29.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:30.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:30.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:31.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:20:31.490+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:20:31.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:31.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:32.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:32.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:33.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:33.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:34.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:34.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:35.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:35.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:36.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:36.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:36.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:20:36.491+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:20:37.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:37.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:38.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:38.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:39.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:39.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:40.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:40.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:41.491 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:20:41.491+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:20:41.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:41.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:42.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:42.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:43.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:43.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:44.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:44.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:45.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:45.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:46.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:20:46.492+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:20:46.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:46.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:47.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:47.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:48.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:48.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:49.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:49.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:50.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:50.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:51.493 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:20:51.493+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:20:51.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:51.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:52.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:52.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:53.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:53.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:54.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:54.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:55.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:55.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:56.494 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:20:56.494+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:20:56.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:56.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:57.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:57.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:58.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:58.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:20:59.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:20:59.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:00.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:00.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:01.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:21:01.495+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:21:01.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:01.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:02.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:02.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:03.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:03.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:04.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:04.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:05.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:05.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:06.496 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:21:06.496+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:21:06.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:06.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:07.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:07.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:08.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:08.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:09.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:09.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:10.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:10.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:11.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:21:11.498+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:21:11.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:11.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:12.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:12.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:13.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:13.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:14.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:14.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:15.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:15.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:16.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:21:16.499+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:21:16.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:16.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:17.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:17.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:18.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:18.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:19.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:19.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:20.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:20.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:21.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:21:21.499+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:21:21.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:21.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:22.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:22.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:23.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:23.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:24.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:24.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:25.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:25.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:26.501 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:21:26.501+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:21:26.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:26.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:27.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:27.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:28.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:28.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:29.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:29.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:30.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:30.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:31.501 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:21:31.501+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:21:31.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:31.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:32.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:32.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:33.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:33.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:34.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:34.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:35.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:35.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:36.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:21:36.502+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:21:36.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:36.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:37.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:37.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:38.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:38.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:39.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:39.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:40.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:40.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:41.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:21:41.503+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:21:41.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:41.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:42.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:42.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:43.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:43.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:44.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:44.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:45.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:45.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:46.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:21:46.505+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:21:46.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:46.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:47.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:47.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:48.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:48.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:49.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:49.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:50.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:50.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:51.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:21:51.505+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:21:51.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:51.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:52.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:52.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:53.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:53.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:54.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:54.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:55.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:55.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:56.505 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:21:56.505+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:21:56.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:56.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:57.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:57.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:58.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:58.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:21:59.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:21:59.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:00.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:00.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:01.506 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:22:01.506+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:22:01.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:01.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:02.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:02.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:03.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:03.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:04.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:04.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:05.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:05.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:06.506 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:22:06.507+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:22:06.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:06.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:07.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:07.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:08.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:08.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:09.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:09.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:10.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:10.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:11.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:22:11.508+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:22:11.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:11.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:12.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:12.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:13.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:13.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:14.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:14.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:15.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:15.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:16.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:22:16.509+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:22:16.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:16.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:17.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:17.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:18.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:18.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:19.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:19.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:20.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:20.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:21.510 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:22:21.510+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:22:21.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:21.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:22.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:22.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:23.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:23.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:24.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:24.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:25.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:25.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:26.511 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:22:26.512+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:22:26.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:26.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:27.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:27.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:28.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:28.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:29.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:29.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:30.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:30.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:31.512 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:22:31.512+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:22:31.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:31.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:32.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:32.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:33.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:33.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:34.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:34.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:35.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:35.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:36.513 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:22:36.513+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:22:36.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:36.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:37.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:37.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:38.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:38.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:39.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:39.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:40.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:40.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:41.514 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:22:41.514+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:22:41.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:41.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:42.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:42.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:43.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:43.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:44.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:44.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:45.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:45.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:46.516 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:22:46.516+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:22:46.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:46.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:47.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:47.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:48.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:48.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:49.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:49.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:50.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:50.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:51.516 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:22:51.516+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:22:51.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:51.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:52.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:52.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:53.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:53.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:54.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:54.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:55.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:55.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:56.517 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:22:56.518+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:22:56.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:56.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:57.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:57.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:58.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:58.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:22:59.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:22:59.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:00.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:00.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:01.518 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:23:01.518+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:23:01.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:01.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:02.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:02.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:03.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:03.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:04.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:04.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:05.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:05.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:06.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:23:06.519+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:23:06.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:06.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:07.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:07.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:08.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:08.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:09.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:09.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:10.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:10.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:11.520 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:23:11.520+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:23:11.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:11.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:12.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:12.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:13.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:13.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:14.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:14.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:15.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:15.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:16.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:23:16.521+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:23:16.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:16.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:17.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:17.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:18.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:18.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:19.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:19.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:20.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:20.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:21.522 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:23:21.522+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:23:21.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:21.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:22.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:22.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:23.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:23.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:24.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:24.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:25.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:25.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:26.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:23:26.523+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:23:26.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:26.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:27.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:27.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:28.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:28.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:29.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:29.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:30.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:30.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:31.524 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:23:31.524+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:23:31.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:31.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:32.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:32.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:33.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:33.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:34.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:34.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:35.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:35.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:36.525 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:23:36.525+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:23:36.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:36.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:37.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:37.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:38.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:38.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:39.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:39.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:40.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:40.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:41.527 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:23:41.527+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:23:41.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:41.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:42.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:42.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:43.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:43.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:44.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:44.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:45.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:45.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:46.527 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:23:46.527+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:23:46.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:46.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:47.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:47.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:48.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:48.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:49.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:49.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:50.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:50.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:51.528 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:23:51.528+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:23:51.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:51.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:52.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:52.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:53.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:53.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:54.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:54.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:55.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:55.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:56.529 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:23:56.529+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:23:56.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:56.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:57.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:57.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:58.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:58.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:23:59.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:23:59.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:00.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:00.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:01.530 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:24:01.530+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:24:01.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:01.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:02.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:02.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:03.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:03.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:04.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:04.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:05.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:05.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:06.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:24:06.531+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:24:06.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:06.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:07.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:07.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:08.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:08.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:09.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:09.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:10.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:10.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:11.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:24:11.533+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:24:11.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:11.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:12.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:12.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:13.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:13.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:14.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:14.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:15.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:15.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:16.533 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:24:16.534+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:24:16.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:16.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:17.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:17.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:18.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:18.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:19.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:19.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:20.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:20.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:21.534 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:24:21.534+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:24:21.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:21.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:22.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:22.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:23.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:23.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:24.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:24.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:25.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:25.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:26.536 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:24:26.536+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:24:26.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:26.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:27.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:27.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:28.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:28.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:29.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:29.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:31.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:31.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:31.536 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:24:31.536+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:24:32.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:32.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:33.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:33.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:34.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:34.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:35.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:35.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:36.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:36.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:36.537 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:24:36.537+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:24:37.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:37.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:38.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:38.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:39.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:39.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:40.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:40.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:41.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:41.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:41.538 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:24:41.538+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:24:42.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:42.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:43.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:43.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:43.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:43.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:45.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:45.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:46.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:46.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:46.539 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:24:46.540+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:24:47.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:47.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:48.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:48.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:49.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:49.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:50.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:50.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:51.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:51.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:51.540 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:24:51.541+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:24:52.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:52.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:53.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:53.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:54.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:54.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:55.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:55.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:56.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:56.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:56.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:24:56.541+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:24:57.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:57.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:58.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:58.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:24:59.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:24:59.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:00.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:00.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:01.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:01.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:01.542 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:25:01.542+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:25:02.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:02.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:03.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:03.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:04.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:04.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:05.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:05.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:06.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:06.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:06.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:25:06.543+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:25:07.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:07.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:08.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:08.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:09.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:09.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:10.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:10.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:11.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:11.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:11.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:25:11.544+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:25:12.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:12.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:13.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:13.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:14.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:14.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:15.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:15.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:16.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:16.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:16.544 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:25:16.544+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:25:17.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:17.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:18.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:18.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:19.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:19.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:20.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:20.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:21.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:21.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:21.546 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:25:21.546+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:25:22.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:22.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:23.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:23.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:24.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:24.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:25.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:25.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:26.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:26.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:26.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:25:26.547+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:25:27.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:27.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:28.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:28.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:29.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:29.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:30.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:30.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:31.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:31.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:31.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:25:31.547+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:25:32.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:32.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:33.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:33.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:34.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:34.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:35.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:35.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:36.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:36.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:36.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:25:36.548+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:25:37.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:37.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:38.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:38.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:39.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:39.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:40.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:40.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:41.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:41.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:41.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:25:41.549+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:25:42.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:42.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:43.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:43.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:44.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:44.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:45.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:45.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:46.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:46.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:46.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:25:46.550+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:25:47.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:47.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:48.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:48.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:49.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:49.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:50.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:50.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:51.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:51.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:51.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:25:51.552+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:25:52.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:52.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:53.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:53.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:54.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:54.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:55.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:55.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:56.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:56.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:56.553 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:25:56.553+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:25:57.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:57.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:58.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:58.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:25:59.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:25:59.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:00.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:00.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:01.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:01.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:01.554 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:26:01.554+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:26:02.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:02.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:03.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:03.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:04.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:04.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:05.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:05.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:06.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:06.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:06.554 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:26:06.554+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:26:07.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:07.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:08.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:08.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:09.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:09.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:10.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:10.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:11.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:11.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:11.556 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:26:11.556+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:26:12.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:12.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:13.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:13.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:14.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:14.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:15.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:15.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:16.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:16.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:16.556 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:26:16.556+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:26:17.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:17.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:18.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:18.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:19.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:19.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:20.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:20.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:21.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:21.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:21.557 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:26:21.557+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:26:22.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:22.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:23.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:23.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:24.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:24.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:25.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:25.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:26.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:26.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:26.558 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:26:26.558+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:26:27.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:27.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:28.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:28.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:29.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:29.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:30.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:30.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:31.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:31.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:31.559 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:26:31.559+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:26:32.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:32.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:33.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:33.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:34.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:34.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:35.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:35.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:36.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:36.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:36.560 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:26:36.561+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:26:37.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:37.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:38.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:38.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:39.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:39.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:40.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:40.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:41.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:41.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:41.562 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:26:41.562+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:26:42.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:42.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:43.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:43.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:44.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:44.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:45.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:45.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:46.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:46.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:46.563 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:26:46.563+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:26:47.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:47.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:48.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:48.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:49.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:49.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:50.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:50.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:51.563 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:26:51.563+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:26:51.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:51.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:52.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:52.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:53.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:53.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:54.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:54.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:55.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:55.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:56.564 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:26:56.564+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:26:56.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:56.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:57.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:57.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:58.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:58.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:26:59.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:26:59.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:00.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:00.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:01.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:01.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:01.565 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:27:01.565+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:27:02.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:02.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:03.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:03.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:04.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:04.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:05.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:05.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:06.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:27:06.566+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:27:06.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:06.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:07.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:07.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:08.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:08.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:09.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:09.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:10.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:10.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:11.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:27:11.567+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:27:11.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:11.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:12.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:12.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:13.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:13.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:14.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:14.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:15.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:15.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:16.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:27:16.568+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:27:16.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:16.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:17.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:17.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:18.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:18.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:19.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:19.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:20.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:20.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:21.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:27:21.569+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:27:21.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:21.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:22.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:22.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:23.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:23.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:24.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:24.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:25.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:25.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:26.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:27:26.570+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:27:26.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:26.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:27.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:27.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:28.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:28.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:29.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:29.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:30.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:30.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:31.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:27:31.571+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:27:31.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:31.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:32.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:32.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:33.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:33.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:34.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:34.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:35.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:35.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:36.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:27:36.572+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:27:36.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:36.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:37.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:37.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:38.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:38.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:39.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:39.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:40.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:40.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:41.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:27:41.573+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:27:41.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:41.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:42.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:42.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:43.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:43.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:44.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:44.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:45.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:45.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:46.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:27:46.574+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:27:46.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:46.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:47.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:47.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:48.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:48.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:49.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:49.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:50.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:50.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:51.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:27:51.576+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:27:51.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:51.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:52.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:52.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:53.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:53.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:54.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:54.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:55.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:55.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:56.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:27:56.576+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:27:56.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:56.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:57.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:57.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:27:59.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:27:59.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:00.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:00.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:00.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:00.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:01.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:28:01.577+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:28:01.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:01.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:03.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:03.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:04.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:04.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:05.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:05.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:06.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:06.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:06.577 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:28:06.577+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:28:07.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:07.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:08.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:08.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:09.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:09.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:10.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:10.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:11.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:11.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:11.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:28:11.579+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:28:12.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:12.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:13.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:13.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:14.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:14.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:15.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:15.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:16.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:16.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:16.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:28:16.579+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:28:17.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:17.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:18.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:18.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:19.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:19.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:20.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:20.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:21.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:21.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:21.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:28:21.581+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:28:22.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:22.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:23.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:23.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:24.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:24.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:25.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:25.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:26.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:26.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:26.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:28:26.581+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:28:27.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:27.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:28.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:28.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:29.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:29.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:30.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:30.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:31.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:31.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:31.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:28:31.583+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:28:32.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:32.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:33.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:33.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:34.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:34.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:35.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:35.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:36.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:36.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:36.584 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:28:36.584+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:28:37.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:37.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:38.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:38.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:39.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:39.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:40.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:40.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:41.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:41.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:41.585 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:28:41.585+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:28:42.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:42.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:43.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:43.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:44.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:44.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:45.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:45.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:45.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:45.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:46.585 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:28:46.585+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:28:47.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:47.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:48.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:48.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:49.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:49.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:50.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:50.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:51.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:51.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:51.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:28:51.586+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:28:52.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:52.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:53.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:53.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:54.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:54.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:55.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:55.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:56.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:56.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:56.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:28:56.587+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:28:57.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:57.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:58.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:58.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:28:59.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:28:59.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:00.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:00.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:01.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:01.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:01.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:29:01.588+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:29:02.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:02.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:03.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:03.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:04.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:04.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:05.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:05.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:06.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:06.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:06.589 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:29:06.589+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:29:07.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:07.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:08.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:08.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:09.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:09.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:10.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:10.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:11.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:11.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:11.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:29:11.590+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:29:12.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:12.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:13.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:13.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:14.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:14.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:15.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:15.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:16.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:16.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:16.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:29:16.591+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:29:17.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:17.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:18.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:18.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:19.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:19.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:19.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:19.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:20.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:20.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:21.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:29:21.592+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:29:21.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:21.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:22.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:22.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:23.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:23.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:24.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:24.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:25.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:25.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:26.593 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:29:26.594+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:29:26.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:26.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:27.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:27.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:28.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:28.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:29.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:29.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:30.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:30.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:31.594 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:29:31.595+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:29:31.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:31.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:32.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:32.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:33.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:33.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:34.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:34.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:35.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:35.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:36.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:29:36.595+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:29:36.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:36.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:37.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:37.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:38.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:38.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:39.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:39.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:40.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:40.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:41.597 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:29:41.597+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:29:41.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:41.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:42.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:42.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:43.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:43.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:44.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:44.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:45.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:45.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:46.598 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:29:46.597+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:29:46.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:46.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:47.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:47.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:48.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:48.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:49.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:49.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:50.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:50.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:51.598 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:29:51.598+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:29:51.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:51.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:52.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:52.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:53.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:53.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:54.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:54.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:55.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:55.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:56.599 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:29:56.599+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:29:56.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:56.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:57.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:57.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:58.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:58.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:29:59.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:29:59.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:00.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:00.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:01.600 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:30:01.600+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:30:01.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:01.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:02.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:02.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:03.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:03.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:04.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:04.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:05.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:05.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:06.601 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:30:06.601+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:30:06.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:06.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:07.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:07.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:08.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:08.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:09.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:09.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:10.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:10.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:11.603 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:30:11.603+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:30:11.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:11.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:12.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:12.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:13.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:13.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:14.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:14.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:15.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:15.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:16.604 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:30:16.604+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:30:16.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:16.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:17.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:17.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:18.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:18.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:19.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:19.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:20.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:20.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:21.605 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:30:21.605+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:30:21.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:21.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:22.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:22.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:23.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:23.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:24.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:24.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:25.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:25.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:26.605 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:30:26.605+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:30:26.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:26.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:27.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:27.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:28.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:28.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:29.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:29.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:30.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:30.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:31.607 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:30:31.606+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:30:31.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:31.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:32.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:32.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:33.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:33.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:34.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:34.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:35.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:35.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:36.607 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:30:36.607+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:30:36.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:36.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:37.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:37.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:38.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:38.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:39.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:39.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:40.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:40.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:41.608 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:30:41.608+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:30:41.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:41.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:42.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:42.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:43.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:43.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:44.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:44.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:45.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:45.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:46.609 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:30:46.609+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:30:46.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:46.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:47.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:47.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:48.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:48.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:49.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:49.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:50.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:50.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:51.610 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:30:51.611+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:30:51.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:51.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:52.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:52.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:53.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:53.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:54.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:54.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:55.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:55.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:56.611 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:30:56.612+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:30:56.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:56.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:57.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:57.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:58.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:58.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:30:59.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:30:59.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:01.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:01.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:01.611 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:31:01.613+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:31:02.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:02.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:03.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:03.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:04.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:04.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:05.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:05.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:06.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:06.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:06.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:31:06.612+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:31:07.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:07.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:08.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:08.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:09.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:09.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:10.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:10.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:11.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:11.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:11.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:31:11.613+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:31:12.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:12.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:13.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:13.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:14.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:14.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:15.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:15.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:16.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:16.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:16.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:31:16.615+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:31:17.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:17.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:18.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:18.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:18.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:18.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:19.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:19.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:20.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:20.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:21.616 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:31:21.616+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:31:21.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:21.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:23.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:23.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:24.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:24.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:25.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:25.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:26.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:26.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:26.617 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:31:26.617+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:31:27.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:27.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:28.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:28.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:29.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:29.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:30.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:30.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:31.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:31.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:31.618 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:31:31.618+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:31:32.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:32.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:33.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:33.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:34.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:34.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:35.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:35.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:36.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:36.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:36.618 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:31:36.618+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:31:37.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:37.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:38.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:38.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:39.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:39.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:40.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:40.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:41.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:41.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:41.619 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:31:41.620+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:31:42.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:42.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:43.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:43.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:44.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:44.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:45.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:45.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:46.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:46.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:46.620 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:31:46.620+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:31:47.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:47.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:48.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:48.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:49.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:49.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:50.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:50.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:51.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:51.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:51.621 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:31:51.621+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:31:52.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:52.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:53.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:53.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:54.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:54.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:55.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:55.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:56.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:56.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:56.622 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:31:56.623+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:31:57.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:57.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:58.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:58.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:31:59.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:31:59.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:00.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:00.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:01.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:01.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:01.624 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:32:01.624+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:32:02.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:02.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:03.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:03.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:04.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:04.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:05.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:05.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:06.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:06.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:06.624 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:32:06.624+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:32:07.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:07.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:08.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:08.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:09.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:09.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:10.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:10.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:11.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:11.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:11.625 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:32:11.625+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:32:12.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:12.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:13.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:13.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:14.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:14.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:15.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:15.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:16.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:16.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:16.626 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:32:16.626+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:32:17.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:17.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:18.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:18.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:19.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:19.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:20.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:20.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:21.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:21.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:21.627 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:32:21.627+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:32:22.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:22.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:23.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:23.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:24.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:24.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:25.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:25.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:26.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:26.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:26.628 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:32:26.628+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:32:27.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:27.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:28.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:28.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:29.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:29.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:30.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:30.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:31.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:31.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:31.629 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:32:31.629+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:32:32.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:32.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:33.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:33.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:34.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:34.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:35.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:35.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:36.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:36.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:36.630 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:32:36.630+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:32:37.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:37.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:38.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:38.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:39.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:39.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:40.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:40.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:41.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:41.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:41.631 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:32:41.632+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:32:42.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:42.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:43.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:43.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:44.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:44.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:45.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:45.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:46.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:46.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:46.632 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:32:46.632+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:32:47.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:47.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:48.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:48.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:48.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:48.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:50.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:50.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:51.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:51.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:51.633 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:32:51.633+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:32:51.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:51.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:52.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:52.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:53.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:53.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:54.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:54.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:55.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:55.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:56.635 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:32:56.635+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:32:56.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:56.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:57.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:57.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:58.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:58.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:32:59.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:32:59.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:00.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:00.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:01.635 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:33:01.636+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:33:01.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:01.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:02.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:02.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:03.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:03.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:04.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:04.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:05.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:05.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:06.636 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:33:06.636+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:33:06.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:06.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:07.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:07.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:08.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:08.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:09.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:09.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:10.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:10.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:11.637 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:33:11.637+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:33:11.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:11.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:12.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:12.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:13.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:13.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:14.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:14.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:15.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:15.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:16.638 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:33:16.638+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:33:16.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:16.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:17.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:17.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:18.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:18.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:19.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:19.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:20.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:20.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:21.639 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:33:21.640+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:33:21.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:21.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:22.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:22.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:23.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:23.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:24.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:24.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:25.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:25.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:26.640 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:33:26.640+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:33:26.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:26.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:27.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:27.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:28.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:28.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:29.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:29.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:30.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:30.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:31.641 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:33:31.641+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:33:31.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:31.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:32.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:32.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:33.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:33.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:34.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:34.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:35.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:35.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:36.642 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:33:36.642+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:33:36.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:36.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:37.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:37.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:38.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:38.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:39.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:39.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:40.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:40.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:41.643 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:33:41.643+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:33:41.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:41.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:42.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:42.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:44.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:44.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:44.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:44.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:45.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:45.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:46.644 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:33:46.644+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:33:46.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:46.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:48.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:48.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:49.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:49.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:50.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:50.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:51.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:51.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:51.645 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:33:51.645+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:33:52.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:52.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:53.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:53.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:54.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:54.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:55.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:55.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:56.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:56.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:56.645 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:33:56.647+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:33:56.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:57.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:57.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:57.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:58.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:58.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:33:59.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:33:59.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:00.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:00.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:01.646 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:34:01.647+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:34:01.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:01.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:03.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:03.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:03.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:03.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:05.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:05.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:06.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:06.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:06.647 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:34:06.647+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:34:07.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:07.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:08.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:08.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:08.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:08.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:09.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:09.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:10.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:10.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:11.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:34:11.648+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:34:11.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:11.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:12.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:12.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:13.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:13.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:15.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:15.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:16.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:16.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:16.649 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:34:16.649+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:34:17.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:17.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:17.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:17.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:19.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:19.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:20.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:20.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:21.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:21.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:21.650 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:34:21.650+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:34:22.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:22.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:23.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:23.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:24.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:24.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:25.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:25.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:26.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:26.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:26.651 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:34:26.651+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:34:27.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:27.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:28.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:28.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:29.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:29.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:30.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:30.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:31.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:31.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:31.652 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:34:31.652+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:34:32.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:32.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:33.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:33.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:34.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:34.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:35.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:35.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:36.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:36.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:36.653 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:34:36.653+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:34:37.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:37.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:38.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:38.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:39.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:39.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:40.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:40.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:41.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:41.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:41.654 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:34:41.654+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:34:42.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:42.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:43.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:43.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:44.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:44.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:45.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:45.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:46.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:46.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:46.655 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:34:46.655+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:34:47.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:47.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:48.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:48.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:49.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:49.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:50.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:50.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:51.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:51.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:51.656 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:34:51.656+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:34:52.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:52.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:53.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:53.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:54.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:54.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:55.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:55.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:56.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:56.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:56.657 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:34:56.657+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:34:57.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:57.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:58.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:58.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:34:59.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:34:59.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:00.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:00.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:01.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:01.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:01.658 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:35:01.658+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:35:02.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:02.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:03.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:03.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:04.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:04.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:05.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:05.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:06.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:06.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:06.659 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:35:06.659+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:35:07.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:07.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:08.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:08.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:09.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:09.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:10.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:10.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:11.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:11.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:11.660 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:35:11.660+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:35:12.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:12.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:13.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:13.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:14.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:14.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:15.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:15.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:16.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:16.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:16.661 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:35:16.661+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:35:17.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:17.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:18.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:18.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:19.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:19.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:20.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:20.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:21.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:21.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:21.662 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:35:21.662+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:35:22.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:22.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:23.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:23.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:24.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:24.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:25.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:25.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:26.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:26.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:26.663 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:35:26.663+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:35:27.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:27.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:28.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:28.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:29.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:29.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:30.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:30.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:31.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:31.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:31.664 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:35:31.664+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:35:32.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:32.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:33.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:33.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:34.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:34.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:35.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:35.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:36.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:36.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:36.665 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:35:36.665+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:35:37.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:37.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:38.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:38.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:39.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:39.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:40.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:40.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:40.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:40.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:41.666 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:35:41.666+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:35:41.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:41.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:42.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:42.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:43.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:43.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:44.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:44.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:45.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:45.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:46.667 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:35:46.667+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:35:46.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:46.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:47.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:47.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:48.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:48.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:49.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:49.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:50.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:50.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:51.669 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:35:51.668+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:35:51.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:51.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:52.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:52.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:53.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:53.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:54.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:54.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:55.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:55.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:56.669 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:35:56.669+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:35:56.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:56.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:57.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:57.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:58.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:58.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:35:59.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:35:59.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:00.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:00.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:01.670 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:36:01.670+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:36:01.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:01.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:02.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:02.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:03.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:03.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:04.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:04.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:05.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:05.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:06.671 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:36:06.671+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:36:06.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:06.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:07.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:07.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:08.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:08.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:09.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:09.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:10.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:10.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:11.672 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:36:11.672+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:36:11.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:11.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:12.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:12.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:13.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:13.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:14.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:14.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:15.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:15.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:16.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:36:16.673+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:36:16.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:16.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:17.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:17.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:18.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:18.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:19.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:19.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:20.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:20.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:21.674 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:36:21.674+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:36:21.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:21.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:22.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:22.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:23.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:23.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:24.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:24.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:25.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:25.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:26.675 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:36:26.675+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:36:26.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:26.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:27.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:27.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:28.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:28.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:29.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:29.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:30.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:30.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:31.676 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:36:31.676+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:36:31.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:31.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:32.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:32.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:33.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:33.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:34.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:34.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:35.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:35.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:36.677 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:36:36.677+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:36:36.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:36.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:37.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:37.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:38.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:38.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:39.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:39.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:40.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:40.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:41.678 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:36:41.678+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:36:41.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:41.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:42.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:42.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:43.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:43.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:44.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:44.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:45.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:45.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:46.679 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:36:46.679+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:36:46.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:46.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:47.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:47.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:48.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:48.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:49.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:49.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:50.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:50.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:51.680 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:36:51.680+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:36:51.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:51.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:52.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:52.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:53.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:53.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:54.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:54.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:55.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:55.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:56.681 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:36:56.681+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:36:56.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:56.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:57.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:57.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:58.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:58.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:36:59.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:36:59.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:00.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:00.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:01.682 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:37:01.683+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:37:01.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:01.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:02.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:02.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:03.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:03.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:04.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:04.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:05.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:05.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:06.683 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:37:06.684+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:37:06.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:06.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:07.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:07.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:08.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:08.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:09.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:09.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:10.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:10.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:11.683 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:37:11.683+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:37:11.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:11.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:12.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:12.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:13.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:13.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:14.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:14.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:15.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:15.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:16.685 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:37:16.685+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:37:16.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:16.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:17.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:17.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:18.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:18.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:19.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:19.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:20.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:20.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:21.685 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:37:21.686+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:37:21.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:21.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:22.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:22.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:23.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:23.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:24.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:24.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:25.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:25.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:26.686 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:37:26.686+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:37:26.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:26.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:27.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:27.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:28.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:28.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:29.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:29.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:30.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:30.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:31.687 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:37:31.688+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:37:31.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:31.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:32.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:32.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:33.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:33.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:34.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:34.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:35.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:35.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:36.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:37:36.689+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:37:36.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:36.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:37.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:37.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:38.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:38.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:39.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:39.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:40.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:40.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:41.690 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:37:41.690+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:37:41.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:41.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:42.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:42.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:43.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:43.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:44.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:44.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:45.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:45.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:46.691 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:37:46.691+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:37:46.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:46.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:47.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:47.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:48.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:48.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:49.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:49.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:50.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:50.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:51.691 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:37:51.691+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:37:51.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:51.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:52.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:52.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:53.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:53.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:54.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:54.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:55.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:55.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:56.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:37:56.692+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:37:56.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:56.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:57.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:57.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:58.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:58.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:37:59.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:37:59.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:00.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:00.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:01.693 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:38:01.693+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:38:01.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:01.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:02.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:02.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:03.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:03.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:04.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:04.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:05.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:05.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:06.694 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:38:06.694+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:38:06.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:06.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:07.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:07.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:08.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:08.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:09.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:09.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:10.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:10.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:11.695 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:38:11.695+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:38:11.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:11.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:12.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:12.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:13.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:13.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:14.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:14.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:15.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:15.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:16.696 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:38:16.696+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:38:16.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:16.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:17.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:17.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:18.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:18.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:19.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:19.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:20.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:20.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:21.697 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:38:21.697+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:38:21.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:21.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:22.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:22.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:23.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:23.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:24.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:24.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:25.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:25.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:26.698 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:38:26.698+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:38:26.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:26.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:27.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:27.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:28.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:28.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:29.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:29.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:30.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:30.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:31.699 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:38:31.699+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:38:31.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:31.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:32.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:32.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:33.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:33.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:34.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:34.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:35.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:35.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:36.700 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:38:36.700+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:38:36.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:36.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:37.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:37.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:38.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:38.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:39.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:39.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:40.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:40.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:41.701 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:38:41.701+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:38:41.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:41.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:42.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:42.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:43.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:43.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:44.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:44.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:45.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:45.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:46.702 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:38:46.702+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:38:46.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:46.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:47.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:47.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:48.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:48.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:49.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:49.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:50.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:50.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:51.703 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:38:51.703+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:38:51.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:51.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:52.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:52.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:53.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:53.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:54.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:54.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:55.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:55.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:56.704 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:38:56.704+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:38:56.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:56.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:57.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:57.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:58.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:58.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:38:59.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:38:59.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:00.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:00.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:01.705 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:39:01.705+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:39:01.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:01.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:02.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:02.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:03.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:03.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:04.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:04.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:05.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:05.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:06.706 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:39:06.706+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:39:06.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:06.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:07.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:07.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:08.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:08.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:09.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:09.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:10.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:10.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:11.706 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:39:11.707+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:39:11.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:11.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:12.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:12.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:13.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:13.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:14.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:14.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:15.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:15.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:16.708 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:39:16.708+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:39:16.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:16.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:17.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:17.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:18.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:18.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:19.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:19.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:20.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:20.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:21.712 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:39:21.709+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:39:21.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:21.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:22.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:22.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:23.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:23.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:24.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:24.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:25.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:25.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:26.710 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:39:26.710+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:39:26.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:26.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:27.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:27.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:28.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:28.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:29.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:29.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:30.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:30.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:31.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:31.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:31.711 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:39:31.711+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:39:32.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:32.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:33.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:33.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:34.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:34.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:35.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:35.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:36.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:36.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:36.712 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:39:36.713+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:39:37.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:37.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:38.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:38.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:39.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:39.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:40.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:40.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:41.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:41.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:41.713 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:39:41.713+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:39:42.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:42.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:43.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:43.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:44.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:44.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:45.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:45.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:46.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:46.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:47.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:47.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:48.079 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:39:48.080+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:39:48.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:48.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:49.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:49.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:50.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:50.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:51.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:51.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:52.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:52.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:53.081 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:39:53.081+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:39:53.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:53.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:54.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:54.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:55.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:55.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:56.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:56.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:57.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:57.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:58.082 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:39:58.083+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:39:58.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:58.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:39:59.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:39:59.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:00.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:00.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:01.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:01.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:02.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:02.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:03.083 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:40:03.084+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:40:03.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:03.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:04.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:04.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:05.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:05.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:06.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:06.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:07.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:07.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:08.084 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:40:08.085+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:40:08.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:08.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:09.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:09.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:10.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:10.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:11.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:11.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:12.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:12.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:13.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:40:13.086+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:40:13.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:13.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:14.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:14.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:15.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:15.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:16.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:16.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:17.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:17.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:18.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:40:18.087+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:40:18.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:18.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:19.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:19.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:20.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:20.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:21.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:21.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:22.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:22.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:23.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:40:23.089+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:40:23.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:23.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:24.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:24.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:25.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:25.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:26.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:26.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:27.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:27.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:28.090 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:40:28.090+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:40:28.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:28.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:29.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:29.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:30.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:30.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:31.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:31.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:32.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:32.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:33.092 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:40:33.092+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:40:33.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:33.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:34.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:34.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:35.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:35.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:36.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:36.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:37.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:37.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:38.094 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:40:38.094+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:40:38.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:38.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:39.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:39.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:40.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:40.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:41.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:41.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:42.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:42.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:43.095 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:40:43.095+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:40:43.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:43.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:44.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:44.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:45.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:45.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:46.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:46.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:47.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:47.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:48.096 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:40:48.097+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:40:48.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:48.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:49.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:49.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:50.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:50.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:51.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:51.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:52.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:52.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:53.098 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:40:53.098+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:40:53.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:53.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:54.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:54.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:55.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:55.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:56.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:56.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:57.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:57.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:58.100 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:40:58.100+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:40:58.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:58.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:40:59.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:40:59.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:00.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:00.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:01.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:01.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:02.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:02.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:03.101 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:41:03.101+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:41:03.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:03.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:04.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:04.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:05.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:05.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:06.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:06.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:07.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:07.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:08.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:41:08.103+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:41:08.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:08.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:09.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:09.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:10.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:10.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:11.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:11.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:12.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:12.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:13.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:41:13.104+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:41:13.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:13.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:14.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:14.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:15.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:15.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:16.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:16.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:17.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:17.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:18.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:41:18.106+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:41:18.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:18.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:19.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:19.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:20.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:20.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:21.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:21.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:22.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:22.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:23.107 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:41:23.107+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:41:23.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:23.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:24.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:24.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:25.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:25.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:26.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:26.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:27.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:27.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:28.108 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:41:28.108+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:41:28.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:28.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:29.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:29.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:30.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:30.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:31.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:31.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:32.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:32.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:33.109 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:41:33.109+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:41:33.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:33.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:34.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:34.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:35.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:35.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:36.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:36.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:37.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:37.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:38.109 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:41:38.109+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:41:38.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:38.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:39.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:39.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:40.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:40.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:41.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:41.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:42.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:42.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:43.111 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:41:43.111+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:41:43.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:43.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:44.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:44.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:45.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:45.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:46.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:46.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:47.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:47.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:48.112 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:41:48.112+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:41:48.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:48.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:49.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:49.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:50.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:50.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:51.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:51.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:52.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:52.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:53.114 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:41:53.114+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:41:53.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:53.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:54.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:54.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:55.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:55.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:56.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:56.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:57.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:57.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:58.115 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:41:58.115+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:41:58.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:58.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:41:59.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:41:59.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:00.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:00.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:01.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:01.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:02.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:02.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:03.117 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:42:03.117+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:42:03.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:03.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:04.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:04.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:05.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:05.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:06.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:06.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:07.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:07.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:08.118 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:42:08.118+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:42:08.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:08.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:09.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:09.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:10.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:10.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:11.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:11.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:12.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:12.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:13.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:13.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:14.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:14.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:15.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:15.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:16.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:16.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:17.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:17.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:18.095 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:42:18.095+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:42:18.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:18.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:19.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:19.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:20.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:20.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:21.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:21.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:22.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:22.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:23.096 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:42:23.097+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:42:23.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:23.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:24.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:24.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:25.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:25.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:26.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:26.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:27.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:27.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:28.098 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:42:28.099+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:42:28.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:28.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:29.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:29.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:30.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:30.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:31.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:31.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:32.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:32.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:33.099 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:42:33.099+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:42:33.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:33.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:34.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:34.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:35.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:35.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:36.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:36.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:37.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:37.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:38.101 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:42:38.101+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:42:38.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:38.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:39.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:39.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:40.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:40.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:41.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:41.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:42.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:42.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:43.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:42:43.102+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:42:43.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:43.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:44.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:44.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:45.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:45.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:46.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:46.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:47.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:47.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:48.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:42:48.103+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:42:48.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:48.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:49.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:49.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:50.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:50.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:52.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:52.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:53.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:53.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:53.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:42:53.104+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:42:53.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:53.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:55.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:55.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:56.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:56.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:56.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:56.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:58.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:58.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:58.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:42:58.105+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:42:58.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:58.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:42:59.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:42:59.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:00.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:00.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:01.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:01.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:02.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:02.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:03.106 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:43:03.107+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:43:03.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:03.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:04.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:04.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:05.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:05.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:06.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:06.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:08.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:08.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:08.108 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:43:08.109+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:43:09.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:09.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:10.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:10.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:11.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:11.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:12.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:12.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:13.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:13.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:13.110 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:43:13.111+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:43:14.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:14.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:15.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:15.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:16.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:16.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:17.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:17.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:18.111 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:43:18.111+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:43:18.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:18.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:19.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:19.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:20.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:20.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:21.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:21.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:22.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:22.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:23.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:23.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:23.113 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:43:23.113+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:43:24.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:24.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:25.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:25.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:26.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:26.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:27.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:27.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:28.114 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:43:28.114+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:43:28.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:28.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:29.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:29.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:30.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:30.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:31.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:31.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:32.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:32.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:33.115 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:43:33.115+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:43:33.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:33.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:34.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:34.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:35.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:35.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:36.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:36.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:37.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:37.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:38.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:38.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:38.116 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:43:38.117+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:43:39.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:39.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:40.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:40.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:41.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:41.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:42.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:42.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:43.118 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:43:43.118+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:43:43.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:43.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:44.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:44.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:45.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:45.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:46.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:46.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:47.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:47.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:48.119 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:43:48.119+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:43:48.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:48.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:49.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:49.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:50.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:50.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:51.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:51.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:52.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:52.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:53.120 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:43:53.121+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:43:53.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:53.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:54.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:54.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:55.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:55.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:56.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:56.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:57.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:57.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:58.121 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:43:58.122+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:43:58.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:58.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:43:59.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:43:59.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:00.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:00.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:01.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:01.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:02.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:02.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:03.123 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:44:03.123+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:44:03.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:03.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:04.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:04.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:05.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:05.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:06.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:06.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:07.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:07.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:08.125 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:44:08.125+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:44:08.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:08.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:09.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:09.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:10.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:10.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:11.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:11.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:12.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:12.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:13.126 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:44:13.126+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:44:13.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:13.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:14.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:14.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:15.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:15.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:16.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:16.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:17.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:17.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:18.127 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:44:18.127+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:44:18.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:18.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:19.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:19.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:20.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:20.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:21.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:21.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:22.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:22.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:23.129 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:44:23.129+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:44:23.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:23.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:24.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:24.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:25.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:25.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:26.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:26.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:27.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:27.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:28.130 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:44:28.130+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:44:28.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:28.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:29.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:29.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:30.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:30.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:31.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:31.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:32.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:32.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:33.131 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:44:33.131+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:44:33.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:33.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:34.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:34.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:35.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:35.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:36.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:36.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:37.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:37.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:38.132 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:44:38.133+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:44:38.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:38.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:39.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:39.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:40.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:40.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:41.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:41.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:42.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:42.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:43.134 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:44:43.134+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:44:43.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:43.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:44.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:44.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:45.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:45.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:46.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:46.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:47.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:47.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:48.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:44:48.135+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:44:48.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:48.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:49.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:49.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:50.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:50.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:51.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:51.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:52.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:52.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:53.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:44:53.136+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:44:53.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:53.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:54.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:54.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:55.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:55.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:56.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:56.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:57.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:57.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:58.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:44:58.138+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:44:58.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:58.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:44:59.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:44:59.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:00.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:00.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:01.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:01.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:02.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:02.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:03.139 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:45:03.139+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:45:03.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:03.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:04.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:04.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:05.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:05.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:06.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:06.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:07.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:07.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:08.140 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:45:08.140+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:45:08.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:08.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:09.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:09.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:10.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:10.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:11.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:11.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:12.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:12.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:13.142 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:45:13.142+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:45:13.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:13.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:14.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:14.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:15.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:15.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:16.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:16.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:17.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:17.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:18.143 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:45:18.143+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:45:18.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:18.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:19.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:19.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:20.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:20.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:21.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:21.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:22.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:22.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:23.145 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:45:23.145+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:45:23.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:23.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:24.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:24.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:25.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:25.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:26.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:26.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:27.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:27.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:28.146 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:45:28.146+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:45:28.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:28.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:29.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:29.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:30.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:30.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:31.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:31.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:32.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:32.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:33.148 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:45:33.148+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:45:33.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:33.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:34.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:34.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:35.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:35.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:36.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:36.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:37.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:37.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:38.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:38.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:39.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:39.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:40.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:40.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:41.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:41.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:41.787 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:45:41.787+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:45:42.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:42.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:43.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:43.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:44.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:44.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:45.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:45.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:46.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:46.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:46.787 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:45:46.787+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:45:47.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:47.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:48.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:48.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:49.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:49.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:50.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:50.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:51.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:51.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:51.788 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:45:51.788+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:45:52.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:52.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:53.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:53.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:54.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:54.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:55.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:55.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:56.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:56.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:56.789 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:45:56.789+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:45:57.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:57.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:58.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:58.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:45:59.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:45:59.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:00.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:00.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:01.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:01.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:01.790 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:46:01.790+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:46:02.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:02.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:03.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:03.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:04.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:04.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:05.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:05.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:06.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:06.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:06.791 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:46:06.791+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:46:07.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:07.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:08.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:08.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:09.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:09.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:10.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:10.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:11.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:11.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:11.792 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:46:11.793+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:46:12.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:12.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:13.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:13.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:14.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:14.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:15.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:15.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:16.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:16.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:16.792 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:46:16.794+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:46:17.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:17.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:18.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:18.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:19.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:19.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:20.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:20.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:21.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:21.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:21.793 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:46:21.793+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:46:22.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:22.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:23.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:23.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:24.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:24.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:25.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:25.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:26.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:26.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:26.794 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:46:26.794+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:46:27.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:27.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:28.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:28.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:29.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:29.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:30.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:30.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:31.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:31.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:31.795 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:46:31.795+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:46:32.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:32.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:33.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:33.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:34.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:34.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:35.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:35.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:36.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:36.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:36.796 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:46:36.796+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:46:37.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:37.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:38.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:38.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:39.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:39.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:40.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:40.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:41.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:41.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:41.797 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:46:41.797+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:46:42.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:42.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:43.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:43.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:44.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:44.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:45.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:45.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:46.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:46.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:46.798 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:46:46.798+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:46:47.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:47.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:48.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:48.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:49.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:49.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:50.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:50.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:51.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:51.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:51.799 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:46:51.799+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:46:52.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:52.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:53.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:53.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:54.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:54.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:55.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:55.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:56.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:56.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:56.800 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:46:56.800+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:46:57.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:57.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:58.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:58.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:46:59.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:46:59.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:00.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:00.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:01.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:01.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:01.801 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:47:01.801+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:47:02.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:02.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:03.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:03.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:04.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:04.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:05.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:05.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:06.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:06.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:06.801 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:47:06.802+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:47:07.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:07.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:08.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:08.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:09.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:09.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:10.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:10.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:11.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:11.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:11.802 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:47:11.802+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:47:12.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:12.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:13.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:13.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:14.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:14.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:15.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:15.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:16.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:16.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:16.803 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:47:16.803+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:47:17.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:17.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:18.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:18.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:19.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:19.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:20.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:20.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:21.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:21.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:21.804 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:47:21.804+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:47:22.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:22.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:23.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:23.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:24.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:24.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:25.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:25.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:26.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:26.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:26.804 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:47:26.805+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:47:27.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:27.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:28.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:28.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:29.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:29.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:30.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:30.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:31.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:31.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:31.805 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:47:31.806+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:47:32.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:32.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:33.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:33.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:34.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:34.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:35.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:35.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:36.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:36.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:36.807 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:47:36.807+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:47:37.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:37.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:38.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:38.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:39.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:39.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:40.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:40.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:41.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:41.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:41.808 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:47:41.808+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:47:42.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:42.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:43.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:43.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:44.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:44.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:45.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:45.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:46.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:46.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:46.809 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:47:46.809+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:47:47.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:47.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:48.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:48.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:49.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:49.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:50.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:50.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:51.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:51.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:51.811 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:47:51.811+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:47:52.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:52.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:53.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:53.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:54.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:54.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:55.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:55.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:56.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:56.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:56.812 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:47:56.812+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:47:57.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:57.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:58.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:58.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:47:59.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:47:59.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:00.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:00.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:01.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:01.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:01.813 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:48:01.813+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:48:02.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:02.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:03.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:03.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:04.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:04.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:05.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:05.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:06.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:06.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:06.814 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:48:06.814+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:48:07.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:07.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:08.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:08.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:09.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:09.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:10.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:10.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:11.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:11.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:11.815 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:48:11.815+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:48:12.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:12.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:13.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:13.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:14.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:14.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:15.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:15.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:16.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:16.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:16.816 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:48:16.816+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:48:17.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:17.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:18.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:18.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:19.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:19.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:20.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:20.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:21.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:21.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:21.817 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:48:21.818+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:48:22.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:22.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:23.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:23.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:24.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:24.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:25.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:25.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:26.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:26.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:26.818 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:48:26.818+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:48:27.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:27.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:28.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:28.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:29.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:29.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:30.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:30.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:31.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:31.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:31.819 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:48:31.819+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:48:32.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:32.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:33.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:33.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:34.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:34.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:35.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:35.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:36.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:36.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:36.820 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:48:36.820+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:48:37.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:37.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:38.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:38.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:39.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:39.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:40.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:40.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:41.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:41.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:41.821 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:48:41.821+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:48:42.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:42.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:43.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:43.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:44.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:44.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:45.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:45.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:46.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:46.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:46.822 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:48:46.822+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:48:47.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:47.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:48.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:48.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:49.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:49.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:50.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:50.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:51.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:51.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:51.824 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:48:51.823+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:48:52.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:52.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:53.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:53.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:54.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:54.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:55.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:55.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:56.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:56.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:56.824 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:48:56.824+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:48:57.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:57.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:58.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:58.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:48:59.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:48:59.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:00.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:00.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:01.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:01.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:01.825 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:49:01.825+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:49:02.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:02.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:03.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:03.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:04.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:04.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:05.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:05.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:06.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:06.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:06.826 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:49:06.826+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:49:07.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:07.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:08.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:08.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:09.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:09.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:10.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:10.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:11.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:11.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:11.827 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:49:11.827+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:49:12.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:12.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:13.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:13.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:14.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:14.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:15.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:15.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:16.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:16.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:16.828 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:49:16.828+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:49:17.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:17.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:18.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:18.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:19.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:19.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:20.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:20.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:21.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:21.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:21.829 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:49:21.830+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:49:22.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:22.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:23.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:23.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:24.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:24.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:25.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:25.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:26.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:26.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:26.830 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:49:26.831+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:49:27.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:27.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:28.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:28.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:29.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:29.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:30.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:30.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:31.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:31.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:31.830 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:49:31.831+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:49:32.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:32.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:33.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:33.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:34.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:34.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:35.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:35.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:36.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:36.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:36.831 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:49:36.832+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:49:37.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:37.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:38.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:38.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:39.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:39.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:40.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:40.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:41.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:41.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:41.832 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:49:41.832+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:49:42.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:42.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:43.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:43.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:44.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:44.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:45.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:45.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:46.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:46.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:46.833 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:49:46.833+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:49:47.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:47.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:48.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:48.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:49.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:49.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:50.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:50.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:51.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:51.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:51.834 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:49:51.834+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:49:52.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:52.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:53.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:53.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:54.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:54.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:55.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:55.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:56.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:56.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:56.835 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:49:56.835+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:49:57.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:57.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:58.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:58.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:49:59.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:49:59.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:00.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:00.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:01.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:01.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:01.836 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:50:01.836+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:50:02.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:02.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:03.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:03.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:04.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:04.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:05.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:05.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:06.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:06.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:06.837 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:50:06.837+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:50:07.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:07.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:08.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:08.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:09.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:09.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:10.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:10.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:11.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:11.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:11.838 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:50:11.838+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:50:12.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:12.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:13.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:13.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:14.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:14.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:15.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:15.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:16.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:16.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:16.839 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:50:16.839+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:50:17.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:17.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:18.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:18.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:19.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:19.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:20.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:20.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:21.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:21.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:21.840 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:50:21.840+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:50:22.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:22.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:23.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:23.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:24.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:24.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:25.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:25.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:26.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:26.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:26.841 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:50:26.842+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:50:27.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:27.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:28.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:28.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:29.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:29.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:30.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:30.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:31.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:31.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:31.842 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:50:31.843+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:50:32.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:32.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:33.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:33.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:34.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:34.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:35.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:35.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:36.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:36.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:36.843 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:50:36.843+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:50:37.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:37.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:38.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:38.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:39.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:39.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:40.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:40.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:41.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:41.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:41.844 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:50:41.844+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:50:42.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:42.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:43.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:43.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:44.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:44.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:45.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:45.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:46.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:46.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:46.845 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:50:46.846+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:50:47.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:47.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:48.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:48.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:49.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:49.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:50.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:50.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:51.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:51.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:51.846 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:50:51.847+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:50:52.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:52.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:53.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:53.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:54.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:54.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:55.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:55.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:56.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:56.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:56.847 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:50:56.847+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:50:57.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:57.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:58.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:58.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:50:59.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:50:59.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:00.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:00.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:01.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:01.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:01.848 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:51:01.849+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:51:02.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:02.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:03.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:03.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:04.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:04.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:05.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:05.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:06.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:06.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:06.849 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:51:06.850+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:51:07.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:07.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:08.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:08.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:09.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:09.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:10.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:10.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:11.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:11.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:11.850 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:51:11.851+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:51:12.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:12.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:13.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:13.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:14.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:14.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:15.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:15.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:16.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:16.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:16.851 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:51:16.852+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:51:17.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:17.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:18.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:18.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:19.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:19.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:20.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:20.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:21.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:21.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:21.852 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:51:21.852+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:51:22.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:22.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:23.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:23.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:24.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:24.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:25.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:25.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:26.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:26.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:26.853 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:51:26.853+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:51:27.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:27.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:28.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:28.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:29.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:29.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:30.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:30.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:31.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:31.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:31.854 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:51:31.854+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:51:32.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:32.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:33.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:33.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:34.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:34.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:35.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:35.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:36.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:36.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:36.855 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:51:36.855+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:51:37.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:37.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:38.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:38.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:39.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:39.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:40.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:40.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:41.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:41.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:41.856 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:51:41.857+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:51:42.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:42.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:43.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:43.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:44.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:44.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:45.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:45.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:46.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:46.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:46.857 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:51:46.857+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:51:47.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:47.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:48.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:48.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:49.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:49.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:50.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:50.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:51.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:51.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:51.858 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:51:51.858+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:51:52.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:52.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:53.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:53.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:54.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:54.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:55.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:55.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:56.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:56.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:56.859 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:51:56.860+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:51:57.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:57.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:58.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:58.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:51:59.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:51:59.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:00.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:00.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:01.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:01.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:01.860 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:52:01.860+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:52:02.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:02.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:03.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:03.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:04.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:04.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:05.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:05.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:06.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:06.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:06.861 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:52:06.862+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:52:07.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:07.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:08.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:08.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:09.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:09.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:10.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:10.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:11.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:11.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:11.862 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:52:11.862+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:52:12.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:12.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:13.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:13.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:14.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:14.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:15.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:15.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:16.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:16.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:16.863 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:52:16.863+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:52:17.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:17.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:18.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:18.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:19.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:19.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:20.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:20.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:21.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:21.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:21.864 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:52:21.864+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:52:22.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:22.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:23.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:23.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:24.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:24.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:25.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:25.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:26.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:26.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:26.864 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:52:26.866+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:52:27.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:27.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:28.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:28.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:29.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:29.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:30.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:30.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:31.865 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:52:31.867+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:52:31.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:31.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:33.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:33.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:34.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:34.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:35.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:35.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:36.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:36.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:36.866 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:52:36.867+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:52:37.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:37.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:38.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:38.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:39.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:39.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:40.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:40.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:41.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:41.162+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:41.867 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:52:41.867+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:52:42.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:42.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:43.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:43.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:44.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:44.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:45.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:45.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:46.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:46.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:46.870 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:52:46.870+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:52:47.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:47.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:48.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:48.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:49.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:49.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:50.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:50.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:51.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:51.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:51.870 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:52:51.870+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:52:52.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:52.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:53.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:53.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:54.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:54.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:55.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:55.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:56.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:56.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:56.870 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:52:56.871+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:52:57.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:57.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:58.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:58.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:52:59.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:52:59.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:00.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:00.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:01.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:01.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:01.871 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:53:01.872+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:53:02.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:02.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:03.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:03.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:04.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:04.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:05.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:05.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:06.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:06.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:06.872 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:53:06.872+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:53:07.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:07.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:08.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:08.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:09.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:09.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:10.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:10.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:11.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:11.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:11.873 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:53:11.873+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:53:12.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:12.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:13.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:13.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:14.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:14.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:15.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:15.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:16.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:16.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:17.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:17.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:17.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:53:17.479+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:53:18.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:18.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:19.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:19.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:20.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:20.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:21.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:21.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:22.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:22.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:22.480 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:53:22.481+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:53:23.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:23.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:24.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:24.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:25.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:25.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:26.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:26.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:27.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:27.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:27.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:53:27.482+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:53:28.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:28.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:29.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:29.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:30.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:30.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:31.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:31.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:32.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:32.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:32.484 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:53:32.484+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:53:33.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:33.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:34.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:34.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:35.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:35.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:36.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:36.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:37.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:37.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:37.485 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:53:37.486+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:53:38.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:38.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:39.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:39.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:40.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:40.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:41.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:41.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:42.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:42.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:42.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:53:42.487+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:53:43.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:43.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:44.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:44.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:45.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:45.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:46.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:46.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:47.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:47.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:47.488 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:53:47.488+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:53:48.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:48.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:49.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:49.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:50.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:50.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:51.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:51.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:52.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:52.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:52.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:53:52.490+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:53:53.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:53.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:54.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:54.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:55.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:55.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:56.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:56.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:57.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:57.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:57.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:53:57.492+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:53:58.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:58.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:53:59.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:53:59.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:00.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:00.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:01.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:01.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:02.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:02.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:02.493 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:54:02.493+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:54:03.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:03.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:04.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:04.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:05.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:05.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:06.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:06.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:07.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:07.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:07.494 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:54:07.494+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:54:08.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:08.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:09.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:09.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:10.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:10.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:11.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:11.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:12.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:12.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:12.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:54:12.496+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:54:13.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:13.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:14.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:14.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:15.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:15.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:16.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:16.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:17.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:17.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:17.497 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:54:17.497+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:54:18.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:18.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:19.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:19.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:20.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:20.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:21.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:21.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:22.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:22.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:22.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:54:22.498+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:54:22.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:22.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:24.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:24.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:25.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:25.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:26.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:26.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:27.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:27.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:27.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:54:27.500+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:54:28.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:28.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:29.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:29.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:30.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:30.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:31.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:31.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:32.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:32.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:32.501 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:54:32.502+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:54:33.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:33.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:34.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:34.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:35.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:35.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:36.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:36.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:36.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:36.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:37.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:54:37.503+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:54:38.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:38.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:38.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:38.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:40.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:40.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:40.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:40.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:41.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:41.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:42.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:54:42.504+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:54:42.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:42.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:43.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:43.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:44.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:44.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:45.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:45.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:46.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:46.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:47.506 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:54:47.507+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:54:47.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:47.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:48.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:48.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:49.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:49.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:50.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:50.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:51.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:51.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:52.507 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:54:52.507+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:54:52.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:52.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:53.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:53.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:54.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:54.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:55.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:55.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:56.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:56.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:57.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:54:57.508+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:54:57.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:57.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:58.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:58.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:54:59.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:54:59.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:00.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:00.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:01.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:01.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:02.510 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:55:02.510+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:55:02.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:02.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:03.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:03.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:04.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:04.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:05.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:05.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:06.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:06.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:07.512 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:55:07.512+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:55:07.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:07.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:08.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:08.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:09.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:09.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:10.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:10.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:11.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:11.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:12.513 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:55:12.513+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:55:12.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:12.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:13.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:13.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:14.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:14.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:15.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:15.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:16.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:16.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:17.514 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:55:17.515+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:55:17.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:17.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:18.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:18.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:19.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:19.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:20.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:20.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:21.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:21.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:22.516 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:55:22.516+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:55:22.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:22.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:23.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:23.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:24.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:24.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:25.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:25.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:26.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:26.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:27.518 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:55:27.519+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:55:27.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:27.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:28.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:28.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:29.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:29.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:30.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:30.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:31.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:31.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:32.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:55:32.520+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:55:32.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:32.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:33.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:33.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:34.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:34.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:35.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:35.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:36.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:36.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:37.520 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:55:37.520+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:55:37.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:37.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:38.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:38.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:39.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:39.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:40.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:40.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:41.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:41.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:42.522 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:55:42.522+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:55:42.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:42.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:43.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:43.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:44.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:44.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:45.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:45.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:46.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:46.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:47.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:55:47.524+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:55:47.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:47.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:48.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:48.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:49.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:49.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:50.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:50.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:51.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:51.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:52.524 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:55:52.525+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:55:52.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:52.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:53.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:53.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:54.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:54.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:55.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:55.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:56.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:56.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:57.526 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:55:57.526+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:55:57.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:57.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:58.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:58.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:55:59.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:55:59.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:00.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:00.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:01.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:01.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:02.528 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:56:02.528+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:56:02.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:02.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:03.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:03.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:04.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:04.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:05.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:05.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:06.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:06.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:07.529 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:56:07.529+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:56:07.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:07.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:08.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:08.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:09.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:09.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:10.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:10.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:11.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:11.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:12.530 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:56:12.530+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:56:12.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:12.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:13.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:13.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:14.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:14.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:15.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:15.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:16.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:16.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:17.531 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:56:17.532+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:56:17.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:17.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:18.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:18.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:19.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:19.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:20.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:20.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:21.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:21.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:22.533 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:56:22.533+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:56:22.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:22.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:23.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:23.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:24.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:24.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:25.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:25.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:26.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:26.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:27.534 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:56:27.534+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:56:27.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:27.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:28.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:28.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:29.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:29.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:30.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:30.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:31.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:31.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:32.535 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:56:32.536+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:56:32.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:32.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:33.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:33.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:34.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:34.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:35.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:35.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:36.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:36.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:37.537 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:56:37.537+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:56:37.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:37.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:38.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:38.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:39.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:39.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:40.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:40.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:41.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:41.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:42.538 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:56:42.539+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:56:42.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:42.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:43.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:43.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:44.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:44.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:45.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:45.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:46.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:46.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:47.539 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:56:47.540+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:56:47.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:47.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:48.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:48.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:49.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:49.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:50.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:50.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:51.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:51.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:52.540 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:56:52.541+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:56:52.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:52.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:53.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:53.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:54.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:54.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:55.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:55.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:56.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:56.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:57.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:56:57.542+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:56:57.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:57.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:58.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:58.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:56:59.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:56:59.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:00.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:00.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:01.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:01.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:02.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:57:02.543+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:57:02.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:02.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:03.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:03.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:04.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:04.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:05.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:05.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:06.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:06.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:07.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:07.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:07.544 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:57:07.544+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:57:08.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:08.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:09.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:09.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:10.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:10.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:11.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:11.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:12.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:12.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:12.545 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:57:12.546+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:57:13.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:13.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:14.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:14.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:15.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:15.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:16.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:16.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:17.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:17.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:17.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:57:17.547+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:57:18.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:18.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:19.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:19.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:20.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:20.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:21.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:21.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:22.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:22.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:22.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:57:22.548+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:57:23.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:23.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:24.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:24.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:25.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:25.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:26.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:26.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:27.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:27.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:27.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:57:27.550+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:57:28.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:28.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:29.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:29.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:30.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:30.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:31.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:31.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:32.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:32.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:32.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:57:32.551+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:57:33.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:33.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:34.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:34.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:35.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:35.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:36.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:36.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:37.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:37.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:37.552 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:57:37.553+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:57:38.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:38.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:39.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:39.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:40.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:40.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:41.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:41.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:42.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:42.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:42.554 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:57:42.555+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:57:43.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:43.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:44.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:44.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:45.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:45.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:46.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:46.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:47.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:47.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:47.555 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:57:47.557+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:57:48.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:48.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:49.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:49.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:50.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:50.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:51.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:51.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:52.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:52.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:52.557 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:57:52.557+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:57:53.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:53.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:54.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:54.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:55.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:55.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:56.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:56.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:57.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:57.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:57.558 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:57:57.559+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:57:58.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:58.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:57:59.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:57:59.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:00.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:00.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:01.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:01.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:02.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:02.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:02.560 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:58:02.560+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:58:03.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:03.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:04.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:04.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:05.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:05.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:06.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:06.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:07.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:07.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:07.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:58:07.561+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:58:08.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:08.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:09.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:09.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:10.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:10.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:11.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:11.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:12.562 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:58:12.562+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:58:12.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:12.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:13.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:13.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:14.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:14.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:15.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:15.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:16.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:16.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:17.564 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:58:17.564+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:58:17.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:17.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:18.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:18.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:19.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:19.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:20.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:20.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:21.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:21.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:22.565 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:58:22.565+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:58:22.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:22.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:23.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:23.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:24.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:24.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:25.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:25.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:26.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:26.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:27.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:58:27.567+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:58:27.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:27.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:28.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:28.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:29.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:29.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:30.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:30.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:31.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:31.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:32.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:58:32.569+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:58:32.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:32.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:33.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:33.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:34.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:34.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:35.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:35.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:36.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:36.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:37.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:58:37.569+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:58:37.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:37.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:38.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:38.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:39.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:39.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:40.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:40.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:41.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:41.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:42.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:58:42.570+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:58:42.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:42.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:43.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:43.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:44.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:44.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:45.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:45.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:46.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:46.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:47.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:58:47.572+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:58:47.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:47.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:48.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:48.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:49.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:49.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:50.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:50.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:51.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:51.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:52.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:58:52.573+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:58:52.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:52.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:53.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:53.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:54.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:54.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:55.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:55.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:56.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:56.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:57.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:58:57.575+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:58:57.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:57.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:58.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:58.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:58:59.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:58:59.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:00.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:00.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:01.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:01.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:02.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:59:02.577+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:59:02.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:02.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:03.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:03.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:04.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:04.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:05.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:05.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:06.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:06.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:07.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:59:07.578+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:59:07.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:07.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:08.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:08.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:09.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:09.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:10.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:10.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:11.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:11.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:12.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:12.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:12.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:59:12.580+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:59:13.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:13.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:14.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:14.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:15.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:15.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:16.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:16.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:17.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:17.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:17.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:59:17.581+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:59:18.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:18.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:19.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:19.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:20.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:20.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:21.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:21.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:22.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:22.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:22.582 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:59:22.582+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:59:23.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:23.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:24.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:24.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:25.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:25.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:26.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:26.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:27.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:27.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:27.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:59:27.584+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:59:28.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:28.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:29.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:29.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:30.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:30.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:31.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:31.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:32.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:32.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:32.584 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:59:32.585+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:59:33.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:33.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:34.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:34.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:35.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:35.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:36.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:36.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:37.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:59:37.586+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:59:37.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:37.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:38.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:38.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:39.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:39.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:40.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:40.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:41.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:41.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:42.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:59:42.587+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:59:42.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:42.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:43.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:43.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:44.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:44.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:45.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:45.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:46.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:46.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:47.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:47.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:47.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:59:47.588+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:59:48.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:48.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:49.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:49.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:50.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:50.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:51.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:51.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:52.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:52.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:52.589 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:59:52.590+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:59:53.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:53.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:54.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:54.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:55.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:55.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:56.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:56.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:57.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:57.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:57.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T12:59:57.591+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T12:59:58.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:58.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T12:59:59.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T12:59:59.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:00.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:00.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:01.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:01.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:02.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:02.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:02.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:00:02.593+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:00:03.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:03.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:04.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:04.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:05.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:05.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:06.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:06.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:07.594 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:00:07.594+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:00:07.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:07.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:08.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:08.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:09.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:09.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:10.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:10.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:11.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:11.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:12.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:00:12.596+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:00:12.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:12.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:13.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:13.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:14.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:14.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:15.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:15.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:16.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:16.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:17.597 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:00:17.597+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:00:17.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:17.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:18.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:18.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:19.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:19.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:20.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:20.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:21.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:21.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:22.598 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:00:22.598+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:00:22.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:22.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:23.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:23.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:24.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:24.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:25.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:25.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:26.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:26.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:27.600 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:00:27.600+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:00:27.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:27.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:28.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:28.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:30.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:30.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:30.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:30.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:31.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:31.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:32.601 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:00:32.601+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:00:33.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:33.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:34.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:34.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:35.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:35.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:36.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:36.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:37.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:37.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:37.602 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:00:37.603+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:00:38.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:38.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:39.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:39.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:40.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:40.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:41.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:41.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:42.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:42.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:42.604 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:00:42.604+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:00:43.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:43.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:44.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:44.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:44.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:44.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:46.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:46.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:47.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:47.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:47.605 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:00:47.605+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:00:48.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:48.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:49.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:49.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:49.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:49.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:51.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:51.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:52.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:52.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:52.606 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:00:52.606+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:00:53.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:53.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:53.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:53.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:54.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:54.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:55.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:55.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:56.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:56.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:57.607 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:00:57.607+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:00:57.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:57.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:00:58.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:00:58.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:00.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:00.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:01.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:01.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:02.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:02.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:02.608 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:01:02.608+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:01:02.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:02.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:04.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:04.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:04.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:04.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:05.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:05.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:06.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:06.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:07.609 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:01:07.610+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:01:07.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:07.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:08.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:08.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:09.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:09.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:10.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:10.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:11.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:11.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:12.611 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:01:12.611+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:01:12.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:12.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:13.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:13.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:14.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:14.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:15.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:15.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:16.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:16.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:17.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:01:17.612+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:01:17.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:17.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:18.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:18.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:19.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:19.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:20.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:20.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:21.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:21.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:22.613 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:01:22.615+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:01:22.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:22.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:23.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:23.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:24.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:24.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:25.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:25.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:26.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:26.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:27.615 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:01:27.616+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:01:27.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:27.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:28.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:28.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:29.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:29.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:30.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:30.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:31.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:31.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:32.616 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:01:32.617+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:01:32.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:32.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:34.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:34.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:34.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:34.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:35.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:35.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:36.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:36.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:37.618 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:01:37.618+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:01:37.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:37.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:38.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:38.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:40.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:40.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:41.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:41.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:42.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:42.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:42.619 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:01:42.619+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:01:43.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:43.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:44.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:44.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:45.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:45.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:46.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:46.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:46.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:46.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:47.620 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:01:47.621+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:01:47.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:47.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:49.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:49.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:50.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:50.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:51.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:51.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:52.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:52.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:52.622 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:01:52.622+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:01:53.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:53.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:54.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:54.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:55.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:55.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:56.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:56.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:57.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:57.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:57.623 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:01:57.624+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:01:58.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:58.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:01:59.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:01:59.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:00.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:00.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:01.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:01.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:02.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:02.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:02.624 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:02:02.625+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:02:03.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:03.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:04.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:04.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:05.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:05.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:06.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:06.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:07.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:07.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:07.626 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:02:07.626+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:02:08.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:08.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:09.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:09.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:10.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:10.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:11.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:11.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:12.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:12.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:12.627 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:02:12.627+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:02:13.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:13.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:14.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:14.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:15.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:15.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:16.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:16.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:17.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:17.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:17.628 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:02:17.628+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:02:18.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:18.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:19.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:19.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:20.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:20.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:21.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:21.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:22.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:22.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:22.629 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:02:22.630+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:02:23.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:23.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:24.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:24.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:25.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:25.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:26.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:26.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:27.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:27.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:27.631 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:02:27.631+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:02:28.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:28.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:29.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:29.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:30.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:30.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:31.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:31.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:32.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:32.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:32.632 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:02:32.633+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:02:33.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:33.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:34.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:34.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:35.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:35.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:36.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:36.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:37.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:37.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:37.633 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:02:37.634+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:02:38.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:38.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:39.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:39.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:40.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:40.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:41.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:41.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:42.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:42.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:42.634 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:02:42.635+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:02:43.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:43.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:44.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:44.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:45.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:45.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:46.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:46.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:47.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:47.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:47.636 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:02:47.636+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:02:48.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:48.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:49.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:49.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:50.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:50.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:51.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:51.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:52.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:52.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:52.637 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:02:52.637+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:02:53.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:53.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:54.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:54.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:55.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:55.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:56.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:56.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:57.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:57.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:57.639 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:02:57.638+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:02:58.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:58.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:02:59.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:02:59.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:00.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:00.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:01.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:01.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:02.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:02.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:02.639 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:03:02.639+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:03:03.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:03.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:04.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:04.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:05.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:05.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:06.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:06.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:07.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:07.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:07.640 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:03:07.641+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:03:08.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:08.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:09.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:09.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:10.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:10.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:11.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:11.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:12.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:12.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:12.642 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:03:12.642+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:03:13.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:13.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:14.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:14.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:15.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:15.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:16.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:16.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:17.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:17.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:17.643 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:03:17.643+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:03:18.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:18.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:19.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:19.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:20.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:20.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:21.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:21.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:22.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:22.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:22.644 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:03:22.644+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:03:23.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:23.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:24.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:24.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:25.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:25.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:26.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:26.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:27.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:27.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:27.645 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:03:27.645+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:03:28.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:28.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:29.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:29.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:30.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:30.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:31.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:31.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:32.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:32.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:32.646 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:03:32.647+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:03:33.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:33.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:34.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:34.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:35.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:35.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:36.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:36.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:37.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:37.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:37.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:03:37.648+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:03:38.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:38.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:39.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:39.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:40.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:40.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:41.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:41.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:42.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:42.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:42.649 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:03:42.649+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:03:43.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:43.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:44.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:44.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:45.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:45.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:46.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:46.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:47.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:47.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:47.650 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:03:47.650+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:03:48.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:48.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:49.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:49.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:50.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:50.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:51.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:51.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:52.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:52.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:52.651 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:03:52.651+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:03:53.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:53.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:54.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:54.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:55.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:55.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:56.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:56.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:57.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:57.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:57.651 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:03:57.652+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:03:58.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:58.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:03:59.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:03:59.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:00.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:00.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:01.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:01.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:02.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:02.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:02.653 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:04:02.653+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:04:03.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:03.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:04.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:04.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:05.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:05.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:06.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:06.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:07.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:07.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:07.654 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:04:07.654+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:04:08.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:08.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:09.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:09.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:10.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:10.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:11.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:11.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:12.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:12.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:12.655 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:04:12.655+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:04:13.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:13.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:14.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:14.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:15.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:15.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:16.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:16.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:17.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:17.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:17.656 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:04:17.656+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:04:17.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:17.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:18.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:18.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:19.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:19.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:20.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:20.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:21.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:21.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:22.658 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:04:22.659+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:04:23.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:23.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:24.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:24.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:25.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:25.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:26.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:26.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:27.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:27.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:27.662 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:04:27.660+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:04:28.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:28.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:29.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:29.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:30.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:30.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:31.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:31.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:32.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:32.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:32.660 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:04:32.660+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:04:33.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:33.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:34.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:34.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:35.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:35.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:36.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:36.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:37.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:37.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:37.662 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:04:37.662+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:04:38.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:38.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:39.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:39.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:40.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:40.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:41.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:41.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:42.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:42.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:42.663 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:04:42.663+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:04:43.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:43.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:44.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:44.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:45.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:45.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:46.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:46.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:47.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:47.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:47.664 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:04:47.664+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:04:48.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:48.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:49.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:49.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:50.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:50.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:50.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:50.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:51.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:51.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:52.665 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:04:52.665+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:04:53.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:53.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:54.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:54.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:54.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:54.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:56.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:56.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:57.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:57.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:57.666 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:04:57.666+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:04:58.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:58.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:59.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:59.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:04:59.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:04:59.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:00.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:00.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:01.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:01.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:02.666 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:05:02.666+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:05:02.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:02.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:04.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:04.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:04.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:04.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:05.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:05.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:06.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:06.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:07.668 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:05:07.668+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:05:08.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:08.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:09.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:09.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:10.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:10.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:11.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:11.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:12.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:12.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:12.669 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:05:12.669+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:05:13.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:13.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:14.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:14.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:15.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:15.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:16.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:16.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:17.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:17.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:17.670 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:05:17.670+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:05:18.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:18.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:19.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:19.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:20.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:20.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:21.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:21.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:22.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:22.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:22.672 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:05:22.672+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:05:23.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:23.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:24.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:24.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:25.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:25.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:26.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:26.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:27.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:27.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:27.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:05:27.673+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:05:28.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:28.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:29.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:29.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:30.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:30.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:31.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:31.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:32.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:32.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:32.675 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:05:32.675+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:05:33.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:33.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:34.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:34.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:35.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:35.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:36.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:36.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:37.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:37.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:37.676 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:05:37.676+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:05:38.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:38.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:39.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:39.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:40.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:40.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:41.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:41.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:42.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:42.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:42.677 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:05:42.678+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:05:43.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:43.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:44.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:44.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:45.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:45.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:46.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:46.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:47.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:47.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:47.679 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:05:47.679+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:05:48.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:48.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:49.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:49.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:50.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:50.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:51.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:51.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:52.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:52.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:52.680 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:05:52.680+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:05:53.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:53.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:54.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:54.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:55.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:55.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:56.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:56.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:57.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:57.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:57.681 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:05:57.682+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:05:58.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:58.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:05:59.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:05:59.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:00.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:00.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:01.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:01.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:02.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:02.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:02.682 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:06:02.683+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:06:03.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:03.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:04.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:04.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:05.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:05.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:06.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:06.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:07.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:07.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:07.685 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:06:07.685+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:06:08.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:08.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:09.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:09.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:10.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:10.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:11.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:11.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:12.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:12.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:12.686 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:06:12.687+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:06:13.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:13.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:14.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:14.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:15.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:15.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:16.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:16.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:17.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:17.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:17.688 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:06:17.688+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:06:18.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:18.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:19.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:19.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:20.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:20.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:21.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:21.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:22.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:22.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:22.690 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:06:22.690+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:06:23.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:23.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:24.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:24.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:25.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:25.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:26.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:26.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:27.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:27.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:27.691 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:06:27.691+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:06:28.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:28.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:29.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:29.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:30.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:30.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:31.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:31.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:32.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:32.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:32.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:06:32.692+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:06:32.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:32.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:33.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:33.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:34.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:34.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:35.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:35.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:36.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:36.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:37.694 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:06:37.694+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:06:37.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:37.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:38.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:38.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:39.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:39.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:40.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:40.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:41.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:41.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:42.695 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:06:42.695+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:06:43.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:43.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:44.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:44.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:44.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:44.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:45.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:45.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:46.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:46.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:47.696 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:06:47.696+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:06:47.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:47.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:48.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:48.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:49.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:49.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:50.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:50.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:51.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:51.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:52.697 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:06:52.698+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:06:52.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:52.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:53.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:53.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:54.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:54.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:55.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:55.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:56.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:56.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:57.698 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:06:57.699+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:06:57.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:57.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:58.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:58.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:06:59.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:06:59.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:00.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:00.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:01.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:01.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:02.700 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:07:02.700+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:07:02.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:02.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:03.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:03.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:04.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:04.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:05.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:05.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:06.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:06.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:07.701 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:07:07.702+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:07:07.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:07.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:08.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:08.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:09.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:09.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:10.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:10.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:11.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:11.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:12.703 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:07:12.704+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:07:12.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:12.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:13.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:13.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:14.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:14.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:15.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:15.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:16.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:16.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:17.704 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:07:17.704+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:07:17.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:17.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:18.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:18.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:19.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:19.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:20.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:20.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:21.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:21.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:22.705 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:07:22.707+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:07:23.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:23.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:24.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:24.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:25.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:25.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:26.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:26.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:27.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:27.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:27.707 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:07:27.708+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:07:28.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:28.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:29.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:29.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:30.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:30.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:31.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:31.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:31.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:31.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:32.709 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:07:32.709+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:07:32.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:32.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:33.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:33.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:34.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:34.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:35.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:35.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:36.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:36.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:37.711 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:07:37.711+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:07:37.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:37.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:39.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:39.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:40.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:40.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:41.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:41.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:42.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:42.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:42.712 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:07:42.712+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:07:43.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:43.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:44.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:44.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:45.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:45.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:46.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:46.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:46.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:46.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:47.713 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:07:47.713+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:07:47.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:47.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:49.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:49.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:49.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:49.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:50.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:50.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:51.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:51.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:52.715 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:07:52.715+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:07:52.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:52.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:53.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:53.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:54.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:54.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:55.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:55.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:56.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:56.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:57.716 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:07:57.716+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:07:57.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:57.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:58.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:58.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:07:59.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:07:59.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:01.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:01.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:02.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:02.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:02.717 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:08:02.717+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:08:03.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:03.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:04.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:04.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:04.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:04.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:05.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:05.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:06.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:06.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:07.719 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:08:07.719+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:08:07.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:07.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:09.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:09.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:10.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:10.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:10.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:10.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:12.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:12.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:12.720 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:08:12.720+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:08:13.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:13.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:13.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:13.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:14.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:14.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:16.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:16.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:16.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:16.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:17.721 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:08:17.721+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:08:17.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:17.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:18.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:18.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:19.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:19.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:20.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:20.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:21.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:21.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:22.722 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:08:22.722+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:08:23.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:23.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:24.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:24.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:24.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:24.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:25.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:25.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:27.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:27.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:27.723 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:08:27.723+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:08:28.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:28.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:29.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:29.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:29.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:29.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:31.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:31.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:32.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:32.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:32.725 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:08:32.725+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:08:32.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:32.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:33.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:33.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:34.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:34.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:35.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:35.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:37.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:37.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:37.726 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:08:37.726+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:08:38.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:38.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:39.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:39.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:40.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:40.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:41.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:41.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:42.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:42.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:42.727 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:08:42.727+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:08:43.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:43.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:44.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:44.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:45.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:45.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:46.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:46.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:47.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:47.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:47.729 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:08:47.729+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:08:48.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:48.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:49.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:49.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:50.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:50.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:51.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:51.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:52.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:52.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:52.730 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:08:52.730+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:08:53.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:53.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:54.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:54.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:55.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:55.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:56.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:56.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:57.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:57.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:57.731 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:08:57.731+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:08:58.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:58.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:08:59.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:08:59.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:00.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:00.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:01.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:01.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:02.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:02.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:02.733 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:09:02.733+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:09:03.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:03.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:04.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:04.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:05.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:05.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:06.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:06.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:07.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:07.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:07.734 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:09:07.734+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:09:08.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:08.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:09.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:09.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:10.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:10.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:11.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:11.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:12.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:12.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:12.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:09:12.735+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:09:13.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:13.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:14.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:14.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:15.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:15.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:16.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:16.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:17.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:17.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:17.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:09:17.736+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:09:18.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:18.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:19.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:19.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:20.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:20.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:21.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:21.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:22.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:22.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:22.737 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:09:22.738+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:09:23.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:23.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:24.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:24.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:25.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:25.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:26.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:26.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:27.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:27.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:27.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:09:27.739+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:09:28.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:28.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:29.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:29.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:30.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:30.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:31.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:31.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:32.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:32.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:32.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:09:32.740+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:09:33.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:33.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:34.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:34.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:35.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:35.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:36.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:36.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:37.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:37.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:37.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:09:37.741+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:09:38.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:38.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:39.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:39.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:40.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:40.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:41.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:41.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:42.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:42.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:42.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:09:42.742+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:09:43.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:43.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:44.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:44.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:45.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:45.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:46.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:46.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:47.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:47.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:47.743 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:09:47.744+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:09:48.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:48.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:49.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:49.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:50.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:50.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:51.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:51.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:52.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:52.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:52.744 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:09:52.745+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:09:53.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:53.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:54.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:54.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:55.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:55.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:56.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:56.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:57.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:57.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:57.746 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:09:57.746+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:09:58.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:58.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:09:59.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:09:59.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:00.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:00.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:01.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:01.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:02.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:02.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:02.747 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:10:02.747+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:10:03.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:03.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:04.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:04.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:05.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:05.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:06.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:06.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:07.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:07.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:07.748 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:10:07.748+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:10:08.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:08.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:09.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:09.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:10.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:10.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:11.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:11.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:12.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:12.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:12.749 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:10:12.749+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:10:13.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:13.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:14.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:14.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:15.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:15.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:16.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:16.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:17.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:17.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:17.750 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:10:17.750+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:10:18.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:18.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:19.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:19.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:20.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:20.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:21.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:21.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:22.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:22.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:22.751 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:10:22.752+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:10:23.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:23.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:24.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:24.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:25.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:25.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:26.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:26.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:27.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:27.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:27.753 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:10:27.754+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:10:28.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:28.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:29.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:29.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:30.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:30.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:31.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:31.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:32.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:32.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:32.754 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:10:32.755+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:10:33.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:33.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:34.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:34.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:35.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:35.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:36.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:36.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:37.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:37.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:37.756 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:10:37.756+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:10:38.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:38.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:39.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:39.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:40.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:40.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:41.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:41.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:42.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:42.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:42.757 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:10:42.757+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:10:43.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:43.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:44.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:44.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:45.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:45.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:46.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:46.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:47.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:47.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:47.758 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:10:47.758+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:10:48.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:48.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:49.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:49.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:50.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:50.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:51.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:51.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:52.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:52.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:52.760 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:10:52.760+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:10:53.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:53.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:54.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:54.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:55.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:55.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:56.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:56.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:57.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:57.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:57.761 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:10:57.761+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:10:58.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:58.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:10:59.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:10:59.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:00.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:00.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:01.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:01.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:02.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:02.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:02.762 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:11:02.762+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:11:03.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:03.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:04.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:04.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:05.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:05.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:06.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:06.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:07.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:07.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:07.763 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:11:07.764+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:11:08.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:08.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:09.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:09.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:10.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:10.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:11.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:11.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:12.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:12.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:12.765 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:11:12.765+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:11:13.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:13.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:14.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:14.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:15.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:15.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:16.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:16.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:17.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:17.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:17.766 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:11:17.766+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:11:18.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:18.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:19.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:19.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:20.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:20.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:21.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:21.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:22.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:22.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:22.768 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:11:22.768+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:11:23.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:23.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:24.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:24.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:25.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:25.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:26.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:26.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:27.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:27.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:27.769 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:11:27.769+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:11:28.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:28.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:29.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:29.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:30.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:30.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:31.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:31.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:32.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:32.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:32.770 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:11:32.770+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:11:33.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:33.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:34.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:34.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:35.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:35.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:36.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:36.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:37.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:37.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:37.772 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:11:37.772+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:11:38.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:38.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:39.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:39.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:40.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:40.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:41.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:41.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:42.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:42.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:42.773 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:11:42.773+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:11:43.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:43.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:44.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:44.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:45.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:45.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:46.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:46.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:47.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:47.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:47.774 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:11:47.774+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:11:48.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:48.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:49.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:49.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:50.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:50.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:51.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:51.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:52.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:52.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:52.774 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:11:52.775+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:11:53.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:53.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:54.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:54.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:55.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:55.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:56.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:56.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:57.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:57.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:57.776 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:11:57.776+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:11:58.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:58.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:11:59.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:11:59.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:00.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:00.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:01.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:01.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:02.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:02.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:02.776 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:12:02.776+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:12:03.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:03.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:04.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:04.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:05.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:05.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:06.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:06.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:07.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:07.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:07.778 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:12:07.778+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:12:08.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:08.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:09.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:09.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:10.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:10.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:11.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:11.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:12.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:12.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:12.779 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:12:12.779+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:12:13.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:13.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:14.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:14.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:15.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:15.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:16.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:16.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:17.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:17.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:17.780 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:12:17.781+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:12:18.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:18.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:19.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:19.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:20.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:20.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:21.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:21.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:22.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:22.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:22.782 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:12:22.782+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:12:23.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:23.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:24.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:24.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:25.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:25.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:26.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:26.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:27.783 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:12:27.784+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:12:27.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:27.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:28.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:28.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:29.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:29.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:30.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:30.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:31.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:31.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:32.785 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:12:32.785+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:12:32.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:32.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:33.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:33.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:34.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:34.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:35.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:35.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:36.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:36.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:37.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:12:37.786+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:12:37.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:37.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:38.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:38.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:39.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:39.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:40.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:40.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:41.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:41.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:42.787 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:12:42.787+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:12:42.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:42.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:43.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:43.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:44.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:44.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:45.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:45.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:46.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:46.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:47.789 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:12:47.789+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:12:47.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:47.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:48.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:48.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:49.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:49.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:50.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:50.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:51.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:51.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:52.790 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:12:52.791+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:12:52.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:52.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:53.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:53.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:54.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:54.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:55.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:55.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:56.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:56.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:57.791 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:12:57.791+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:12:57.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:57.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:59.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:59.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:12:59.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:12:59.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:00.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:00.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:01.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:01.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:02.792 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:13:02.792+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:13:02.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:02.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:03.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:03.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:04.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:04.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:05.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:05.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:07.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:07.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:07.794 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:13:07.795+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:13:07.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:07.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:09.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:09.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:09.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:09.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:10.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:10.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:11.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:11.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:12.795 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:13:12.796+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:13:12.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:12.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:13.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:13.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:14.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:14.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:15.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:15.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:16.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:16.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:17.796 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:13:17.796+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:13:17.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:17.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:18.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:18.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:19.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:19.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:20.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:20.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:21.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:21.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:22.798 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:13:22.799+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:13:22.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:22.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:23.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:23.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:24.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:24.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:25.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:25.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:26.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:26.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:27.799 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:13:27.800+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:13:27.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:27.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:28.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:28.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:29.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:29.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:30.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:30.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:31.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:31.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:32.800 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:13:32.800+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:13:32.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:32.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:33.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:33.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:34.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:34.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:35.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:35.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:36.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:36.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:37.802 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:13:37.802+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:13:38.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:38.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:38.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:38.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:40.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:40.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:41.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:41.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:41.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:41.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:42.804 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:13:42.804+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:13:42.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:42.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:43.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:43.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:45.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:45.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:45.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:45.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:46.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:46.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:47.805 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:13:47.805+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:13:47.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:47.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:48.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:48.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:49.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:49.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:51.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:51.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:51.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:51.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:52.807 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:13:52.807+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:13:52.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:52.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:53.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:53.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:54.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:54.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:55.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:55.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:56.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:56.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:57.808 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:13:57.808+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:13:57.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:57.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:58.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:58.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:13:59.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:13:59.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:00.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:00.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:01.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:01.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:02.809 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:14:02.810+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:14:02.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:02.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:03.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:03.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:04.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:04.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:05.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:05.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:06.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:06.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:07.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:07.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:07.811 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:14:07.811+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:14:08.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:08.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:09.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:09.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:10.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:10.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:11.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:11.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:12.812 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:14:12.812+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:14:12.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:12.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:13.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:13.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:14.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:14.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:15.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:15.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:16.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:16.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:17.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:17.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:17.813 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:14:17.814+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:14:18.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:18.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:19.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:19.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:20.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:20.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:21.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:21.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:22.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:22.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:22.815 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:14:22.815+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:14:23.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:23.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:24.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:24.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:25.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:25.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:26.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:26.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:27.816 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:14:27.816+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:14:27.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:27.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:28.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:28.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:29.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:29.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:30.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:30.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:31.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:31.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:32.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:32.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:32.817 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:14:32.817+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:14:33.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:33.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:34.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:34.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:35.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:35.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:36.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:36.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:37.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:37.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:37.818 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:14:37.819+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:14:38.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:38.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:39.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:39.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:40.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:40.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:41.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:41.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:42.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:42.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:42.820 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:14:42.820+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:14:43.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:43.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:44.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:44.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:45.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:45.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:46.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:46.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:47.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:47.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:47.821 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:14:47.821+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:14:48.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:48.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:49.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:49.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:50.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:50.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:51.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:51.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:52.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:52.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:52.822 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:14:52.822+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:14:53.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:53.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:54.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:54.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:55.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:55.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:56.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:56.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:57.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:57.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:57.823 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:14:57.824+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:14:58.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:58.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:14:59.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:14:59.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:00.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:00.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:01.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:01.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:02.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:02.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:02.824 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:15:02.825+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:15:03.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:03.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:04.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:04.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:05.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:05.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:06.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:06.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:07.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:07.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:08.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:08.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:09.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:09.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:10.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:10.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:11.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:11.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:12.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:15:12.135+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:15:12.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:12.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:13.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:13.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:14.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:14.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:15.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:15.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:16.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:16.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:17.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:15:17.136+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:15:17.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:17.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:18.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:18.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:19.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:19.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:20.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:20.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:21.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:21.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:22.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:15:22.137+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:15:22.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:22.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:23.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:23.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:24.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:24.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:25.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:25.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:26.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:26.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:27.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:15:27.137+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:15:27.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:27.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:28.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:28.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:29.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:29.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:30.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:30.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:31.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:31.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:32.138 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:15:32.138+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:15:32.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:32.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:33.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:33.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:34.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:34.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:35.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:35.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:36.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:36.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:37.139 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:15:37.140+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:15:37.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:37.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:38.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:38.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:39.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:39.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:40.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:40.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:41.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:41.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:42.140 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:15:42.140+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:15:42.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:42.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:43.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:43.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:44.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:44.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:45.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:45.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:46.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:46.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:47.141 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:15:47.141+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:15:47.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:47.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:48.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:48.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:49.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:49.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:50.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:50.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:51.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:51.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:52.142 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:15:52.142+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:15:52.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:52.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:53.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:53.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:54.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:54.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:55.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:55.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:56.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:56.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:57.143 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:15:57.143+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:15:57.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:57.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:58.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:58.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:15:59.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:15:59.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:00.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:00.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:01.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:01.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:02.144 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:16:02.145+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:16:02.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:02.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:03.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:03.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:04.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:04.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:05.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:05.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:06.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:06.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:07.146 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:16:07.145+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:16:07.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:07.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:08.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:08.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:09.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:09.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:10.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:10.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:11.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:11.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:12.146 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:16:12.146+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:16:12.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:12.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:13.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:13.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:14.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:14.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:15.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:15.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:16.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:16.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:17.147 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:16:17.148+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:16:17.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:17.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:18.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:18.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:19.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:19.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:20.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:20.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:21.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:21.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:22.148 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:16:22.149+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:16:22.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:22.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:23.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:23.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:24.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:24.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:25.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:25.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:26.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:26.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:27.149 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:16:27.150+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:16:27.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:27.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:28.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:28.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:29.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:29.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:30.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:30.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:31.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:31.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:32.149 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:16:32.150+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:16:32.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:32.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:33.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:33.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:34.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:34.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:35.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:35.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:36.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:36.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:37.150 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:16:37.151+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:16:37.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:37.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:38.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:38.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:39.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:39.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:40.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:40.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:41.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:41.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:42.151 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:16:42.151+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:16:42.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:42.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:43.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:43.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:44.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:44.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:45.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:45.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:46.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:46.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:47.152 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:16:47.152+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:16:47.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:47.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:48.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:48.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:49.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:49.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:50.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:50.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:51.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:51.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:52.153 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:16:52.153+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:16:52.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:52.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:53.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:53.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:54.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:54.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:55.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:55.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:56.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:56.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:57.154 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:16:57.154+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:16:57.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:57.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:58.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:58.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:16:59.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:16:59.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:00.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:00.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:01.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:01.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:02.155 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:17:02.156+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:17:02.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:02.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:03.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:03.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:04.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:04.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:05.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:05.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:06.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:06.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:07.156 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:17:07.156+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:17:07.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:07.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:08.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:08.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:09.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:09.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:10.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:10.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:11.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:11.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:12.157 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:17:12.157+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:17:12.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:12.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:13.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:13.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:14.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:14.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:15.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:15.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:16.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:16.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:17.158 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:17:17.158+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:17:17.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:17.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:18.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:18.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:19.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:19.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:20.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:20.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:21.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:21.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:22.159 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:17:22.159+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:17:22.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:22.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:23.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:23.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:24.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:24.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:25.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:25.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:26.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:26.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:27.160 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:17:27.160+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:17:27.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:27.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:28.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:28.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:29.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:29.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:30.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:30.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:31.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:31.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:32.161 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:17:32.161+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:17:32.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:32.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:33.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:33.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:34.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:34.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:35.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:35.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:36.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:36.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:37.162 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:17:37.162+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:17:37.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:37.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:38.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:38.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:39.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:39.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:40.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:40.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:41.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:41.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:42.163 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:17:42.163+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:17:42.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:42.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:43.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:43.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:44.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:44.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:45.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:45.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:46.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:46.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:47.164 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:17:47.164+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:17:47.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:47.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:48.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:48.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:49.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:49.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:50.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:50.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:51.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:51.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:52.165 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:17:52.165+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:17:52.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:52.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:53.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:53.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:54.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:54.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:55.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:55.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:56.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:56.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:57.166 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:17:57.166+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:17:57.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:57.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:58.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:58.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:17:59.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:17:59.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:00.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:00.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:01.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:01.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:02.167 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:18:02.167+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:18:02.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:02.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:03.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:03.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:04.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:04.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:05.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:05.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:06.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:06.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:07.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:07.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:07.168 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:18:07.169+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:18:08.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:08.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:09.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:09.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:10.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:10.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:11.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:11.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:12.169 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:18:12.170+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:18:12.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:12.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:13.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:13.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:14.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:14.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:15.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:15.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:16.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:16.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:17.170 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:18:17.170+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:18:17.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:17.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:18.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:18.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:19.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:19.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:20.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:20.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:21.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:21.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:22.171 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:18:22.171+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:18:22.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:22.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:23.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:23.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:24.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:24.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:25.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:25.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:26.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:26.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:27.172 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:18:27.173+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:18:27.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:27.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:28.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:28.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:29.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:29.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:30.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:30.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:31.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:31.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:32.173 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:18:32.173+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:18:32.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:32.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:33.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:33.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:34.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:34.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:35.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:35.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:36.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:36.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:37.176 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:18:37.174+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:18:37.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:37.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:38.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:38.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:39.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:39.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:40.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:40.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:41.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:41.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:42.175 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:18:42.176+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:18:42.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:42.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:43.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:43.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:44.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:44.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:45.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:45.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:46.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:46.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:47.176 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:18:47.176+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:18:47.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:47.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:48.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:48.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:49.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:49.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:50.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:50.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:51.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:51.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:52.177 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:18:52.178+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:18:52.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:52.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:53.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:53.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:54.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:54.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:55.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:55.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:56.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:56.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:57.178 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:18:57.178+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:18:57.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:57.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:58.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:58.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:18:59.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:18:59.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:00.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:00.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:01.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:01.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:02.179 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:19:02.179+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:19:02.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:02.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:03.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:03.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:04.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:04.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:05.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:05.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:06.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:06.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:07.180 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:19:07.180+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:19:07.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:07.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:08.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:08.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:09.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:09.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:10.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:10.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:11.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:11.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:12.181 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:19:12.181+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:19:12.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:12.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:13.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:13.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:14.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:14.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:15.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:15.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:16.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:16.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:17.182 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:19:17.182+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:19:17.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:17.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:18.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:18.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:19.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:19.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:20.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:20.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:21.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:21.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:22.183 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:19:22.184+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:19:22.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:22.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:23.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:23.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:24.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:24.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:25.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:25.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:26.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:26.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:27.183 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:19:27.185+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:19:27.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:27.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:28.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:28.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:29.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:29.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:30.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:30.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:31.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:31.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:32.184 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:19:32.184+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:19:32.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:32.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:33.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:33.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:34.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:34.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:35.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:35.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:36.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:36.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:37.185 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:19:37.186+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:19:37.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:37.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:38.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:38.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:39.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:39.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:40.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:40.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:41.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:41.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:42.186 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:19:42.186+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:19:42.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:42.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:43.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:43.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:44.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:44.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:45.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:45.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:46.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:46.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:47.187 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:19:47.187+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:19:47.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:47.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:48.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:48.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:49.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:49.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:50.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:50.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:51.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:51.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:52.188 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:19:52.188+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:19:52.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:52.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:53.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:53.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:54.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:54.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:55.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:55.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:56.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:56.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:57.189 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:19:57.189+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:19:57.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:57.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:58.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:58.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:19:59.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:19:59.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:00.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:00.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:01.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:01.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:02.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:20:02.190+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:20:02.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:02.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:03.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:03.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:04.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:04.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:05.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:05.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:06.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:06.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:07.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:20:07.191+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:20:07.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:07.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:08.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:08.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:09.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:09.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:10.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:10.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:11.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:11.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:12.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:20:12.192+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:20:12.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:12.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:13.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:13.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:14.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:14.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:15.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:15.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:16.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:16.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:17.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:20:17.193+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:20:17.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:17.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:18.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:18.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:19.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:19.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:20.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:20.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:21.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:21.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:22.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:20:22.194+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:20:22.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:22.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:23.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:23.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:24.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:24.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:25.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:25.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:26.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:26.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:27.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:20:27.195+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:20:27.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:27.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:28.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:28.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:29.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:29.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:30.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:30.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:31.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:31.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:32.196 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:20:32.196+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:20:32.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:32.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:33.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:33.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:34.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:34.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:35.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:35.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:36.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:36.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:37.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:20:37.197+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:20:37.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:37.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:38.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:38.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:39.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:39.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:40.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:40.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:41.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:41.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:42.199 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:20:42.199+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:20:42.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:42.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:43.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:43.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:44.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:44.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:45.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:45.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:46.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:46.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:47.199 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:20:47.200+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:20:47.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:47.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:48.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:48.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:49.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:49.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:50.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:50.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:51.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:51.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:52.200 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:20:52.200+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:20:52.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:52.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:53.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:53.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:54.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:54.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:55.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:55.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:56.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:56.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:57.201 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:20:57.201+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:20:57.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:57.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:58.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:58.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:20:59.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:20:59.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:00.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:00.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:01.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:01.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:02.202 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:21:02.202+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:21:02.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:02.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:03.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:03.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:04.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:04.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:05.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:05.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:06.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:06.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:07.203 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:21:07.203+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:21:07.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:07.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:08.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:08.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:09.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:09.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:10.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:10.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:11.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:11.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:12.204 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:21:12.204+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:21:12.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:12.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:13.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:13.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:14.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:14.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:15.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:15.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:16.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:16.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:17.205 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:21:17.205+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:21:17.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:17.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:18.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:18.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:19.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:19.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:20.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:20.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:21.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:21.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:22.206 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:21:22.206+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:21:22.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:22.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:23.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:23.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:24.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:24.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:25.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:25.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:26.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:26.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:27.207 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:21:27.207+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:21:28.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:28.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:29.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:29.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:30.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:30.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:31.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:31.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:32.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:32.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:32.208 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:21:32.208+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:21:33.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:33.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:34.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:34.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:35.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:35.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:36.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:36.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:36.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:36.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:37.209 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:21:37.210+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:21:37.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:37.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:38.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:38.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:39.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:39.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:40.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:40.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:41.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:41.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:42.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:21:42.210+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:21:42.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:42.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:43.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:43.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:44.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:44.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:45.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:45.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:46.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:46.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:47.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:21:47.212+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:21:47.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:47.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:48.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:48.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:49.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:49.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:50.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:50.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:52.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:52.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:52.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:21:52.212+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:21:53.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:53.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:54.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:54.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:54.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:54.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:55.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:55.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:56.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:56.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:57.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:21:57.214+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:21:57.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:57.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:58.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:58.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:21:59.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:21:59.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:00.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:00.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:02.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:02.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:02.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:22:02.214+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:22:03.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:03.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:03.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:03.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:05.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:05.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:06.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:06.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:07.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:07.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:07.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:22:07.215+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:22:08.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:08.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:09.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:09.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:10.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:10.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:11.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:11.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:12.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:12.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:12.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:22:12.216+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:22:13.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:13.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:14.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:14.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:15.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:15.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:16.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:16.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:17.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:17.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:17.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:22:17.219+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:22:18.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:18.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:19.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:19.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:20.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:20.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:21.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:21.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:22.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:22.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:22.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:22:22.219+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:22:23.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:23.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:24.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:24.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:25.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:25.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:26.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:26.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:27.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:27.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:27.281 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:22:27.221+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:22:28.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:28.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:29.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:29.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:30.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:30.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:31.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:31.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:32.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:32.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:32.220 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:22:32.220+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:22:33.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:33.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:34.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:34.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:35.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:35.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:36.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:36.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:37.221 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:22:37.221+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:22:37.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:37.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:38.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:38.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:39.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:39.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:40.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:40.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:41.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:41.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:42.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:42.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:42.222 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:22:42.222+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:22:43.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:43.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:44.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:44.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:45.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:45.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:46.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:46.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:47.223 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:22:47.223+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:22:47.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:47.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:48.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:48.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:49.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:49.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:50.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:50.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:51.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:51.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:52.224 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:22:52.224+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:22:52.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:52.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:53.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:53.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:54.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:54.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:55.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:55.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:56.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:56.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:57.225 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:22:57.226+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:22:57.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:57.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:58.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:58.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:22:59.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:22:59.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:00.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:00.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:01.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:01.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:02.226 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:23:02.226+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:23:02.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:02.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:03.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:03.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:04.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:04.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:05.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:05.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:06.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:06.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:07.227 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:23:07.228+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:23:07.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:07.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:08.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:08.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:09.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:09.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:10.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:10.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:11.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:11.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:12.228 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:23:12.229+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:23:12.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:12.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:13.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:13.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:14.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:14.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:15.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:15.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:16.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:16.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:17.229 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:23:17.230+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:23:17.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:17.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:18.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:18.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:19.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:19.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:20.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:20.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:21.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:21.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:22.230 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:23:22.231+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:23:22.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:22.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:23.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:23.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:24.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:24.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:25.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:25.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:26.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:26.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:27.231 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:23:27.231+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:23:27.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:27.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:28.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:28.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:29.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:29.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:30.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:30.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:31.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:31.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:32.232 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:23:32.233+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:23:32.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:32.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:33.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:33.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:34.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:34.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:35.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:35.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:36.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:36.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:37.233 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:23:37.233+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:23:37.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:37.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:38.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:38.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:39.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:39.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:40.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:40.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:41.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:41.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:42.234 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:23:42.235+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:23:42.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:42.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:43.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:43.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:44.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:44.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:45.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:45.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:46.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:46.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:47.235 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:23:47.235+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:23:47.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:47.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:48.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:48.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:49.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:49.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:50.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:50.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:51.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:51.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:52.237 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:23:52.237+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:23:52.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:52.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:53.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:53.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:54.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:54.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:55.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:55.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:56.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:56.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:57.237 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:23:57.238+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:23:57.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:57.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:58.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:58.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:23:59.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:23:59.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:00.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:00.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:01.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:01.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:02.238 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:24:02.239+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:24:02.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:02.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:03.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:03.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:04.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:04.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:05.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:05.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:06.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:06.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:07.240 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:24:07.240+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:24:07.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:07.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:08.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:08.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:09.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:09.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:10.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:10.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:11.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:11.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:12.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:24:12.241+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:24:12.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:12.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:13.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:13.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:14.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:14.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:15.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:15.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:16.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:16.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:17.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:24:17.242+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:24:17.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:17.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:18.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:18.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:19.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:19.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:20.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:20.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:21.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:21.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:22.242 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:24:22.242+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:24:22.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:22.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:23.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:23.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:24.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:24.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:25.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:25.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:26.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:26.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:27.243 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:24:27.243+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:24:27.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:27.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:28.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:28.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:29.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:29.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:30.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:30.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:31.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:31.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:32.244 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:24:32.245+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:24:32.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:32.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:33.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:33.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:34.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:34.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:35.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:35.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:36.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:36.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:37.245 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:24:37.246+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:24:37.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:37.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:38.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:38.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:39.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:39.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:40.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:40.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:41.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:41.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:42.246 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:24:42.246+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:24:42.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:42.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:43.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:43.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:44.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:44.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:45.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:45.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:46.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:46.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:47.247 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:24:47.247+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:24:47.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:47.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:48.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:48.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:49.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:49.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:50.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:50.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:51.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:51.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:52.248 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:24:52.248+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:24:52.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:52.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:53.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:53.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:54.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:54.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:55.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:55.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:56.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:56.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:57.249 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:24:57.249+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:24:57.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:57.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:58.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:58.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:24:59.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:24:59.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:00.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:00.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:01.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:01.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:02.250 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:25:02.250+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:25:02.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:02.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:03.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:03.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:04.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:04.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:05.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:05.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:06.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:06.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:07.251 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:25:07.251+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:25:07.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:07.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:08.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:08.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:09.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:09.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:10.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:10.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:11.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:11.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:12.252 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:25:12.252+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:25:12.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:12.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:13.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:13.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:14.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:14.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:15.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:15.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:16.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:16.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:17.253 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:25:17.254+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:25:17.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:17.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:18.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:18.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:19.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:19.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:20.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:20.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:21.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:21.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:22.254 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:25:22.255+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:25:22.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:22.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:23.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:23.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:24.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:24.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:25.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:25.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:26.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:26.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:27.254 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:25:27.255+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:25:27.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:27.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:28.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:28.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:29.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:29.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:30.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:30.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:31.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:31.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:32.255 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:25:32.255+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:25:32.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:32.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:33.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:33.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:34.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:34.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:35.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:35.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:36.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:36.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:37.256 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:25:37.256+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:25:37.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:37.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:38.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:38.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:39.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:39.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:40.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:40.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:41.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:41.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:42.257 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:25:42.258+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:25:42.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:42.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:43.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:43.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:44.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:44.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:45.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:45.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:46.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:46.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:47.259 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:25:47.259+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:25:47.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:47.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:48.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:48.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:49.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:49.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:50.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:50.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:51.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:51.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:52.259 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:25:52.260+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:25:52.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:52.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:53.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:53.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:54.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:54.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:55.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:55.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:56.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:56.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:57.260 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:25:57.260+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:25:57.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:57.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:58.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:58.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:25:59.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:25:59.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:00.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:00.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:01.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:01.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:02.261 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:26:02.261+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:26:02.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:02.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:03.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:03.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:04.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:04.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:05.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:05.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:06.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:06.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:07.263 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:26:07.263+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:26:07.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:07.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:08.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:08.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:09.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:09.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:10.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:10.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:11.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:11.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:12.264 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:26:12.263+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:26:12.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:12.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:13.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:13.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:14.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:14.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:15.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:15.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:16.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:16.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:17.264 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:26:17.264+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:26:17.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:17.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:18.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:18.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:19.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:19.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:20.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:20.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:21.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:21.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:22.265 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:26:22.266+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:26:22.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:22.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:23.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:23.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:25.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:25.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:25.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:25.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:27.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:27.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:27.266 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:26:27.267+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:26:27.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:27.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:29.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:29.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:30.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:30.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:31.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:31.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:32.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:32.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:32.267 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:26:32.268+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:26:33.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:33.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:34.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:34.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:35.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:35.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:36.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:36.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:37.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:37.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:37.268 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:26:37.269+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:26:38.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:38.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:39.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:39.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:40.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:40.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:41.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:41.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:42.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:42.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:42.269 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:26:42.269+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:26:43.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:43.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:44.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:44.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:45.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:45.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:46.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:46.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:47.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:47.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:47.270 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:26:47.270+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:26:48.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:48.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:49.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:49.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:50.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:50.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:51.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:51.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:52.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:52.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:53.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:53.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:54.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:54.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:55.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:55.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:56.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:56.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:57.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:57.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:57.272 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:26:57.273+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:26:58.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:58.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:26:59.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:26:59.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:00.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:00.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:01.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:01.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:02.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:02.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:02.273 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:27:02.273+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:27:03.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:03.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:04.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:04.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:05.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:05.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:06.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:06.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:07.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:07.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:07.274 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:27:07.274+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:27:08.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:08.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:09.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:09.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:10.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:10.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:11.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:11.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:12.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:12.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:12.275 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:27:12.276+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:27:13.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:13.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:14.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:14.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:15.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:15.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:16.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:16.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:17.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:17.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:17.276 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:27:17.276+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:27:18.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:18.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:19.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:19.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:20.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:20.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:21.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:21.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:22.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:22.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:22.278 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:27:22.278+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:27:23.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:23.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:24.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:24.075+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:25.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:25.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:26.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:26.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:27.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:27.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:27.278 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:27:27.279+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:27:28.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:28.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:29.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:29.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:30.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:30.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:31.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:31.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:32.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:32.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:32.279 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:27:32.279+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:27:33.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:33.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:34.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:34.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:35.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:35.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:36.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:36.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:36.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:36.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:37.280 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:27:37.281+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:27:38.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:38.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:38.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:38.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:39.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:39.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:40.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:40.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:41.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:41.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:42.281 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:27:42.281+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:27:42.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:42.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:43.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:43.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:44.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:44.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:45.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:45.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:46.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:46.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:47.282 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:27:47.282+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:27:47.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:47.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:48.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:48.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:49.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:49.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:50.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:50.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:51.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:51.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:52.283 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:27:52.283+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:27:52.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:52.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:53.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:53.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:54.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:54.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:55.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:55.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:56.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:56.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:57.284 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:27:57.285+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:27:57.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:57.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:58.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:58.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:27:59.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:27:59.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:00.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:00.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:01.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:01.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:02.285 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:28:02.285+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:28:02.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:02.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:03.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:03.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:04.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:04.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:05.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:05.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:06.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:06.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:07.287 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:28:07.286+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:28:07.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:07.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:08.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:08.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:09.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:09.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:10.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:10.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:11.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:11.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:12.287 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:28:12.287+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:28:12.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:12.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:13.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:13.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:14.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:14.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:15.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:15.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:16.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:16.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:17.288 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:28:17.289+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:28:17.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:17.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:18.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:18.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:19.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:19.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:20.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:20.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:21.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:21.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:22.288 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:28:22.289+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:28:22.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:22.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:23.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:23.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:24.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:24.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:25.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:25.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:26.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:26.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:27.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:28:27.289+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:28:27.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:27.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:28.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:28.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:29.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:29.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:30.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:30.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:31.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:31.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:32.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:28:32.290+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:28:32.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:32.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:33.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:33.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:34.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:34.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:35.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:35.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:36.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:36.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:37.291 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:28:37.292+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:28:37.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:37.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:38.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:38.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:39.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:39.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:40.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:40.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:41.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:41.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:42.293 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:28:42.292+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:28:42.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:42.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:43.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:43.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:44.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:44.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:45.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:45.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:46.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:46.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:47.293 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:28:47.293+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:28:47.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:47.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:48.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:48.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:49.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:49.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:50.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:50.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:51.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:51.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:52.294 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:28:52.294+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:28:52.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:52.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:53.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:53.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:54.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:54.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:55.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:55.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:56.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:56.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:57.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:28:57.295+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:28:57.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:57.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:58.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:58.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:28:59.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:28:59.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:00.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:00.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:01.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:01.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:02.296 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:29:02.296+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:29:02.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:02.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:03.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:03.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:04.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:04.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:05.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:05.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:06.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:06.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:07.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:29:07.297+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:29:07.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:07.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:08.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:08.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:09.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:09.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:10.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:10.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:11.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:11.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:12.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:29:12.298+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:29:12.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:12.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:13.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:13.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:14.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:14.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:15.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:15.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:16.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:16.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:17.299 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:29:17.299+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:29:17.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:17.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:18.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:18.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:19.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:19.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:20.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:20.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:21.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:21.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:22.300 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:29:22.300+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:29:22.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:22.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:23.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:23.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:24.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:24.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:25.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:25.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:26.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:26.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:27.301 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:29:27.301+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:29:27.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:27.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:28.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:28.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:29.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:29.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:30.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:30.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:31.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:31.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:32.302 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:29:32.303+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:29:32.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:32.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:33.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:33.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:34.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:34.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:35.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:35.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:36.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:36.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:37.304 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:29:37.304+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:29:37.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:37.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:38.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:38.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:39.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:39.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:40.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:40.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:41.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:41.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:42.304 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:29:42.304+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:29:42.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:42.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:43.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:43.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:44.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:44.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:45.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:45.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:46.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:46.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:47.305 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:29:47.305+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:29:47.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:47.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:48.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:48.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:49.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:49.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:50.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:50.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:51.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:51.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:52.306 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:29:52.306+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:29:52.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:52.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:53.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:53.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:54.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:54.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:55.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:55.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:56.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:56.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:57.307 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:29:57.307+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:29:57.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:57.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:29:59.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:29:59.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:00.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:00.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:00.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:00.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:01.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:01.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:02.308 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:30:02.308+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:30:02.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:02.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:03.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:03.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:05.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:05.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:06.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:06.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:07.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:07.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:07.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:30:07.309+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:30:08.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:08.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:09.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:09.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:10.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:10.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:11.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:11.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:12.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:12.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:12.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:30:12.310+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:30:13.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:13.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:14.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:14.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:15.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:15.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:16.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:16.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:17.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:17.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:17.311 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:30:17.311+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:30:18.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:18.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:19.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:19.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:20.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:20.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:21.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:21.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:22.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:22.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:22.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:30:22.313+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:30:23.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:23.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:24.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:24.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:25.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:25.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:26.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:26.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:27.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:27.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:27.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:30:27.313+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:30:28.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:28.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:29.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:29.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:30.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:30.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:31.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:31.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:32.315 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:30:32.315+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:30:32.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:32.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:33.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:33.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:34.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:34.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:35.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:35.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:36.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:36.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:37.315 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:30:37.315+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:30:37.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:37.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:38.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:38.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:39.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:39.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:40.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:40.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:41.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:41.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:42.317 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:30:42.316+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:30:42.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:42.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:43.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:43.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:44.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:44.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:45.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:45.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:46.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:46.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:47.317 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:30:47.317+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:30:47.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:47.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:48.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:48.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:49.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:49.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:50.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:50.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:51.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:51.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:52.319 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:30:52.319+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:30:52.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:52.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:53.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:53.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:54.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:54.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:55.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:55.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:56.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:56.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:57.319 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:30:57.320+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:30:57.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:57.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:58.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:58.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:30:59.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:30:59.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:00.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:00.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:01.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:01.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:02.323 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:31:02.320+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:31:02.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:02.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:03.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:03.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:04.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:04.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:05.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:05.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:06.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:06.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:07.321 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:31:07.321+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:31:07.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:07.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:08.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:08.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:09.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:09.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:10.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:10.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:11.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:11.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:12.322 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:31:12.322+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:31:12.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:12.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:13.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:13.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:14.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:14.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:15.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:15.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:16.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:16.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:17.323 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:31:17.323+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:31:17.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:17.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:18.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:18.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:19.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:19.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:20.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:20.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:21.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:21.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:22.324 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:31:22.325+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:31:22.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:22.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:23.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:23.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:24.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:24.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:25.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:25.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:26.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:26.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:27.325 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:31:27.326+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:31:27.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:27.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:28.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:28.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:29.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:29.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:30.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:30.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:31.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:31.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:32.326 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:31:32.326+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:31:32.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:32.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:33.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:33.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:34.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:34.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:35.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:35.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:36.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:36.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:37.326 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:31:37.326+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:31:37.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:37.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:38.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:38.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:39.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:39.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:40.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:40.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:41.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:41.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:42.328 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:31:42.328+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:31:42.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:42.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:43.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:43.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:44.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:44.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:45.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:45.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:46.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:46.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:47.329 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:31:47.329+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:31:47.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:47.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:48.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:48.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:49.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:49.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:50.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:50.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:51.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:51.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:52.329 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:31:52.329+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:31:52.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:52.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:53.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:53.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:54.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:54.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:55.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:55.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:56.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:56.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:57.330 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:31:57.330+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:31:57.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:57.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:58.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:58.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:31:59.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:31:59.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:00.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:00.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:01.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:01.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:02.331 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:32:02.331+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:32:02.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:02.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:03.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:03.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:04.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:04.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:05.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:05.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:06.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:06.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:07.332 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:32:07.332+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:32:07.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:07.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:08.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:08.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:09.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:09.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:10.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:10.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:11.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:11.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:12.333 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:32:12.333+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:32:12.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:12.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:13.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:13.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:14.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:14.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:15.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:15.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:16.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:16.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:17.334 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:32:17.334+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:32:17.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:17.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:18.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:18.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:19.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:19.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:20.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:20.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:21.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:21.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:22.335 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:32:22.335+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:32:22.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:22.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:23.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:23.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:24.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:24.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:25.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:25.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:26.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:26.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:27.336 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:32:27.337+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:32:27.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:27.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:28.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:28.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:29.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:29.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:30.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:30.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:31.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:31.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:32.338 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:32:32.338+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:32:32.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:32.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:33.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:33.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:34.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:34.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:35.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:35.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:36.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:36.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:37.338 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:32:37.338+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:32:37.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:37.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:38.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:38.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:39.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:39.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:40.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:40.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:41.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:41.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:42.339 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:32:42.339+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:32:42.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:42.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:43.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:43.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:44.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:44.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:45.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:45.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:46.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:46.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:47.341 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:32:47.341+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:32:47.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:47.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:48.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:48.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:49.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:49.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:50.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:50.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:51.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:51.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:52.341 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:32:52.341+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:32:52.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:52.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:53.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:53.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:54.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:54.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:55.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:55.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:56.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:56.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:57.342 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:32:57.343+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:32:57.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:57.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:58.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:58.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:32:59.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:32:59.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:00.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:00.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:01.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:01.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:02.343 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:33:02.343+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:33:02.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:02.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:03.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:03.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:04.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:04.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:05.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:05.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:06.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:06.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:07.345 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:33:07.345+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:33:07.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:07.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:08.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:08.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:09.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:09.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:10.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:10.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:11.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:11.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:12.345 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:33:12.345+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:33:12.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:12.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:13.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:13.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:14.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:14.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:15.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:15.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:16.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:16.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:17.346 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:33:17.346+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:33:17.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:17.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:18.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:18.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:19.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:19.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:20.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:20.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:21.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:21.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:22.347 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:33:22.347+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:33:22.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:22.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:23.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:23.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:24.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:24.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:25.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:25.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:26.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:26.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:27.348 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:33:27.348+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:33:27.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:27.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:28.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:28.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:29.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:29.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:30.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:30.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:31.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:31.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:32.349 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:33:32.349+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:33:32.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:32.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:33.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:33.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:34.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:34.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:35.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:35.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:36.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:36.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:37.350 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:33:37.350+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:33:37.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:37.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:38.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:38.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:39.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:39.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:40.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:40.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:41.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:41.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:42.351 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:33:42.351+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:33:42.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:42.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:43.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:43.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:44.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:44.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:45.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:45.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:46.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:46.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:47.352 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:33:47.352+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:33:47.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:47.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:48.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:48.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:49.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:49.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:50.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:50.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:51.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:51.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:52.353 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:33:52.353+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:33:52.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:52.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:53.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:53.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:54.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:54.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:55.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:55.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:56.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:56.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:57.354 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:33:57.354+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:33:57.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:57.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:58.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:58.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:33:59.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:33:59.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:00.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:00.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:01.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:01.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:02.355 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:34:02.356+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:34:02.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:02.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:03.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:03.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:04.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:04.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:05.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:05.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:06.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:06.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:07.356 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:34:07.356+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:34:07.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:07.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:08.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:08.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:09.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:09.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:10.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:10.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:11.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:11.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:12.357 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:34:12.357+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:34:12.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:12.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:13.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:13.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:14.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:14.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:15.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:15.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:16.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:16.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:17.358 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:34:17.358+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:34:17.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:17.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:18.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:18.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:19.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:19.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:20.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:20.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:21.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:21.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:22.359 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:34:22.360+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:34:22.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:22.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:23.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:23.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:24.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:24.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:25.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:25.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:26.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:26.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:27.360 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:34:27.361+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:34:27.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:27.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:28.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:28.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:29.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:29.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:30.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:30.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:31.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:31.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:32.360 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:34:32.361+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:34:32.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:32.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:33.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:33.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:34.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:34.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:35.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:35.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:36.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:36.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:37.361 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:34:37.362+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:34:37.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:37.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:38.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:38.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:39.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:39.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:40.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:40.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:41.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:41.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:42.362 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:34:42.363+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:34:42.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:42.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:43.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:43.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:44.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:44.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:45.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:45.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:46.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:46.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:47.363 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:34:47.364+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:34:47.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:47.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:48.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:48.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:49.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:49.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:50.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:50.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:51.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:51.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:52.364 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:34:52.364+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:34:52.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:52.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:53.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:53.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:54.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:54.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:55.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:55.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:56.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:56.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:57.366 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:34:57.366+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:34:57.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:57.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:58.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:58.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:34:59.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:34:59.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:00.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:00.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:01.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:01.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:02.367 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:35:02.367+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:35:02.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:02.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:03.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:03.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:04.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:04.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:05.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:05.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:06.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:06.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:07.367 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:35:07.367+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:35:07.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:07.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:08.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:08.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:09.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:09.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:10.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:10.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:11.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:11.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:12.368 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:35:12.368+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:35:12.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:12.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:13.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:13.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:14.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:14.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:15.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:15.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:16.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:16.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:17.370 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:35:17.370+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:35:17.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:17.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:18.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:18.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:19.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:19.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:20.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:20.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:21.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:21.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:22.370 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:35:22.370+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:35:22.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:22.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:23.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:23.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:24.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:24.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:25.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:25.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:26.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:26.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:27.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:35:27.372+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:35:27.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:27.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:28.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:28.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:29.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:29.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:30.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:30.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:31.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:31.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:32.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:35:32.372+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:35:32.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:32.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:33.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:33.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:34.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:34.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:35.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:35.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:36.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:36.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:37.373 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:35:37.373+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:35:37.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:37.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:38.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:38.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:39.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:39.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:40.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:40.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:41.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:41.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:42.374 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:35:42.374+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:35:42.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:42.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:43.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:43.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:44.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:44.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:45.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:45.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:46.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:46.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:47.375 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:35:47.375+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:35:47.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:47.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:48.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:48.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:49.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:49.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:50.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:50.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:51.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:51.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:52.376 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:35:52.376+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:35:52.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:52.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:53.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:53.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:54.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:54.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:55.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:55.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:56.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:56.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:57.377 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:35:57.377+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:35:57.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:57.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:58.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:58.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:35:59.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:35:59.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:00.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:00.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:01.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:01.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:02.378 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:36:02.378+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:36:02.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:02.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:03.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:03.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:04.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:04.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:05.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:05.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:06.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:06.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:07.379 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:36:07.379+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:36:07.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:07.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:08.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:08.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:09.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:09.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:10.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:10.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:11.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:11.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:12.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:36:12.380+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:36:12.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:12.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:13.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:13.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:14.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:14.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:15.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:15.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:16.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:16.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:17.381 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:36:17.381+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:36:17.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:17.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:18.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:18.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:19.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:19.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:20.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:20.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:21.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:21.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:22.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:36:22.382+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:36:22.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:22.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:23.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:23.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:24.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:24.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:25.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:25.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:26.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:26.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:27.383 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:36:27.383+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:36:27.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:27.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:28.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:28.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:29.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:29.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:30.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:30.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:31.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:31.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:32.384 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:36:32.384+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:36:32.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:32.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:33.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:33.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:34.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:34.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:35.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:35.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:36.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:36.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:37.385 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:36:37.385+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:36:37.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:37.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:38.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:38.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:39.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:39.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:40.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:40.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:41.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:41.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:42.386 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:36:42.386+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:36:42.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:42.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:43.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:43.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:44.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:44.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:45.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:45.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:46.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:46.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:47.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:36:47.387+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:36:47.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:47.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:48.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:48.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:49.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:49.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:50.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:50.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:51.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:51.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:52.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:36:52.388+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:36:52.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:52.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:53.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:53.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:54.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:54.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:55.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:55.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:56.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:56.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:57.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:36:57.389+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:36:57.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:57.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:58.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:58.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:36:59.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:36:59.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:00.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:00.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:01.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:01.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:02.390 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:37:02.390+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:37:02.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:02.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:03.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:03.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:04.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:04.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:05.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:05.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:06.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:06.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:07.391 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:37:07.391+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:37:07.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:07.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:08.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:08.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:09.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:09.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:10.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:10.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:11.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:11.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:12.392 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:37:12.392+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:37:12.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:12.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:13.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:13.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:14.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:14.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:15.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:15.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:16.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:16.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:17.393 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:37:17.393+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:37:17.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:17.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:18.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:18.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:19.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:19.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:20.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:20.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:21.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:21.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:22.394 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:37:22.395+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:37:22.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:22.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:23.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:23.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:24.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:24.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:25.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:25.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:26.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:26.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:27.394 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:37:27.395+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:37:27.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:27.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:28.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:28.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:29.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:29.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:30.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:30.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:31.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:31.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:32.395 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:37:32.395+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:37:32.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:32.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:33.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:33.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:34.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:34.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:35.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:35.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:36.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:36.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:37.397 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:37:37.397+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:37:37.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:37.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:38.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:38.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:39.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:39.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:40.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:40.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:41.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:41.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:42.398 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:37:42.398+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:37:42.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:42.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:43.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:43.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:44.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:44.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:45.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:45.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:46.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:46.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:47.398 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:37:47.398+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:37:47.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:47.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:48.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:48.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:49.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:49.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:50.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:50.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:51.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:51.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:52.399 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:37:52.399+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:37:52.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:52.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:53.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:53.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:54.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:54.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:55.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:55.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:56.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:56.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:57.400 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:37:57.400+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:37:57.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:57.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:58.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:58.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:37:59.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:37:59.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:00.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:00.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:01.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:01.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:02.401 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:38:02.401+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:38:02.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:02.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:03.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:03.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:04.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:04.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:05.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:05.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:06.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:06.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:07.402 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:38:07.402+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:38:07.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:07.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:08.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:08.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:09.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:09.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:10.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:10.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:11.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:11.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:12.403 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:38:12.403+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:38:12.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:12.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:13.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:13.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:14.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:14.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:15.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:15.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:16.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:16.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:17.404 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:38:17.404+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:38:17.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:17.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:18.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:18.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:19.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:19.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:20.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:20.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:21.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:21.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:22.405 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:38:22.405+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:38:22.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:22.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:23.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:23.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:24.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:24.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:25.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:25.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:26.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:26.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:27.407 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:38:27.407+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:38:27.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:27.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:28.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:28.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:29.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:29.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:30.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:30.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:31.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:31.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:32.407 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:38:32.408+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:38:32.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:32.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:33.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:33.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:34.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:34.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:35.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:35.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:36.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:36.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:37.409 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:38:37.409+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:38:37.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:37.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:38.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:38.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:39.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:39.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:41.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:41.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:41.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:41.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:42.410 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:38:42.411+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:38:43.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:43.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:44.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:44.024+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:45.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:45.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:46.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:46.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:47.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:47.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:47.412 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:38:47.412+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:38:48.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:48.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:49.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:49.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:50.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:50.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:51.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:51.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:52.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:52.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:52.412 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:38:52.412+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:38:53.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:53.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:54.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:54.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:55.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:55.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:56.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:56.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:57.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:57.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:57.413 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:38:57.413+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:38:58.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:58.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:38:59.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:38:59.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:00.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:00.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:01.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:01.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:02.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:02.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:02.413 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:39:02.413+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:39:03.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:03.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:04.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:04.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:05.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:05.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:06.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:06.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:07.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:07.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:07.414 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:39:07.415+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:39:08.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:08.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:09.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:09.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:10.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:10.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:11.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:11.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:12.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:12.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:12.415 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:39:12.416+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:39:13.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:13.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:14.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:14.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:15.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:15.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:16.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:16.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:17.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:17.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:17.416 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:39:17.416+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:39:18.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:18.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:19.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:19.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:20.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:20.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:21.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:21.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:22.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:22.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:22.417 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:39:22.417+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:39:23.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:23.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:24.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:24.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:25.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:25.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:26.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:26.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:27.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:27.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:27.418 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:39:27.418+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:39:28.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:28.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:29.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:29.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:30.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:30.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:31.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:31.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:32.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:32.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:32.419 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:39:32.419+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:39:33.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:33.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:34.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:34.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:35.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:35.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:36.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:36.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:37.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:37.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:37.420 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:39:37.420+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:39:38.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:38.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:39.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:39.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:40.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:40.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:41.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:41.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:42.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:42.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:42.421 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:39:42.421+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:39:43.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:43.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:44.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:44.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:45.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:45.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:46.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:46.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:47.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:47.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:47.422 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:39:47.422+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:39:48.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:48.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:49.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:49.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:50.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:50.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:51.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:51.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:52.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:52.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:52.423 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:39:52.423+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:39:52.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:52.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:54.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:54.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:55.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:55.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:56.009 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:56.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:56.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:56.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:57.424 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:39:57.424+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:39:57.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:57.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:58.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:58.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:39:59.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:39:59.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:00.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:00.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:01.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:01.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:02.424 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:40:02.425+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:40:02.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:02.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:03.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:03.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:04.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:04.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:05.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:05.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:06.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:06.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:07.425 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:40:07.426+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:40:07.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:07.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:08.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:08.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:09.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:10.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:11.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:11.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:11.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:11.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:12.427 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:40:12.427+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:40:12.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:12.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:13.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:13.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:15.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:15.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:16.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:16.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:17.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:17.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:17.427 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:40:17.429+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:40:18.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:18.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:19.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:19.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:20.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:20.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:21.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:21.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:22.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:22.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:22.428 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:40:22.429+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:40:23.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:23.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:24.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:24.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:25.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:25.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:25.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:26.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:26.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:26.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:27.429 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:40:27.429+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:40:28.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:28.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:29.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:29.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:30.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:30.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:31.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:31.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:32.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:32.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:32.430 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:40:32.430+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:40:33.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:33.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:34.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:34.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:35.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:35.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:36.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:36.030+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:37.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:37.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:37.431 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:40:37.431+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:40:38.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:38.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:39.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:39.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:40.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:40.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:40.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:40.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:41.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:41.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:42.432 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:40:42.432+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:40:42.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:42.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:43.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:43.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:44.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:44.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:45.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:45.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:46.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:46.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:47.433 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:40:47.433+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:40:47.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:47.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:48.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:48.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:49.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:49.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:50.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:50.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:51.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:51.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:52.434 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:40:52.434+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:40:52.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:52.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:53.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:53.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:54.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:54.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:55.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:55.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:56.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:56.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:57.435 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:40:57.435+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:40:57.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:57.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:58.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:58.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:40:59.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:40:59.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:00.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:00.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:01.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:01.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:02.436 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:41:02.436+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:41:02.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:02.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:03.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:03.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:04.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:04.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:05.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:05.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:06.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:06.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:07.437 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:41:07.437+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:41:07.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:07.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:08.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:08.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:09.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:09.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:10.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:10.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:11.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:11.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:12.438 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:41:12.438+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:41:12.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:12.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:13.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:13.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:14.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:14.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:15.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:15.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:16.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:16.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:17.438 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:41:17.439+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:41:17.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:17.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:18.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:18.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:19.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:19.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:20.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:20.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:21.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:21.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:22.440 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:41:22.440+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:41:22.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:22.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:23.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:23.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:24.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:24.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:25.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:25.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:26.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:26.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:27.441 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:41:27.441+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:41:27.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:27.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:28.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:28.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:29.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:29.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:30.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:30.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:31.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:31.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:32.442 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:41:32.442+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:41:32.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:32.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:33.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:33.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:34.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:34.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:35.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:35.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:36.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:36.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:37.443 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:41:37.443+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:41:37.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:37.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:38.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:38.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:39.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:39.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:40.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:40.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:41.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:41.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:42.444 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:41:42.444+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:41:42.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:42.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:43.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:43.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:45.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:45.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:46.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:46.052+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:47.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:47.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:47.445 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:41:47.445+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:41:48.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:48.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:49.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:49.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:50.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:50.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:51.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:51.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:52.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:52.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:52.446 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:41:52.446+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:41:53.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:53.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:54.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:54.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:55.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:55.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:56.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:56.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:57.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:57.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:57.447 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:41:57.447+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:41:58.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:58.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:41:59.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:41:59.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:00.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:00.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:01.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:01.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:02.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:02.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:02.448 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:42:02.448+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:42:03.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:03.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:04.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:04.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:05.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:05.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:06.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:06.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:07.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:07.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:07.449 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:42:07.449+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:42:08.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:08.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:09.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:09.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:10.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:10.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:11.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:11.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:12.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:12.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:12.450 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:42:12.450+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:42:13.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:13.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:14.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:14.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:15.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:15.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:16.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:16.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:17.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:17.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:17.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:42:17.451+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:42:18.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:18.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:19.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:19.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:20.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:20.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:21.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:21.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:22.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:22.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:22.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:42:22.452+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:42:23.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:23.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:24.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:24.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:25.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:25.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:26.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:26.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:27.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:27.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:27.454 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:42:27.454+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:42:28.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:28.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:29.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:29.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:30.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:30.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:31.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:31.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:32.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:32.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:32.454 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:42:32.454+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:42:33.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:33.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:34.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:34.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:35.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:35.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:36.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:36.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:37.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:37.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:37.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:42:37.456+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:42:38.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:38.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:39.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:39.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:40.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:40.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:41.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:41.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:42.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:42.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:42.457 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:42:42.457+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:42:43.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:43.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:44.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:44.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:45.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:45.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:46.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:46.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:47.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:47.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:47.457 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:42:47.458+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:42:48.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:48.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:49.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:49.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:50.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:50.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:51.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:51.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:52.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:52.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:52.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:42:52.459+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:42:53.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:53.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:54.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:54.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:55.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:55.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:56.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:56.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:57.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:57.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:57.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:42:57.460+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:42:58.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:58.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:42:59.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:42:59.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:00.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:00.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:01.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:01.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:02.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:02.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:02.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:43:02.461+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:43:03.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:03.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:04.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:04.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:05.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:05.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:06.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:06.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:07.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:07.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:07.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:43:07.461+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:43:08.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:08.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:09.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:09.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:10.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:10.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:11.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:11.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:12.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:12.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:12.462 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:43:12.462+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:43:13.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:13.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:14.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:14.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:15.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:15.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:16.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:16.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:17.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:17.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:17.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:43:17.464+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:43:18.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:18.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:19.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:19.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:20.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:20.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:21.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:21.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:22.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:22.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:22.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:43:22.465+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:43:23.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:23.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:24.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:24.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:25.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:25.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:26.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:26.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:27.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:27.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:27.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:43:27.464+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:43:28.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:28.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:29.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:29.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:30.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:30.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:31.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:31.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:32.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:32.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:32.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:43:32.465+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:43:33.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:33.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:34.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:34.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:35.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:35.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:36.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:36.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:37.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:37.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:37.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:43:37.466+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:43:38.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:38.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:39.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:39.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:40.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:40.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:41.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:41.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:42.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:42.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:42.467 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:43:42.467+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:43:43.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:43.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:44.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:44.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:45.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:45.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:46.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:46.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:47.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:47.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:47.468 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:43:47.468+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:43:48.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:48.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:49.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:49.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:50.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:50.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:51.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:51.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:52.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:52.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:52.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:43:52.469+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:43:53.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:53.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:54.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:54.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:55.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:55.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:56.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:56.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:57.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:57.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:57.470 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:43:57.470+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:43:58.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:58.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:43:59.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:43:59.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:00.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:00.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:01.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:01.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:02.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:02.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:02.471 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:44:02.471+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:44:03.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:03.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:04.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:04.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:05.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:05.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:06.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:06.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:07.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:07.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:07.472 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:44:07.472+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:44:08.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:08.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:09.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:09.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:10.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:10.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:10.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:10.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:11.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:11.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:12.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:44:12.473+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:44:12.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:12.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:13.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:13.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:14.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:14.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:15.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:15.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:16.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:16.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:17.474 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:44:17.474+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:44:17.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:17.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:18.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:18.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:19.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:19.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:20.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:20.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:21.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:21.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:22.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:44:22.476+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:44:22.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:22.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:23.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:23.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:24.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:24.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:25.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:25.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:27.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:27.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:27.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:44:27.476+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:44:28.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:28.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:29.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:29.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:30.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:30.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:31.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:31.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:32.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:32.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:32.477 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:44:32.477+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:44:33.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:33.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:34.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:34.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:35.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:35.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:36.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:36.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:37.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:37.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:37.478 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:44:37.478+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:44:38.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:38.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:39.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:39.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:40.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:40.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:41.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:41.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:42.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:42.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:42.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:44:42.479+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:44:43.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:43.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:44.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:44.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:45.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:45.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:46.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:46.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:47.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:47.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:47.480 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:44:47.480+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:44:48.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:48.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:49.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:49.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:50.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:50.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:51.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:51.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:52.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:52.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:52.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:44:52.482+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:44:53.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:53.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:54.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:54.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:55.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:55.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:56.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:56.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:57.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:57.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:57.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:44:57.482+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:44:58.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:58.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:44:59.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:44:59.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:00.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:00.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:01.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:01.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:02.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:02.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:02.483 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:45:02.483+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:45:03.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:03.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:04.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:04.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:05.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:05.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:06.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:06.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:07.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:07.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:07.484 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:45:07.484+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:45:08.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:08.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:09.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:09.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:10.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:10.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:11.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:11.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:12.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:12.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:12.485 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:45:12.485+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:45:13.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:13.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:14.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:14.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:15.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:15.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:16.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:16.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:17.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:17.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:17.486 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:45:17.486+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:45:18.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:18.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:19.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:19.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:20.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:20.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:21.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:21.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:22.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:22.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:22.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:45:22.487+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:45:23.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:23.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:24.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:24.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:25.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:25.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:26.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:26.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:27.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:27.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:27.488 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:45:27.488+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:45:28.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:28.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:29.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:29.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:30.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:30.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:31.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:31.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:32.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:32.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:32.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:45:32.489+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:45:33.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:33.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:34.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:34.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:35.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:35.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:36.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:36.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:37.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:37.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:37.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:45:37.491+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:45:38.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:38.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:39.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:39.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:40.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:40.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:41.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:41.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:42.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:42.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:42.491 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:45:42.491+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:45:43.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:43.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:44.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:44.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:45.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:45.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:46.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:46.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:47.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:47.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:47.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:45:47.492+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:45:48.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:48.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:49.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:49.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:50.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:50.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:51.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:51.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:52.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:52.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:52.493 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:45:52.493+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:45:53.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:53.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:54.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:54.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:55.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:55.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:56.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:56.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:57.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:57.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:57.494 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:45:57.494+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:45:58.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:58.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:45:59.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:45:59.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:00.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:00.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:01.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:01.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:02.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:02.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:02.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:46:02.495+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:46:03.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:03.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:04.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:04.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:05.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:05.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:06.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:06.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:07.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:07.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:07.496 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:46:07.496+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:46:08.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:08.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:09.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:09.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:10.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:10.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:11.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:11.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:12.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:12.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:12.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:46:12.498+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:46:13.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:13.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:14.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:14.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:15.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:15.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:16.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:16.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:17.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:17.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:17.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:46:17.499+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:46:18.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:18.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:19.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:19.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:20.162 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:20.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:21.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:21.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:22.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:22.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:22.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:46:22.500+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:46:23.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:23.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:24.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:24.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:25.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:25.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:26.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:26.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:27.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:27.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:27.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:46:27.500+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:46:28.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:28.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:29.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:29.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:30.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:30.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:31.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:31.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:32.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:32.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:32.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:46:32.501+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:46:33.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:33.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:34.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:34.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:35.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:35.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:36.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:36.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:37.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:37.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:37.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:46:37.502+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:46:38.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:38.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:39.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:39.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:40.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:40.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:41.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:41.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:42.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:42.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:42.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:46:42.503+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:46:43.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:43.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:44.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:44.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:45.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:45.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:46.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:46.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:47.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:47.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:47.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:46:47.503+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:46:48.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:48.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:49.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:49.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:50.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:50.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:51.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:51.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:52.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:52.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:52.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:46:52.504+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:46:53.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:53.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:54.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:54.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:55.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:55.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:56.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:56.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:57.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:57.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:57.505 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:46:57.505+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:46:58.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:58.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:46:59.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:46:59.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:00.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:00.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:01.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:01.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:02.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:02.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:02.506 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:47:02.506+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:47:03.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:03.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:04.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:04.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:05.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:05.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:06.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:06.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:07.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:07.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:07.506 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:47:07.507+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:47:08.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:08.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:09.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:09.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:10.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:10.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:11.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:11.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:12.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:12.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:12.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:47:12.508+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:47:13.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:13.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:14.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:14.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:15.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:15.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:16.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:16.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:17.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:17.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:17.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:47:17.509+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:47:18.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:18.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:19.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:19.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:20.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:20.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:21.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:21.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:22.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:22.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:22.511 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:47:22.511+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:47:23.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:23.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:24.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:24.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:25.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:25.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:26.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:26.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:27.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:27.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:27.512 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:47:27.512+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:47:28.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:28.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:29.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:29.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:30.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:30.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:31.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:31.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:32.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:32.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:32.513 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:47:32.513+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:47:33.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:33.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:34.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:34.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:35.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:35.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:36.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:36.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:37.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:37.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:37.513 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:47:37.513+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:47:38.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:38.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:39.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:39.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:40.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:40.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:41.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:41.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:42.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:42.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:42.514 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:47:42.514+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:47:43.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:43.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:44.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:44.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:45.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:45.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:46.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:46.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:47.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:47.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:47.515 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:47:47.515+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:47:48.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:48.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:49.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:49.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:50.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:50.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:51.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:51.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:52.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:52.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:52.516 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:47:52.516+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:47:53.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:53.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:54.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:54.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:55.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:55.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:56.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:56.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:57.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:57.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:57.517 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:47:57.517+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:47:58.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:58.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:47:59.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:47:59.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:00.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:00.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:01.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:01.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:02.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:02.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:02.518 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:48:02.518+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:48:03.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:03.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:04.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:04.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:05.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:05.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:06.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:06.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:07.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:07.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:07.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:48:07.519+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:48:08.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:08.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:09.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:09.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:10.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:10.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:11.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:11.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:12.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:12.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:12.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:48:12.521+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:48:13.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:13.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:14.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:14.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:15.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:15.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:16.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:16.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:17.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:17.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:17.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:48:17.521+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:48:18.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:18.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:19.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:19.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:20.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:20.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:21.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:21.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:22.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:22.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:22.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:48:22.523+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:48:23.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:23.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:24.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:24.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:25.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:25.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:26.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:26.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:27.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:27.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:27.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:48:27.523+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:48:28.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:28.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:29.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:29.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:30.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:30.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:31.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:31.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:32.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:32.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:32.524 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:48:32.524+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:48:33.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:33.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:34.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:34.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:35.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:35.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:36.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:36.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:37.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:37.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:37.525 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:48:37.525+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:48:38.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:38.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:39.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:39.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:40.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:40.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:41.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:41.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:42.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:42.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:42.526 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:48:42.526+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:48:43.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:43.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:44.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:44.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:45.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:45.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:46.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:46.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:47.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:47.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:47.527 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:48:47.527+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:48:48.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:48.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:49.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:49.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:50.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:50.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:51.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:51.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:52.528 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:48:52.528+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:48:52.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:52.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:53.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:53.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:54.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:54.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:55.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:55.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:56.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:56.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:57.529 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:48:57.529+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:48:57.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:57.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:58.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:58.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:48:59.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:48:59.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:00.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:00.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:01.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:01.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:02.530 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:49:02.530+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:49:02.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:02.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:03.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:03.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:04.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:04.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:05.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:05.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:06.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:06.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:07.531 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:49:07.531+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:49:07.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:07.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:08.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:08.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:09.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:09.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:10.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:10.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:11.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:11.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:12.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:49:12.532+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:49:12.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:12.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:13.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:13.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:14.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:14.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:15.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:15.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:16.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:16.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:17.533 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:49:17.534+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:49:17.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:17.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:18.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:18.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:19.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:19.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:20.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:20.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:21.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:21.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:22.534 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:49:22.535+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:49:22.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:22.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:23.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:23.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:24.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:24.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:25.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:25.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:26.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:26.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:27.534 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:49:27.534+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:49:27.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:27.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:28.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:28.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:29.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:29.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:30.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:30.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:31.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:31.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:32.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:32.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:32.535 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:49:32.535+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:49:33.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:33.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:34.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:34.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:35.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:35.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:36.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:36.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:37.464 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:37.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:37.536 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:49:37.536+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:49:38.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:38.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:39.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:39.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:40.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:40.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:41.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:41.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:42.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:42.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:42.537 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:49:42.537+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:49:43.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:43.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:44.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:44.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:45.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:45.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:46.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:46.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:47.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:47.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:47.538 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:49:47.538+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:49:48.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:48.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:49.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:49.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:50.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:50.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:51.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:51.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:52.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:52.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:52.538 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:49:52.538+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:49:53.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:53.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:54.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:54.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:55.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:55.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:56.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:56.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:57.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:57.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:57.539 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:49:57.540+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:49:58.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:58.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:49:59.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:49:59.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:00.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:00.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:01.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:01.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:02.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:02.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:02.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:50:02.541+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:50:03.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:03.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:04.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:04.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:05.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:05.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:06.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:06.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:07.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:07.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:07.542 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:50:07.542+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:50:08.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:08.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:09.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:09.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:10.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:10.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:11.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:11.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:12.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:12.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:12.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:50:12.543+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:50:13.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:13.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:14.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:14.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:15.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:15.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:16.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:16.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:17.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:17.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:17.544 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:50:17.544+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:50:18.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:18.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:19.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:19.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:20.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:20.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:21.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:21.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:22.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:22.146+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:22.545 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:50:22.545+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:50:23.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:23.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:24.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:24.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:25.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:25.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:26.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:26.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:27.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:27.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:27.546 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:50:27.546+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:50:28.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:28.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:29.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:29.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:30.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:30.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:31.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:31.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:32.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:32.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:32.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:50:32.547+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:50:33.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:33.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:34.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:34.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:35.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:35.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:36.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:36.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:37.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:37.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:37.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:50:37.548+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:50:38.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:38.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:39.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:39.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:40.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:40.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:41.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:41.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:42.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:42.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:42.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:50:42.549+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:50:43.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:43.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:44.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:44.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:45.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:45.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:46.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:46.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:47.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:47.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:47.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:50:47.550+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:50:48.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:48.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:49.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:49.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:50.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:50.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:51.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:51.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:52.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:52.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:52.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:50:52.551+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:50:53.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:53.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:54.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:54.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:55.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:55.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:56.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:56.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:57.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:57.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:57.552 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:50:57.553+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:50:58.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:58.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:50:59.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:50:59.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:00.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:00.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:01.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:01.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:02.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:02.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:02.553 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:51:02.553+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:51:03.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:03.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:04.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:04.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:05.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:05.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:06.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:06.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:07.092 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:07.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:07.554 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:51:07.554+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:51:08.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:08.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:09.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:09.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:10.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:10.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:11.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:11.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:12.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:12.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:12.555 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:51:12.555+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:51:13.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:13.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:14.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:14.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:15.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:15.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:16.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:16.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:17.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:17.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:17.556 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:51:17.556+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:51:18.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:18.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:19.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:19.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:20.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:20.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:21.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:21.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:22.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:22.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:22.557 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:51:22.557+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:51:23.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:23.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:24.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:24.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:25.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:25.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:26.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:26.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:27.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:27.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:27.558 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:51:27.558+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:51:28.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:28.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:29.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:29.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:30.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:30.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:31.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:31.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:32.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:32.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:32.560 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:51:32.560+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:51:33.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:33.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:34.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:34.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:35.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:35.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:36.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:36.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:37.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:37.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:37.560 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:51:37.560+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:51:38.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:38.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:39.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:39.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:40.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:40.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:41.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:41.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:42.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:42.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:42.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:51:42.561+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:51:43.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:43.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:44.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:44.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:45.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:45.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:46.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:46.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:47.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:47.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:47.562 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:51:47.562+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:51:48.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:48.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:49.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:49.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:50.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:50.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:51.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:51.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:52.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:52.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:52.564 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:51:52.563+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:51:53.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:53.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:54.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:54.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:55.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:55.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:56.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:56.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:57.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:57.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:57.564 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:51:57.564+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:51:58.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:58.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:51:59.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:51:59.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:00.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:00.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:01.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:01.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:02.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:02.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:02.565 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:52:02.565+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:52:03.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:03.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:03.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:03.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:04.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:04.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:05.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:05.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:07.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:07.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:07.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:52:07.566+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:52:08.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:08.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:09.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:09.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:09.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:09.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:10.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:10.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:12.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:12.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:12.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:52:12.567+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:52:12.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:12.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:14.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:14.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:15.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:15.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:15.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:15.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:16.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:16.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:17.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:52:17.568+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:52:17.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:17.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:18.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:18.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:19.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:19.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:20.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:20.943+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:21.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:21.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:22.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:52:22.570+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:52:23.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:23.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:23.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:23.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:25.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:25.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:25.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:25.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:26.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:26.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:27.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:27.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:28.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:28.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:29.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:29.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:30.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:30.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:31.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:31.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:32.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:52:32.570+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:52:32.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:32.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:33.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:33.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:34.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:34.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:35.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:35.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:36.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:36.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:37.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:52:37.572+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:52:37.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:37.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:38.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:38.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:39.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:39.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:40.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:40.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:41.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:41.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:42.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:52:42.572+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:52:42.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:42.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:43.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:43.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:44.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:44.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:45.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:45.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:46.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:46.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:47.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:52:47.574+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:52:47.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:47.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:48.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:48.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:49.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:49.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:50.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:50.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:51.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:51.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:52.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:52:52.574+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:52:52.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:52.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:53.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:53.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:54.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:54.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:55.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:55.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:56.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:56.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:57.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:52:57.575+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:52:57.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:57.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:58.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:58.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:52:59.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:52:59.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:00.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:00.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:01.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:01.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:02.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:53:02.577+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:53:02.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:02.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:03.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:03.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:04.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:04.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:05.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:05.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:06.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:06.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:07.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:53:07.578+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:53:07.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:07.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:08.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:08.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:09.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:09.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:10.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:10.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:11.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:11.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:12.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:53:12.579+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:53:12.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:12.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:13.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:13.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:14.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:14.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:15.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:15.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:16.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:16.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:17.580 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:53:17.580+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:53:17.901 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:17.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:18.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:18.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:19.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:19.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:20.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:20.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:21.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:21.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:22.580 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:53:22.580+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:53:22.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:22.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:23.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:23.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:24.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:24.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:25.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:25.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:26.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:26.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:27.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:53:27.581+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:53:27.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:27.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:28.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:28.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:29.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:29.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:30.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:30.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:31.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:31.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:32.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:53:32.582+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:53:32.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:32.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:33.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:33.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:34.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:34.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:35.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:35.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:36.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:36.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:37.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:53:37.583+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:53:37.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:37.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:38.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:38.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:39.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:39.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:40.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:40.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:41.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:41.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:42.584 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:53:42.584+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:53:42.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:42.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:43.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:43.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:44.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:44.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:45.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:45.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:46.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:46.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:47.585 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:53:47.585+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:53:47.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:47.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:48.918 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:48.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:49.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:49.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:50.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:50.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:51.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:51.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:52.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:53:52.586+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:53:52.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:52.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:53.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:53.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:54.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:54.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:55.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:55.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:56.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:56.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:57.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:57.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:58.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:58.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:53:59.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:53:59.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:00.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:00.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:01.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:01.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:02.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:54:02.589+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:54:02.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:02.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:03.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:03.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:04.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:04.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:05.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:05.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:06.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:06.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:07.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:54:07.590+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:54:07.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:07.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:08.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:08.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:09.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:09.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:10.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:10.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:11.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:11.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:12.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:54:12.590+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:54:12.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:12.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:13.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:13.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:14.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:14.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:15.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:15.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:16.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:16.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:17.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:54:17.591+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:54:17.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:17.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:18.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:18.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:19.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:19.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:20.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:20.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:21.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:21.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:22.593 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:54:22.592+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:54:22.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:22.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:23.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:23.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:24.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:24.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:25.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:25.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:26.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:26.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:27.593 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:54:27.593+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:54:27.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:27.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:28.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:28.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:29.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:29.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:30.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:30.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:31.888 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:31.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:32.594 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:54:32.594+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:54:32.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:32.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:33.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:33.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:34.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:34.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:35.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:35.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:36.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:36.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:37.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:54:37.595+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:54:37.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:37.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:38.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:38.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:39.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:39.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:41.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:41.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:41.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:41.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:42.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:54:42.596+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:54:43.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:43.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:43.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:43.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:44.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:44.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:45.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:45.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:46.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:46.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:47.597 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:54:47.597+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:54:47.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:47.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:48.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:48.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:49.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:49.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:50.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:50.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:51.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:51.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:52.598 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:54:52.598+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:54:52.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:52.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:53.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:53.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:54.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:54.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:55.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:55.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:56.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:56.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:57.599 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:54:57.599+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:54:57.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:57.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:58.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:58.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:54:59.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:54:59.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:00.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:00.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:01.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:01.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:02.600 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:55:02.600+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:55:02.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:02.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:03.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:03.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:04.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:04.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:05.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:05.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:06.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:06.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:07.601 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:55:07.601+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:55:07.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:07.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:08.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:08.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:09.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:09.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:10.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:10.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:11.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:11.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:12.601 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:55:12.601+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:55:12.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:12.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:13.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:13.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:14.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:14.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:15.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:15.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:16.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:16.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:17.603 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:55:17.603+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:55:17.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:17.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:18.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:18.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:19.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:19.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:20.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:20.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:21.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:21.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:22.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:22.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:22.603 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:55:22.605+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:55:23.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:23.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:24.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:24.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:25.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:25.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:26.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:26.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:27.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:27.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:27.604 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:55:27.605+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:55:28.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:28.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:29.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:29.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:30.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:30.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:31.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:31.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:32.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:32.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:32.605 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:55:32.605+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:55:33.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:33.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:34.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:34.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:35.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:35.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:36.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:36.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:37.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:37.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:37.605 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:55:37.606+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:55:38.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:38.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:39.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:39.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:40.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:40.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:41.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:41.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:42.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:42.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:42.607 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:55:42.607+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:55:43.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:43.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:44.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:44.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:45.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:45.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:46.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:46.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:47.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:47.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:47.608 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:55:47.609+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:55:48.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:48.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:49.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:49.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:50.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:50.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:51.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:51.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:52.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:52.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:52.610 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:55:52.610+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:55:53.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:53.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:54.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:54.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:55.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:55.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:56.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:56.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:57.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:57.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:57.611 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:55:57.611+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:55:58.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:58.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:55:59.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:55:59.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:00.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:00.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:01.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:01.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:02.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:02.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:02.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:56:02.612+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:56:03.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:03.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:04.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:04.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:05.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:05.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:06.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:06.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:07.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:07.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:07.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:56:07.612+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:56:08.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:08.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:09.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:09.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:10.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:10.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:11.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:11.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:12.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:12.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:12.613 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:56:12.613+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:56:13.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:13.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:14.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:14.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:15.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:15.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:16.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:16.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:17.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:17.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:17.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:56:17.615+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:56:18.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:18.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:19.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:19.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:20.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:20.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:21.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:21.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:22.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:22.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:22.615 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:56:22.615+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:56:23.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:23.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:24.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:24.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:25.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:25.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:26.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:26.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:27.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:27.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:27.616 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:56:27.616+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:56:28.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:28.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:29.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:29.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:30.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:30.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:31.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:31.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:32.617 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:56:32.617+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:56:32.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:32.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:33.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:33.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:34.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:34.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:35.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:35.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:36.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:36.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:37.618 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:56:37.618+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:56:37.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:37.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:38.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:38.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:39.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:39.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:40.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:40.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:41.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:41.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:42.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:42.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:42.619 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:56:42.619+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:56:43.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:43.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:44.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:44.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:45.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:45.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:46.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:46.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:47.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:47.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:47.620 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:56:47.620+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:56:48.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:48.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:49.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:49.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:50.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:50.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:51.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:51.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:52.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:52.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:52.622 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:56:52.622+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:56:53.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:53.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:54.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:54.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:55.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:55.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:56.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:56.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:57.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:57.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:57.622 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:56:57.622+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:56:58.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:58.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:56:59.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:56:59.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:00.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:00.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:01.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:01.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:02.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:02.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:02.623 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:57:02.624+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:57:03.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:03.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:04.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:04.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:05.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:05.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:06.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:06.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:07.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:07.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:07.624 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:57:07.625+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:57:08.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:08.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:09.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:09.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:10.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:10.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:11.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:11.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:12.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:12.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:12.625 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:57:12.626+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:57:13.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:13.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:14.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:14.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:15.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:15.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:16.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:16.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:17.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:17.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:18.447 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:57:18.447+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:57:18.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:18.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:19.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:19.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:20.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:20.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:21.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:21.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:22.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:22.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:23.448 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:57:23.448+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:57:23.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:23.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:24.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:24.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:25.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:25.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:26.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:26.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:27.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:27.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:28.449 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:57:28.449+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:57:28.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:28.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:29.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:29.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:30.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:30.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:31.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:31.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:32.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:32.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:33.450 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:57:33.450+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:57:33.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:33.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:34.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:34.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:35.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:35.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:36.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:36.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:37.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:37.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:38.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:57:38.452+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:57:38.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:38.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:39.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:39.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:40.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:40.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:41.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:41.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:42.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:42.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:43.453 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:57:43.453+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:57:43.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:43.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:44.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:44.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:45.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:45.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:46.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:46.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:47.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:47.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:48.454 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:57:48.454+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:57:48.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:48.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:49.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:49.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:50.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:50.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:51.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:51.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:52.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:52.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:53.455 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:57:53.455+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:57:53.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:53.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:54.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:54.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:55.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:55.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:56.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:56.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:57.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:57.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:58.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:57:58.456+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:57:58.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:58.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:57:59.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:57:59.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:00.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:00.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:01.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:01.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:02.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:02.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:03.457 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:58:03.457+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:58:03.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:03.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:04.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:04.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:05.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:05.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:06.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:06.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:07.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:07.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:08.458 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:58:08.458+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:58:08.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:08.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:09.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:09.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:10.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:10.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:11.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:11.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:12.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:12.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:13.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:58:13.459+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:58:13.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:13.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:14.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:14.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:15.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:15.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:16.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:16.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:17.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:17.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:18.460 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:58:18.461+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:58:18.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:18.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:19.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:19.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:20.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:20.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:21.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:21.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:22.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:22.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:23.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:58:23.462+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:58:23.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:23.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:24.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:24.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:25.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:25.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:26.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:26.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:27.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:27.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:28.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:58:28.464+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:58:28.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:28.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:29.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:29.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:30.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:30.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:31.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:31.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:32.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:32.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:33.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:58:33.465+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:58:33.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:33.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:34.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:34.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:35.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:35.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:36.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:36.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:37.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:37.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:38.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:58:38.466+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:58:38.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:38.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:39.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:39.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:40.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:40.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:41.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:41.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:42.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:42.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:43.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:43.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:44.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:44.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:45.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:45.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:46.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:46.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:47.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:47.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:48.454 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:58:48.455+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:58:48.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:48.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:49.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:49.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:50.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:50.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:51.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:51.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:52.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:52.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:53.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:58:53.456+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:58:53.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:53.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:54.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:54.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:55.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:55.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:56.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:56.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:57.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:57.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:58.457 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:58:58.457+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:58:58.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:58.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:58:59.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:58:59.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:00.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:00.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:01.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:01.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:02.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:02.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:03.458 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:59:03.458+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:59:03.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:03.889+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:04.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:04.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:05.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:05.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:06.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:06.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:07.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:07.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:08.460 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:59:08.460+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:59:08.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:08.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:09.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:09.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:11.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:11.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:12.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:12.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:13.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:13.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:13.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:59:13.461+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:59:14.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:14.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:15.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:15.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:16.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:16.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:17.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:17.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:18.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:18.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:18.462 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:59:18.462+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:59:19.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:19.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:20.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:20.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:21.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:21.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:22.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:22.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:23.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:23.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:23.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:59:23.463+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:59:23.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:23.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:25.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:25.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:26.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:26.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:26.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:26.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:28.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:28.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:28.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:59:28.464+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:59:29.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:29.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:30.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:30.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:30.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:30.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:31.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:31.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:32.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:32.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:33.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:59:33.465+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:59:33.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:33.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:34.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:34.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:35.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:35.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:36.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:36.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:37.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:37.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:38.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:59:38.467+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:59:38.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:38.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:39.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:39.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:40.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:40.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:41.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:41.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:42.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:42.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:43.468 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:59:43.468+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:59:43.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:43.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:44.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:44.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:45.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:45.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:46.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:46.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:47.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:47.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:48.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:59:48.469+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:59:48.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:48.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:49.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:49.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:50.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:50.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:51.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:51.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:52.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:52.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:53.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:53.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:54.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:54.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:55.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:55.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:56.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:56.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:57.657 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T13:59:57.658+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T13:59:57.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:57.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:58.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:58.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T13:59:59.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T13:59:59.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:00.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:00.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:01.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:01.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:02.658 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:00:02.658+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:00:02.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:02.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:03.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:03.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:04.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:04.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:05.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:05.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:06.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:06.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:07.659 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:00:07.659+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:00:07.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:07.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:08.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:08.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:09.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:09.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:10.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:10.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:11.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:11.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:12.659 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:00:12.660+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:00:12.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:12.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:13.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:13.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:14.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:14.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:15.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:15.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:16.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:16.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:17.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:17.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:17.660 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:00:17.661+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:00:18.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:18.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:19.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:19.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:20.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:20.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:21.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:21.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:22.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:22.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:22.661 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:00:22.662+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:00:23.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:23.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:24.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:24.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:25.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:25.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:26.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:26.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:27.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:27.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:27.662 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:00:27.663+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:00:28.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:28.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:29.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:29.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:30.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:30.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:31.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:31.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:32.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:32.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:32.663 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:00:32.663+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:00:33.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:33.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:34.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:34.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:35.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:35.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:36.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:36.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:37.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:37.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:37.664 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:00:37.664+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:00:38.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:38.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:39.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:39.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:40.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:40.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:41.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:41.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:42.665 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:00:42.665+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:00:42.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:42.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:43.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:43.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:44.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:44.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:45.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:45.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:46.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:46.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:47.667 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:00:47.667+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:00:47.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:47.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:48.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:48.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:49.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:49.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:50.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:50.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:51.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:51.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:52.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:52.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:52.668 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:00:52.668+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:00:53.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:53.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:54.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:54.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:55.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:55.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:56.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:56.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:57.670 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:00:57.669+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:00:57.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:57.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:58.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:58.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:00:59.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:00:59.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:00.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:00.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:01.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:01.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:02.670 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:01:02.670+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:01:02.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:02.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:03.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:03.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:04.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:04.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:05.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:05.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:06.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:06.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:07.671 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:01:07.671+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:01:07.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:07.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:08.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:08.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:09.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:09.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:10.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:10.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:11.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:11.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:12.672 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:01:12.672+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:01:12.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:12.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:13.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:13.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:14.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:14.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:15.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:15.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:16.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:16.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:17.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:01:17.673+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:01:17.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:17.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:18.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:18.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:19.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:19.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:20.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:20.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:21.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:21.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:22.674 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:01:22.674+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:01:22.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:22.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:23.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:23.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:24.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:24.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:25.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:25.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:26.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:26.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:27.675 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:01:27.676+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:01:27.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:27.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:28.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:28.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:29.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:29.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:30.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:30.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:31.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:31.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:32.676 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:01:32.677+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:01:32.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:32.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:33.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:33.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:34.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:34.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:35.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:35.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:36.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:36.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:37.676 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:01:37.676+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:01:37.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:37.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:38.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:38.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:39.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:39.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:40.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:40.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:41.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:41.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:42.677 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:01:42.677+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:01:42.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:42.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:43.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:43.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:44.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:44.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:45.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:45.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:46.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:46.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:47.678 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:01:47.678+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:01:47.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:47.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:48.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:48.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:49.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:49.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:50.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:50.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:51.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:51.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:52.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:52.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:52.679 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:01:52.680+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:01:53.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:53.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:54.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:54.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:55.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:55.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:56.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:56.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:57.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:57.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:57.680 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:01:57.680+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:01:58.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:58.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:01:59.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:01:59.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:00.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:00.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:01.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:01.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:02.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:02.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:02.681 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:02:02.681+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:02:03.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:03.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:04.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:04.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:05.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:05.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:06.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:06.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:07.682 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:02:07.682+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:02:07.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:07.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:08.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:08.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:09.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:09.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:10.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:10.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:11.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:11.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:12.683 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:02:12.683+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:02:12.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:12.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:13.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:13.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:14.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:14.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:15.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:15.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:16.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:16.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:17.684 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:02:17.684+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:02:17.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:17.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:18.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:18.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:19.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:19.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:20.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:20.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:21.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:21.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:22.685 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:02:22.686+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:02:22.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:22.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:23.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:23.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:24.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:24.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:25.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:25.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:27.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:27.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:27.686 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:02:27.686+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:02:27.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:27.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:28.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:28.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:29.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:29.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:30.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:30.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:31.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:31.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:32.687 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:02:32.687+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:02:32.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:32.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:33.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:33.911+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:34.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:34.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:35.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:35.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:36.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:36.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:37.688 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:02:37.688+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:02:37.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:37.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:38.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:38.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:39.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:39.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:40.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:40.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:41.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:41.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:42.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:02:42.689+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:02:42.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:42.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:43.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:43.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:44.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:44.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:45.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:45.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:46.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:46.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:47.690 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:02:47.690+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:02:47.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:47.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:48.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:48.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:49.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:49.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:50.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:50.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:51.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:51.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:52.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:52.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:52.691 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:02:52.692+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:02:53.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:53.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:54.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:54.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:55.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:55.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:56.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:56.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:57.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:57.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:57.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:02:57.692+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:02:58.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:58.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:02:59.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:02:59.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:00.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:00.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:01.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:01.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:02.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:02.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:02.693 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:03:02.693+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:03:03.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:03.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:04.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:04.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:05.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:05.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:06.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:06.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:07.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:07.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:07.694 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:03:07.694+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:03:08.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:08.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:09.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:09.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:10.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:10.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:11.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:11.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:12.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:12.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:12.695 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:03:12.695+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:03:13.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:13.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:14.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:14.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:15.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:15.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:16.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:16.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:17.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:17.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:17.696 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:03:17.696+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:03:18.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:18.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:19.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:19.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:20.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:20.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:21.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:21.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:22.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:22.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:22.697 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:03:22.697+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:03:23.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:23.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:24.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:24.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:25.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:25.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:26.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:26.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:27.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:27.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:27.698 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:03:27.698+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:03:28.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:28.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:29.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:29.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:30.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:30.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:31.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:31.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:32.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:32.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:32.699 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:03:32.699+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:03:33.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:33.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:34.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:34.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:35.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:35.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:36.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:36.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:37.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:37.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:37.700 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:03:37.700+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:03:38.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:38.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:39.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:39.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:40.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:40.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:41.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:41.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:42.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:42.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:42.701 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:03:42.701+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:03:43.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:43.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:44.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:44.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:45.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:45.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:46.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:46.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:47.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:47.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:47.702 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:03:47.702+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:03:48.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:48.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:49.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:49.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:50.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:50.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:51.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:51.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:52.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:52.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:52.703 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:03:52.703+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:03:53.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:53.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:54.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:54.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:55.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:55.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:56.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:56.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:57.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:57.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:57.703 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:03:57.704+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:03:58.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:58.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:03:59.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:03:59.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:00.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:00.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:01.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:01.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:02.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:02.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:02.704 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:04:02.705+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:04:03.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:03.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:04.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:04.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:05.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:05.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:06.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:06.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:07.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:07.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:07.705 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:04:07.706+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:04:08.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:08.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:09.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:09.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:10.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:10.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:11.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:11.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:12.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:12.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:12.706 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:04:12.707+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:04:13.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:13.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:14.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:14.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:15.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:15.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:16.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:16.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:17.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:17.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:17.708 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:04:17.708+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:04:18.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:18.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:19.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:19.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:20.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:20.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:21.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:21.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:22.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:22.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:22.709 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:04:22.709+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:04:23.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:23.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:24.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:24.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:25.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:25.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:26.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:26.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:27.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:27.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:27.710 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:04:27.710+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:04:28.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:28.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:29.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:29.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:30.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:30.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:31.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:31.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:32.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:32.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:32.711 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:04:32.712+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:04:33.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:33.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:34.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:34.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:35.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:35.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:36.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:36.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:37.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:37.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:37.712 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:04:37.713+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:04:38.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:38.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:39.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:39.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:40.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:40.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:41.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:41.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:42.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:42.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:42.712 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:04:42.712+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:04:43.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:43.482+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:44.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:44.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:45.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:45.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:46.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:46.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:47.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:47.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:47.713 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:04:47.713+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:04:48.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:48.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:49.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:49.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:50.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:50.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:51.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:51.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:52.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:52.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:52.714 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:04:52.714+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:04:53.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:53.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:54.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:54.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:55.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:55.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:56.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:56.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:57.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:57.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:57.715 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:04:57.715+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:04:58.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:58.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:04:59.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:04:59.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:00.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:00.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:01.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:01.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:02.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:02.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:02.716 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:05:02.716+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:05:03.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:03.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:04.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:04.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:05.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:05.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:06.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:06.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:07.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:07.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:07.717 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:05:07.717+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:05:08.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:08.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:09.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:09.067+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:10.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:10.044+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:11.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:11.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:12.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:12.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:12.719 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:05:12.719+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:05:12.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:12.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:13.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:13.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:14.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:14.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:15.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:15.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:16.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:16.950+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:17.719 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:05:17.720+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:05:17.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:17.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:18.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:18.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:19.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:19.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:20.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:20.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:21.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:21.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:22.720 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:05:22.721+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:05:22.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:22.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:23.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:23.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:24.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:24.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:25.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:25.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:26.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:26.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:27.721 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:05:27.721+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:05:27.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:27.887+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:28.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:28.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:29.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:29.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:30.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:30.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:31.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:31.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:32.722 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:05:32.722+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:05:32.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:32.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:33.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:33.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:34.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:34.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:35.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:35.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:36.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:36.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:37.723 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:05:37.723+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:05:37.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:37.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:38.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:38.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:39.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:39.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:40.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:40.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:41.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:41.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:42.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:42.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:42.724 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:05:42.724+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:05:43.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:43.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:44.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:44.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:45.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:45.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:46.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:46.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:47.725 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:05:47.725+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:05:47.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:47.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:48.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:48.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:49.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:49.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:50.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:50.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:51.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:51.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:52.726 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:05:52.726+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:05:52.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:52.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:53.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:53.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:54.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:54.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:55.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:55.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:56.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:56.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:57.727 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:05:57.727+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:05:57.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:57.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:58.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:58.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:05:59.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:05:59.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:00.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:00.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:01.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:01.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:02.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:02.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:02.727 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:06:02.728+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:06:03.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:03.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:04.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:04.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:05.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:05.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:06.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:06.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:07.729 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:06:07.729+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:06:07.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:07.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:08.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:08.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:09.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:09.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:10.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:10.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:11.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:11.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:12.730 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:06:12.730+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:06:12.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:12.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:13.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:13.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:14.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:14.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:15.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:15.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:16.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:16.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:17.731 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:06:17.731+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:06:17.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:17.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:18.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:18.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:19.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:19.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:20.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:20.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:21.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:21.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:22.732 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:06:22.732+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:06:22.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:22.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:23.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:23.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:24.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:24.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:25.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:25.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:26.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:26.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:27.733 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:06:27.733+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:06:27.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:27.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:28.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:28.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:29.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:29.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:30.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:30.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:31.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:31.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:32.734 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:06:32.734+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:06:32.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:32.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:33.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:33.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:34.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:34.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:35.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:35.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:36.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:36.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:37.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:06:37.735+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:06:37.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:37.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:38.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:38.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:39.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:39.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:40.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:40.905+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:41.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:41.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:42.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:06:42.736+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:06:42.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:42.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:43.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:43.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:44.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:44.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:45.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:45.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:46.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:46.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:47.737 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:06:47.737+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:06:47.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:47.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:49.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:49.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:50.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:50.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:51.028 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:51.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:52.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:52.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:52.738 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:06:52.738+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:06:53.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:53.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:54.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:54.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:55.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:55.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:56.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:56.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:57.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:57.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:57.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:06:57.739+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:06:58.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:58.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:06:59.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:06:59.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:00.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:00.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:01.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:01.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:02.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:02.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:02.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:07:02.740+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:07:03.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:03.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:04.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:04.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:05.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:05.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:06.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:06.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:07.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:07.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:07.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:07:07.741+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:07:08.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:08.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:09.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:09.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:10.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:10.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:10.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:10.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:12.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:12.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:12.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:07:12.742+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:07:13.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:13.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:13.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:13.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:14.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:14.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:15.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:15.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:17.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:17.010+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:17.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:07:17.743+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:07:18.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:18.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:19.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:19.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:20.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:20.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:21.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:21.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:22.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:22.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:22.744 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:07:22.744+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:07:23.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:23.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:24.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:24.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:25.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:25.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:26.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:26.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:27.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:27.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:27.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:07:27.745+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:07:28.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:28.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:29.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:29.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:30.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:30.157+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:31.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:31.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:32.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:32.168+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:32.746 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:07:32.746+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:07:33.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:33.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:34.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:34.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:35.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:35.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:36.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:36.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:37.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:37.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:37.747 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:07:37.748+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:07:38.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:38.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:39.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:39.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:40.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:40.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:41.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:41.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:42.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:42.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:42.747 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:07:42.749+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:07:43.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:43.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:44.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:44.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:45.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:45.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:46.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:46.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:47.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:47.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:47.748 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:07:47.748+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:07:48.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:48.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:49.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:49.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:50.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:50.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:51.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:51.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:52.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:52.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:52.749 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:07:52.749+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:07:53.143 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:53.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:54.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:54.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:55.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:55.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:56.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:56.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:57.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:57.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:57.750 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:07:57.750+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:07:58.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:58.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:07:59.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:07:59.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:00.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:00.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:01.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:01.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:02.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:02.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:02.751 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:08:02.752+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:08:03.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:03.135+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:04.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:04.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:05.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:05.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:06.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:06.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:07.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:07.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:07.752 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:08:07.752+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:08:08.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:08.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:09.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:09.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:10.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:10.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:11.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:11.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:12.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:12.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:12.753 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:08:12.753+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:08:13.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:13.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:14.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:14.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:15.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:15.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:15.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:15.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:16.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:16.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:17.754 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:08:17.755+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:08:17.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:17.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:18.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:18.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:19.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:19.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:20.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:20.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:21.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:21.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:22.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:22.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:22.755 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:08:22.756+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:08:23.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:23.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:24.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:24.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:25.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:25.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:26.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:26.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:27.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:27.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:27.756 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:08:27.757+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:08:28.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:28.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:29.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:29.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:30.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:30.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:31.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:31.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:32.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:32.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:32.757 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:08:32.757+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:08:33.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:33.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:34.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:34.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:35.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:35.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:36.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:36.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:37.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:37.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:37.758 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:08:37.758+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:08:38.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:38.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:39.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:39.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:40.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:40.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:41.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:41.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:42.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:42.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:42.759 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:08:42.759+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:08:43.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:43.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:44.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:44.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:45.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:45.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:46.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:46.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:47.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:47.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:47.760 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:08:47.760+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:08:48.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:48.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:49.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:49.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:50.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:50.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:51.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:51.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:52.761 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:08:52.761+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:08:52.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:52.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:53.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:53.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:54.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:54.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:55.709 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:55.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:56.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:56.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:57.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:57.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:57.762 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:08:57.762+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:08:58.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:58.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:08:59.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:08:59.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:00.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:00.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:01.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:01.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:02.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:02.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:02.763 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:09:02.763+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:09:03.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:03.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:04.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:04.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:05.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:05.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:06.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:06.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:07.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:07.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:07.764 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:09:07.764+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:09:08.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:08.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:09.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:09.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:10.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:10.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:11.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:11.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:12.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:12.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:12.765 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:09:12.765+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:09:13.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:13.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:14.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:14.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:15.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:15.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:16.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:16.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:17.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:17.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:17.766 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:09:17.766+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:09:18.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:18.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:19.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:19.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:20.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:20.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:21.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:21.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:22.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:22.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:22.766 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:09:22.767+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:09:23.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:23.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:24.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:24.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:25.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:25.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:26.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:26.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:27.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:27.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:27.767 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:09:27.767+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:09:28.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:28.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:29.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:29.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:30.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:30.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:31.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:31.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:32.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:32.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:32.768 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:09:32.768+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:09:33.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:33.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:34.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:34.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:35.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:35.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:36.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:36.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:37.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:37.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:37.770 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:09:37.770+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:09:38.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:38.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:39.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:39.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:40.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:40.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:41.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:41.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:42.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:42.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:42.770 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:09:42.771+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:09:43.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:43.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:44.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:44.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:45.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:45.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:46.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:46.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:47.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:47.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:47.771 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:09:47.772+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:09:48.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:48.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:49.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:49.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:50.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:50.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:51.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:51.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:52.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:52.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:52.772 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:09:52.772+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:09:53.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:53.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:54.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:54.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:55.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:55.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:56.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:56.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:57.773 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:09:57.774+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:09:57.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:57.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:58.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:58.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:09:59.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:09:59.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:00.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:00.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:01.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:01.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:02.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:02.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:02.775 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:10:02.775+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:10:03.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:03.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:04.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:04.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:05.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:05.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:06.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:06.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:07.776 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:10:07.776+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:10:07.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:07.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:08.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:08.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:09.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:09.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:10.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:10.919+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:11.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:11.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:12.777 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:10:12.777+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:10:12.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:12.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:13.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:13.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:14.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:14.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:15.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:15.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:16.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:16.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:17.778 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:10:17.778+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:10:17.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:17.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:18.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:18.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:19.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:19.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:20.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:20.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:21.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:21.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:22.779 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:10:22.779+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:10:22.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:22.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:23.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:23.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:24.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:24.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:25.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:25.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:26.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:26.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:27.780 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:10:27.781+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:10:27.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:27.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:28.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:28.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:29.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:29.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:30.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:30.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:31.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:31.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:32.781 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:10:32.782+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:10:33.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:33.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:34.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:34.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:35.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:35.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:36.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:36.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:37.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:37.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:37.782 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:10:37.784+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:10:38.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:38.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:39.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:39.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:40.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:40.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:40.965 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:40.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:41.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:41.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:42.783 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:10:42.784+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:10:43.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:43.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:44.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:44.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:45.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:45.083+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:46.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:46.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:47.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:47.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:47.784 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:10:47.785+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:10:48.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:48.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:49.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:49.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:50.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:50.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:51.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:51.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:52.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:52.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:52.785 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:10:52.785+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:10:53.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:53.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:54.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:54.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:55.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:55.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:56.066 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:56.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:57.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:57.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:57.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:10:57.786+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:10:58.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:58.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:10:59.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:10:59.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:00.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:00.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:01.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:01.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:02.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:02.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:02.787 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:11:02.788+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:11:03.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:03.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:03.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:03.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:05.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:05.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:06.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:06.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:06.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:06.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:07.788 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:11:07.789+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:11:07.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:07.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:08.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:08.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:10.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:10.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:11.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:11.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:12.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:12.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:12.789 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:11:12.789+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:11:13.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:13.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:13.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:13.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:14.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:14.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:15.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:15.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:16.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:17.000+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:17.790 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:11:17.791+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:11:18.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:18.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:19.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:19.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:20.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:20.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:21.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:21.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:22.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:22.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:23.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:23.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:24.120 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:24.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:25.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:25.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:26.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:26.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:27.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:27.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:27.792 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:11:27.793+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:11:28.198 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:28.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:29.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:29.208+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:30.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:30.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:31.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:31.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:32.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:32.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:32.793 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:11:32.794+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:11:33.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:33.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:34.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:34.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:35.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:35.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:36.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:36.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:37.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:37.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:37.794 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:11:37.794+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:11:38.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:38.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:39.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:39.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:40.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:40.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:41.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:41.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:42.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:42.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:42.795 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:11:42.795+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:11:43.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:43.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:44.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:44.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:45.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:45.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:46.249 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:46.250+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:47.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:47.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:47.796 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:11:47.796+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:11:48.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:48.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:49.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:49.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:50.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:50.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:51.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:51.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:52.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:52.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:52.797 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:11:52.798+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:11:53.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:53.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:54.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:54.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:55.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:55.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:56.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:56.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:57.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:57.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:57.798 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:11:57.799+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:11:58.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:58.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:11:59.191 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:11:59.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:00.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:00.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:01.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:01.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:02.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:02.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:02.799 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:12:02.800+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:12:03.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:03.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:04.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:04.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:05.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:05.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:06.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:06.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:07.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:07.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:07.800 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:12:07.801+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:12:08.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:08.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:09.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:09.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:10.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:10.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:11.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:11.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:12.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:12.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:12.801 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:12:12.802+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:12:13.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:13.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:14.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:14.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:15.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:15.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:16.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:16.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:17.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:17.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:17.802 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:12:17.802+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:12:18.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:18.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:19.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:19.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:20.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:20.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:21.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:21.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:22.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:22.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:22.803 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:12:22.803+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:12:23.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:23.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:24.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:24.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:25.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:25.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:26.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:26.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:27.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:27.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:27.804 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:12:27.804+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:12:28.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:28.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:29.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:29.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:30.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:30.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:31.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:31.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:32.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:32.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:32.805 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:12:32.805+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:12:33.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:33.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:34.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:34.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:35.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:35.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:36.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:36.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:37.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:37.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:37.806 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:12:37.806+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:12:38.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:38.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:39.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:39.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:40.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:40.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:41.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:41.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:42.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:42.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:42.807 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:12:42.807+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:12:43.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:43.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:44.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:44.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:45.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:45.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:46.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:46.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:47.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:47.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:47.808 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:12:47.809+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:12:48.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:48.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:49.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:49.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:50.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:50.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:51.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:51.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:52.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:52.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:52.809 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:12:52.809+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:12:53.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:53.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:54.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:54.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:55.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:55.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:56.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:56.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:57.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:57.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:57.810 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:12:57.811+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:12:58.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:58.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:12:59.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:12:59.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:00.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:00.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:01.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:01.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:02.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:02.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:02.811 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:13:02.811+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:13:03.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:03.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:04.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:04.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:05.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:05.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:06.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:06.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:07.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:07.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:07.812 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:13:07.812+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:13:08.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:08.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:09.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:09.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:10.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:10.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:11.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:11.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:12.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:12.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:12.813 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:13:12.813+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:13:13.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:13.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:14.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:14.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:15.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:15.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:16.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:16.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:17.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:17.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:17.814 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:13:17.814+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:13:18.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:18.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:19.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:19.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:20.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:20.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:21.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:21.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:22.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:22.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:22.815 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:13:22.815+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:13:23.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:23.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:24.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:24.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:25.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:25.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:26.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:26.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:27.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:27.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:27.816 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:13:27.816+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:13:28.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:28.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:29.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:29.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:30.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:30.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:31.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:31.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:32.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:32.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:32.817 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:13:32.817+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:13:33.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:33.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:34.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:34.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:35.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:35.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:36.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:36.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:37.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:37.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:37.819 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:13:37.819+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:13:38.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:38.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:39.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:39.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:40.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:40.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:41.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:41.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:42.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:42.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:42.819 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:13:42.820+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:13:43.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:43.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:44.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:44.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:45.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:45.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:46.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:46.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:47.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:47.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:47.820 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:13:47.821+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:13:48.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:48.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:49.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:49.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:50.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:50.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:51.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:51.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:52.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:52.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:52.820 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:13:52.821+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:13:53.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:53.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:54.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:54.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:55.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:55.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:56.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:56.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:57.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:57.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:57.821 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:13:57.822+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:13:58.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:58.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:13:59.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:13:59.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:00.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:00.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:01.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:01.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:02.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:02.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:02.822 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:14:02.822+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:14:03.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:03.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:04.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:04.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:05.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:05.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:06.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:06.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:07.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:07.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:07.823 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:14:07.824+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:14:08.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:08.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:09.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:09.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:10.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:10.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:11.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:11.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:12.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:12.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:12.824 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:14:12.825+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:14:13.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:13.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:14.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:14.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:15.301 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:15.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:16.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:16.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:17.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:17.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:17.825 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:14:17.825+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:14:18.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:18.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:19.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:19.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:20.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:20.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:21.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:21.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:22.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:22.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:22.826 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:14:22.827+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:14:23.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:23.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:24.178 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:24.178+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:25.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:25.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:26.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:26.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:27.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:27.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:27.827 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:14:27.827+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:14:28.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:28.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:29.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:29.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:30.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:30.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:31.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:31.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:31.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:31.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:32.828 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:14:32.828+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:14:32.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:32.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:33.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:33.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:34.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:34.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:35.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:35.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:36.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:36.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:37.829 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:14:37.830+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:14:37.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:37.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:38.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:38.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:39.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:39.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:40.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:40.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:41.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:41.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:42.830 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:14:42.831+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:14:42.841 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:42.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:43.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:43.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:44.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:44.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:45.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:45.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:46.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:46.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:47.831 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:14:47.831+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:14:47.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:47.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:48.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:48.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:49.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:49.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:50.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:50.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:51.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:51.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:52.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:52.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:52.832 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:14:52.832+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:14:53.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:53.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:54.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:54.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:55.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:55.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:56.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:56.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:57.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:57.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:57.833 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:14:57.833+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:14:58.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:58.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:14:59.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:14:59.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:00.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:00.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:01.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:01.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:02.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:02.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:02.834 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:15:02.834+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:15:03.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:03.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:04.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:04.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:05.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:05.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:06.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:06.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:07.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:07.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:07.835 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:15:07.835+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:15:08.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:08.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:09.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:09.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:10.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:10.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:11.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:11.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:12.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:12.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:12.836 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:15:12.836+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:15:13.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:13.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:14.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:14.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:15.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:15.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:16.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:16.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:17.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:17.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:17.837 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:15:17.837+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:15:18.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:18.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:19.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:19.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:20.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:20.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:21.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:21.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:22.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:22.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:22.838 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:15:22.838+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:15:23.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:23.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:24.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:24.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:25.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:25.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:26.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:26.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:27.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:27.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:27.839 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:15:27.840+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:15:28.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:28.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:29.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:29.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:30.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:30.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:31.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:31.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:32.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:32.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:32.840 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:15:32.840+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:15:33.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:33.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:34.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:34.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:35.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:35.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:36.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:36.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:37.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:37.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:37.841 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:15:37.841+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:15:38.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:38.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:39.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:39.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:40.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:40.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:41.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:41.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:42.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:42.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:42.842 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:15:42.842+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:15:43.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:43.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:44.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:44.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:45.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:45.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:46.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:46.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:47.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:47.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:47.843 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:15:47.843+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:15:48.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:48.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:49.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:49.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:50.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:50.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:51.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:51.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:52.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:52.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:52.843 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:15:52.844+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:15:53.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:53.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:54.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:54.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:55.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:55.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:56.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:56.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:57.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:57.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:57.845 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:15:57.845+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:15:58.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:58.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:15:59.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:15:59.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:00.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:00.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:01.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:01.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:02.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:02.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:02.846 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:16:02.847+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:16:03.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:03.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:04.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:04.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:05.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:05.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:06.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:06.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:07.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:07.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:07.847 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:16:07.847+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:16:08.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:08.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:09.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:09.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:10.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:10.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:11.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:11.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:12.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:12.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:12.848 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:16:12.848+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:16:13.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:13.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:14.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:14.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:15.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:15.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:16.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:16.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:17.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:17.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:17.849 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:16:17.849+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:16:18.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:18.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:19.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:19.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:20.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:20.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:21.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:21.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:22.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:22.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:22.850 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:16:22.850+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:16:23.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:23.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:24.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:24.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:25.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:25.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:26.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:26.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:27.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:27.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:27.851 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:16:27.851+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:16:28.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:28.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:29.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:29.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:30.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:30.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:31.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:31.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:32.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:32.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:32.852 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:16:32.852+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:16:33.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:33.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:34.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:34.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:35.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:35.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:36.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:36.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:37.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:37.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:37.853 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:16:37.853+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:16:38.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:38.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:39.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:39.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:40.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:40.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:41.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:41.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:42.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:42.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:42.854 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:16:42.854+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:16:43.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:43.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:44.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:44.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:45.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:45.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:46.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:46.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:47.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:47.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:47.855 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:16:47.856+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:16:48.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:48.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:49.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:49.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:50.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:50.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:51.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:51.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:52.855 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:16:52.857+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:16:52.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:52.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:53.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:53.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:54.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:54.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:55.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:55.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:56.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:56.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:57.856 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:16:57.856+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:16:57.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:57.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:58.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:58.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:16:59.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:16:59.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:00.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:00.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:01.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:01.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:02.857 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:17:02.857+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:17:02.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:02.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:03.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:03.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:04.943 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:04.944+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:05.899 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:05.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:06.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:06.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:07.858 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:17:07.858+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:17:07.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:07.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:08.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:08.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:09.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:09.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:10.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:10.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:11.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:11.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:12.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:12.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:12.859 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:17:12.859+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:17:13.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:13.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:14.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:14.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:15.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:15.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:16.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:16.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:17.860 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:17:17.860+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:17:17.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:17.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:18.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:18.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:19.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:19.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:20.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:20.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:21.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:21.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:22.861 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:17:22.861+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:17:22.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:22.966+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:23.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:23.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:24.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:24.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:25.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:25.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:26.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:26.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:27.862 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:17:27.862+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:17:27.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:27.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:28.933 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:28.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:29.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:29.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:30.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:30.902+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:31.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:31.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:32.862 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:17:32.863+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:17:32.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:32.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:33.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:33.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:34.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:34.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:35.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:35.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:36.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:36.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:37.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:37.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:37.864 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:17:37.864+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:17:38.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:38.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:39.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:39.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:40.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:40.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:41.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:41.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:42.865 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:17:42.865+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:17:43.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:43.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:44.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:44.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:45.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:45.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:46.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:46.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:47.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:47.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:47.866 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:17:47.867+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:17:48.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:48.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:49.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:49.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:50.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:50.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:51.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:51.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:52.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:52.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:52.867 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:17:52.867+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:17:53.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:53.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:54.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:54.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:55.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:55.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:56.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:56.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:57.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:57.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:57.868 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:17:57.868+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:17:58.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:58.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:17:59.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:17:59.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:00.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:00.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:01.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:01.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:02.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:02.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:02.869 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:18:02.869+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:18:03.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:03.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:04.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:04.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:05.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:05.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:06.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:06.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:07.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:07.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:07.870 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:18:07.870+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:18:08.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:08.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:09.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:09.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:10.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:10.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:11.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:11.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:12.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:12.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:12.871 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:18:12.871+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:18:13.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:13.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:14.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:14.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:15.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:15.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:16.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:16.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:17.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:17.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:17.872 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:18:17.872+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:18:18.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:18.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:19.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:19.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:20.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:20.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:21.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:21.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:22.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:22.180+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:22.873 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:18:22.874+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:18:23.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:23.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:24.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:24.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:25.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:25.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:26.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:26.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:27.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:27.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:27.874 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:18:27.874+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:18:28.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:28.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:29.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:29.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:30.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:30.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:31.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:31.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:32.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:32.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:32.875 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:18:32.875+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:18:33.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:33.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:34.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:34.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:35.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:35.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:36.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:36.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:37.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:37.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:37.876 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:18:37.876+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:18:38.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:38.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:39.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:39.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:40.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:40.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:41.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:41.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:42.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:42.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:42.877 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:18:42.877+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:18:43.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:43.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:44.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:44.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:45.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:45.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:46.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:46.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:47.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:47.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:47.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:18:47.879+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:18:48.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:48.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:49.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:49.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:50.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:50.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:51.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:51.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:52.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:52.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:52.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:18:52.879+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:18:53.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:53.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:54.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:54.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:55.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:55.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:56.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:56.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:57.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:57.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:57.880 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:18:57.880+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:18:58.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:58.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:18:59.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:18:59.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:00.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:00.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:01.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:01.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:02.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:02.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:02.881 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:19:02.882+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:19:03.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:03.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:04.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:04.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:05.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:05.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:06.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:06.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:07.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:07.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:07.882 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:19:07.882+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:19:08.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:08.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:09.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:09.232+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:10.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:10.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:11.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:11.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:12.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:12.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:12.883 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:19:12.883+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:19:13.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:13.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:14.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:14.276+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:15.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:15.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:16.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:16.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:17.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:17.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:17.884 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:19:17.884+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:19:18.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:18.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:19.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:19.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:20.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:20.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:21.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:21.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:22.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:22.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:22.885 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:19:22.885+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:19:23.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:23.192+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:24.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:24.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:25.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:25.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:26.226 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:26.227+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:27.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:27.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:27.886 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:19:27.886+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:19:28.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:28.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:29.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:29.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:30.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:30.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:31.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:31.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:32.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:32.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:32.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:19:32.887+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:19:33.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:33.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:34.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:34.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:35.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:35.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:36.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:36.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:37.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:37.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:37.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:19:37.888+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:19:38.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:38.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:39.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:39.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:40.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:40.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:41.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:41.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:42.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:42.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:42.889 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:19:42.889+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:19:43.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:43.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:44.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:44.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:45.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:45.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:46.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:46.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:47.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:47.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:47.890 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:19:47.891+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:19:48.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:48.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:49.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:49.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:50.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:50.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:51.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:51.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:52.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:52.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:52.890 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:19:52.892+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:19:53.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:53.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:54.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:54.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:55.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:55.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:56.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:56.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:57.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:57.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:57.891 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:19:57.893+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:19:58.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:58.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:19:59.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:19:59.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:00.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:00.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:01.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:01.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:02.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:02.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:02.892 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:20:02.892+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:20:03.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:03.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:04.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:04.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:05.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:05.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:06.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:06.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:07.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:07.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:07.893 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:20:07.893+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:20:08.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:08.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:09.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:09.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:10.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:10.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:11.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:11.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:12.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:12.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:12.894 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:20:12.894+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:20:13.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:13.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:14.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:14.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:15.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:15.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:16.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:16.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:17.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:17.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:17.895 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:20:17.896+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:20:18.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:18.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:19.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:19.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:20.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:20.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:21.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:21.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:22.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:22.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:22.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:20:22.896+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:20:23.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:23.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:24.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:24.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:25.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:25.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:26.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:26.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:27.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:27.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:27.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:20:27.897+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:20:28.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:28.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:29.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:29.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:30.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:30.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:31.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:31.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:32.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:32.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:32.898 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:20:32.898+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:20:33.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:33.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:34.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:34.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:35.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:35.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:36.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:36.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:37.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:37.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:37.899 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:20:37.900+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:20:38.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:38.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:39.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:39.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:40.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:40.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:41.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:41.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:42.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:42.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:42.900 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:20:42.901+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:20:43.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:43.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:44.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:44.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:45.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:45.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:46.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:46.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:47.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:47.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:47.901 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:20:47.902+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:20:48.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:48.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:49.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:49.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:50.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:50.958+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:51.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:51.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:52.902 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:20:52.902+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:20:52.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:52.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:53.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:53.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:54.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:54.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:55.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:55.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:56.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:56.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:57.903 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:20:57.903+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:20:58.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:58.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:20:58.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:20:58.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:00.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:00.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:00.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:00.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:01.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:01.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:02.904 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:21:02.904+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:21:02.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:02.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:03.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:03.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:04.941 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:04.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:05.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:05.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:06.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:06.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:07.905 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:21:07.906+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:21:07.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:07.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:08.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:08.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:09.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:09.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:10.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:10.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:11.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:11.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:12.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:12.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:12.905 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:21:12.906+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:21:13.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:13.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:14.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:14.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:15.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:15.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:16.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:16.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:17.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:17.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:17.907 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:21:17.907+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:21:18.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:18.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:19.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:19.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:20.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:20.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:21.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:21.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:22.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:22.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:22.907 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:21:22.908+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:21:23.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:23.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:24.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:24.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:25.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:25.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:26.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:26.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:27.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:27.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:27.909 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:21:27.909+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:21:28.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:28.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:29.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:29.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:30.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:30.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:31.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:31.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:32.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:32.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:32.910 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:21:32.910+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:21:33.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:33.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:34.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:34.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:35.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:35.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:36.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:36.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:37.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:37.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:37.911 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:21:37.911+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:21:38.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:38.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:39.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:39.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:40.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:40.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:41.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:41.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:42.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:42.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:42.912 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:21:42.912+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:21:43.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:43.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:44.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:44.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:45.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:45.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:46.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:46.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:47.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:47.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:47.913 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:21:47.913+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:21:48.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:48.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:49.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:49.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:50.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:50.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:51.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:51.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:52.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:52.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:52.914 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:21:52.914+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:21:53.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:53.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:54.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:54.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:55.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:55.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:56.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:56.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:57.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:57.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:57.915 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:21:57.915+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:21:58.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:58.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:21:59.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:21:59.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:00.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:00.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:01.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:01.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:02.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:02.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:02.916 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:22:02.916+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:22:03.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:03.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:04.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:04.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:05.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:05.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:06.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:06.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:07.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:07.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:07.917 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:22:07.917+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:22:08.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:08.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:09.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:09.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:10.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:10.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:11.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:11.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:12.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:12.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:12.918 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:22:12.918+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:22:13.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:13.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:14.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:14.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:15.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:15.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:16.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:16.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:17.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:17.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:17.919 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:22:17.919+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:22:18.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:18.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:19.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:19.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:20.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:20.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:21.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:21.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:22.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:22.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:22.919 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:22:22.920+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:22:23.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:23.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:24.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:24.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:25.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:25.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:26.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:26.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:27.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:27.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:27.921 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:22:27.921+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:22:28.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:28.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:29.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:29.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:30.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:30.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:31.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:31.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:32.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:32.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:32.922 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:22:32.922+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:22:33.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:33.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:34.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:34.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:35.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:35.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:36.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:36.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:37.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:37.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:37.923 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:22:37.923+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:22:38.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:38.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:39.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:39.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:40.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:40.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:41.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:41.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:42.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:42.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:42.924 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:22:42.924+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:22:43.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:43.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:44.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:44.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:45.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:45.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:46.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:46.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:47.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:47.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:47.925 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:22:47.926+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:22:48.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:48.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:49.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:49.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:50.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:50.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:51.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:51.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:52.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:52.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:52.926 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:22:52.927+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:22:53.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:53.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:54.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:54.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:55.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:55.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:56.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:56.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:57.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:57.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:57.926 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:22:57.928+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:22:58.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:58.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:22:59.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:22:59.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:00.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:00.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:01.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:01.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:02.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:02.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:02.927 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:23:02.928+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:23:03.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:03.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:04.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:04.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:05.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:05.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:06.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:06.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:07.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:07.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:07.928 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:23:07.929+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:23:08.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:08.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:09.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:09.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:10.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:10.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:11.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:11.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:12.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:12.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:12.929 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:23:12.929+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:23:13.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:13.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:14.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:14.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:15.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:15.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:16.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:16.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:17.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:17.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:17.930 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:23:17.931+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:23:18.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:18.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:19.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:19.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:20.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:20.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:21.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:21.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:22.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:22.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:22.931 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:23:22.931+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:23:23.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:23.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:24.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:24.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:25.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:25.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:26.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:26.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:27.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:27.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:27.932 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:23:27.932+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:23:28.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:28.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:29.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:29.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:30.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:30.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:31.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:31.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:32.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:32.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:32.933 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:23:32.934+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:23:33.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:33.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:34.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:34.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:35.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:35.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:36.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:36.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:37.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:37.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:37.934 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:23:37.935+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:23:38.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:38.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:39.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:39.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:40.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:40.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:41.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:41.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:42.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:42.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:42.935 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:23:42.936+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:23:43.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:43.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:44.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:44.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:45.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:45.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:46.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:46.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:47.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:47.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:47.936 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:23:47.937+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:23:48.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:48.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:49.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:49.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:50.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:50.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:51.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:51.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:52.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:52.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:52.937 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:23:52.937+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:23:53.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:53.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:54.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:54.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:55.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:55.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:56.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:56.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:57.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:57.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:57.938 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:23:57.938+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:23:58.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:58.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:23:59.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:23:59.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:00.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:00.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:01.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:01.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:02.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:02.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:02.938 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:24:02.939+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:24:03.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:03.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:04.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:04.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:05.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:05.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:06.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:06.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:07.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:07.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:07.939 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:24:07.940+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:24:08.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:08.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:09.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:09.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:10.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:10.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:11.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:11.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:12.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:12.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:12.940 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:24:12.941+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:24:13.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:13.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:14.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:14.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:15.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:15.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:16.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:16.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:17.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:17.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:17.941 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:24:17.942+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:24:18.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:18.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:19.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:19.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:20.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:20.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:21.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:21.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:22.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:22.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:22.943 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:24:22.943+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:24:23.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:23.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:24.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:24.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:25.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:25.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:26.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:26.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:27.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:27.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:27.944 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:24:27.944+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:24:28.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:28.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:29.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:29.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:30.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:30.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:31.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:31.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:32.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:32.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:32.945 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:24:32.945+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:24:33.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:33.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:34.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:34.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:35.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:35.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:36.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:36.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:37.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:37.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:37.946 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:24:37.946+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:24:38.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:38.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:39.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:39.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:40.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:40.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:41.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:41.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:42.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:42.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:42.946 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:24:42.947+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:24:43.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:43.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:44.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:44.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:45.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:45.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:46.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:46.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:47.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:47.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:47.947 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:24:47.948+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:24:48.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:48.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:49.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:49.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:50.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:50.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:51.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:51.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:52.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:52.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:52.948 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:24:52.949+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:24:53.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:53.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:54.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:54.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:55.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:55.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:56.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:56.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:57.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:57.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:57.949 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:24:57.950+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:24:58.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:58.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:24:59.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:24:59.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:00.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:00.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:01.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:01.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:02.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:02.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:02.950 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:25:02.951+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:25:03.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:03.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:04.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:04.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:05.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:05.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:06.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:06.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:07.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:07.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:07.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:25:07.952+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:25:08.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:08.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:09.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:09.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:10.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:10.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:11.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:11.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:12.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:12.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:12.953 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:25:12.953+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:25:13.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:13.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:14.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:14.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:15.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:15.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:16.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:16.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:17.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:17.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:17.954 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:25:17.954+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:25:18.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:18.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:19.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:19.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:20.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:20.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:21.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:21.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:22.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:22.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:22.954 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:25:22.955+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:25:23.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:23.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:24.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:24.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:25.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:25.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:26.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:26.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:27.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:27.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:27.955 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:25:27.956+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:25:28.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:28.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:29.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:29.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:30.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:30.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:31.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:31.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:32.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:32.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:32.957 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:25:32.957+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:25:33.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:33.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:34.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:34.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:35.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:35.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:36.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:36.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:37.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:37.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:37.958 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:25:37.958+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:25:38.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:38.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:39.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:39.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:40.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:40.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:41.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:41.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:42.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:42.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:42.959 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:25:42.959+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:25:43.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:43.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:44.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:44.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:45.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:45.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:46.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:46.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:47.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:47.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:47.960 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:25:47.960+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:25:48.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:48.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:49.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:49.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:50.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:50.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:51.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:51.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:52.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:52.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:52.961 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:25:52.962+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:25:53.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:53.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:54.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:54.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:55.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:55.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:56.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:56.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:57.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:57.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:57.962 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:25:57.963+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:25:58.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:58.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:25:59.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:25:59.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:00.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:00.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:01.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:01.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:02.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:02.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:02.962 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:26:02.964+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:26:03.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:03.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:04.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:04.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:05.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:05.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:06.452 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:06.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:07.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:07.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:07.963 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:26:07.964+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:26:08.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:08.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:09.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:09.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:10.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:10.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:11.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:11.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:12.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:12.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:12.964 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:26:12.964+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:26:13.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:13.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:14.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:14.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:15.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:15.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:16.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:16.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:17.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:17.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:17.965 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:26:17.965+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:26:18.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:18.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:19.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:19.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:20.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:20.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:21.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:21.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:22.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:22.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:22.966 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:26:22.967+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:26:23.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:23.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:24.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:24.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:25.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:25.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:26.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:26.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:27.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:27.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:27.967 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:26:27.968+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:26:28.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:28.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:29.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:29.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:30.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:30.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:31.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:31.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:32.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:32.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:32.968 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:26:32.969+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:26:33.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:33.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:34.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:34.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:35.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:35.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:36.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:36.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:37.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:37.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:37.969 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:26:37.970+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:26:38.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:38.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:39.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:39.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:40.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:40.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:41.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:41.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:42.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:42.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:42.970 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:26:42.971+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:26:43.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:43.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:44.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:44.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:45.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:45.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:46.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:46.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:47.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:47.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:47.971 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:26:47.971+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:26:48.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:48.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:49.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:49.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:50.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:50.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:51.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:51.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:52.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:52.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:52.972 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:26:52.973+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:26:53.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:53.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:54.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:54.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:55.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:55.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:56.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:56.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:57.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:57.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:57.973 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:26:57.974+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:26:58.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:58.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:26:59.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:26:59.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:00.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:00.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:01.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:01.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:02.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:02.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:02.974 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:27:02.974+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:27:03.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:03.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:04.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:04.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:05.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:05.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:06.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:06.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:07.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:07.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:07.975 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:27:07.975+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:27:08.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:08.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:09.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:09.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:10.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:10.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:11.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:11.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:12.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:12.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:12.976 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:27:12.977+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:27:13.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:13.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:14.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:14.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:15.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:15.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:16.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:16.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:17.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:17.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:17.977 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:27:17.977+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:27:18.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:18.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:19.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:19.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:20.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:20.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:21.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:21.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:22.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:22.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:22.978 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:27:22.978+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:27:23.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:23.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:24.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:24.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:25.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:25.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:26.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:26.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:27.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:27.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:27.979 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:27:27.979+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:27:28.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:28.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:29.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:29.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:30.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:30.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:31.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:31.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:32.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:32.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:32.980 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:27:32.980+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:27:33.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:33.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:34.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:34.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:35.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:35.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:36.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:36.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:37.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:37.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:37.981 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:27:37.981+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:27:38.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:38.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:39.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:39.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:40.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:40.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:41.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:41.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:42.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:42.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:42.982 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:27:42.983+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:27:43.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:43.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:44.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:44.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:45.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:45.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:46.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:46.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:47.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:47.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:47.983 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:27:47.984+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:27:48.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:48.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:49.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:49.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:50.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:50.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:51.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:51.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:52.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:52.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:52.984 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:27:52.984+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:27:53.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:53.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:54.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:54.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:55.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:55.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:56.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:56.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:57.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:57.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:57.985 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:27:57.985+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:27:58.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:58.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:27:59.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:27:59.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:00.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:00.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:01.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:01.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:02.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:02.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:02.986 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:28:02.986+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:28:03.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:03.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:04.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:04.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:05.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:05.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:06.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:06.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:07.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:07.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:07.987 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:28:07.987+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:28:08.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:08.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:09.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:09.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:10.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:10.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:11.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:11.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:12.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:12.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:12.988 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:28:12.988+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:28:13.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:13.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:14.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:14.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:15.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:15.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:16.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:16.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:17.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:17.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:17.989 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:28:17.989+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:28:18.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:18.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:19.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:19.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:20.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:20.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:21.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:21.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:22.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:22.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:22.990 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:28:22.990+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:28:23.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:23.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:24.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:24.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:25.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:25.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:26.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:26.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:27.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:27.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:27.991 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:28:27.991+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:28:28.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:28.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:29.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:29.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:30.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:30.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:31.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:31.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:32.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:32.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:32.991 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:28:32.992+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:28:33.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:33.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:34.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:34.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:35.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:35.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:36.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:36.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:37.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:37.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:37.993 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:28:37.993+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:28:38.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:38.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:39.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:39.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:40.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:40.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:41.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:41.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:42.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:42.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:42.993 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:28:42.994+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:28:43.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:43.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:44.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:44.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:45.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:45.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:46.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:46.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:47.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:47.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:47.995 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:28:47.995+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:28:48.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:48.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:49.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:49.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:50.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:50.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:51.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:51.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:52.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:52.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:52.995 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:28:52.997+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:28:53.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:53.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:54.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:54.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:55.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:55.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:56.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:56.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:57.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:57.619+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:57.996 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:28:57.997+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:28:58.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:58.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:28:59.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:28:59.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:00.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:00.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:01.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:01.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:02.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:02.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:02.997 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:29:02.998+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:29:03.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:03.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:04.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:04.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:05.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:05.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:06.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:06.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:07.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:07.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:07.998 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:29:07.999+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:29:08.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:08.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:09.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:09.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:10.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:10.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:11.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:11.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:12.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:12.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:12.999 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:29:13.000+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:29:13.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:13.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:14.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:14.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:15.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:15.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:16.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:16.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:17.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:17.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:18.000 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:29:18.000+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:29:18.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:18.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:19.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:19.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:20.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:20.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:21.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:21.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:22.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:22.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:23.001 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:29:23.002+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:29:23.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:23.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:24.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:24.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:25.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:25.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:26.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:26.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:27.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:27.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:28.002 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:29:28.002+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:29:28.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:28.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:29.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:29.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:30.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:30.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:31.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:31.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:32.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:32.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:33.003 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:29:33.003+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:29:33.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:33.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:34.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:34.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:35.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:35.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:36.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:36.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:37.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:37.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:38.004 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:29:38.005+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:29:38.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:38.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:39.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:39.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:40.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:40.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:41.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:41.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:42.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:42.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:43.005 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:29:43.005+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:29:43.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:43.272+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:44.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:44.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:45.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:45.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:46.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:46.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:47.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:47.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:48.006 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:29:48.006+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:29:48.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:48.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:49.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:49.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:50.284 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:50.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:51.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:51.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:52.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:52.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:53.007 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:29:53.007+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:29:53.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:53.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:54.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:54.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:55.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:55.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:56.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:56.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:57.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:57.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:58.007 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:29:58.008+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:29:58.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:58.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:29:59.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:29:59.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:00.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:00.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:01.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:01.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:02.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:02.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:03.008 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:30:03.009+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:30:03.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:03.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:04.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:04.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:05.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:05.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:06.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:06.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:07.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:07.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:08.009 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:30:08.010+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:30:08.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:08.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:09.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:09.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:10.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:10.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:11.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:11.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:12.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:12.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:13.010 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:30:13.010+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:30:13.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:13.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:14.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:14.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:15.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:15.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:16.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:16.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:17.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:17.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:18.011 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:30:18.011+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:30:18.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:18.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:19.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:19.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:20.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:20.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:21.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:21.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:22.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:22.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:23.011 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:30:23.012+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:30:23.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:23.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:24.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:24.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:25.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:25.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:26.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:26.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:27.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:27.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:28.012 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:30:28.013+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:30:28.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:28.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:29.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:29.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:30.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:30.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:31.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:31.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:32.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:32.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:33.013 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:30:33.014+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:30:33.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:33.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:34.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:34.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:35.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:35.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:36.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:36.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:37.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:37.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:38.014 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:30:38.015+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:30:38.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:38.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:39.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:39.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:40.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:40.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:41.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:41.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:42.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:42.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:43.016 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:30:43.016+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:30:43.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:43.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:44.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:44.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:45.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:45.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:46.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:46.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:47.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:47.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:48.016 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:30:48.017+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:30:48.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:48.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:49.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:49.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:50.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:50.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:51.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:51.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:52.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:52.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:53.018 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:30:53.018+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:30:53.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:53.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:54.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:54.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:55.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:55.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:56.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:56.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:57.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:57.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:58.019 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:30:58.020+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:30:58.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:58.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:30:59.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:30:59.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:00.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:00.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:01.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:01.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:02.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:02.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:03.022 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:31:03.021+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:31:03.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:03.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:04.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:04.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:05.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:05.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:06.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:06.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:07.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:07.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:08.022 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:31:08.022+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:31:08.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:08.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:09.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:09.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:10.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:10.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:11.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:11.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:12.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:12.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:13.023 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:31:13.023+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:31:13.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:13.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:14.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:14.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:15.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:15.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:16.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:16.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:17.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:17.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:18.024 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:31:18.024+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:31:18.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:18.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:19.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:19.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:20.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:20.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:21.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:21.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:22.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:22.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:23.025 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:31:23.025+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:31:23.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:23.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:24.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:24.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:25.712 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:25.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:26.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:26.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:27.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:27.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:28.026 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:31:28.026+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:31:28.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:28.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:29.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:29.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:30.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:30.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:31.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:31.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:32.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:32.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:33.027 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:31:33.027+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:31:33.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:33.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:34.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:34.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:35.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:35.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:36.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:36.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:37.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:37.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:38.028 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:31:38.028+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:31:38.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:38.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:39.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:39.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:40.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:40.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:41.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:41.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:42.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:42.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:43.029 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:31:43.029+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:31:43.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:43.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:44.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:44.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:45.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:45.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:46.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:46.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:47.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:47.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:48.030 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:31:48.030+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:31:48.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:48.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:49.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:49.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:50.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:50.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:51.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:51.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:52.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:52.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:53.031 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:31:53.031+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:31:53.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:53.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:54.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:54.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:55.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:55.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:56.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:56.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:57.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:57.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:58.031 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:31:58.033+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:31:58.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:58.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:31:59.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:31:59.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:00.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:00.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:01.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:01.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:02.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:02.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:03.032 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:32:03.034+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:32:03.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:03.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:04.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:04.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:05.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:05.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:06.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:06.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:07.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:07.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:08.033 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:32:08.035+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:32:08.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:08.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:09.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:09.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:10.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:10.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:11.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:11.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:12.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:12.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:13.034 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:32:13.036+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:32:13.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:13.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:14.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:14.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:15.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:15.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:16.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:16.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:17.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:17.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:18.035 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:32:18.036+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:32:18.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:18.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:19.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:19.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:20.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:20.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:21.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:21.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:22.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:22.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:23.036 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:32:23.036+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:32:23.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:23.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:24.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:24.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:25.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:25.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:26.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:26.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:27.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:27.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:28.037 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:32:28.037+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:32:28.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:28.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:29.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:29.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:30.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:30.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:31.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:31.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:32.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:32.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:33.038 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:32:33.039+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:32:33.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:33.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:34.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:34.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:35.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:35.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:36.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:36.418+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:37.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:37.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:38.039 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:32:38.039+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:32:38.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:38.438+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:39.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:39.465+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:40.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:40.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:41.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:41.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:42.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:42.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:43.040 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:32:43.041+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:32:43.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:43.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:44.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:44.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:45.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:45.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:46.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:46.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:47.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:47.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:48.041 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:32:48.042+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:32:48.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:48.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:49.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:49.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:50.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:50.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:51.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:51.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:52.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:52.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:53.042 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:32:53.043+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:32:53.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:53.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:54.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:54.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:55.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:55.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:56.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:56.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:57.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:57.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:58.043 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:32:58.043+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:32:58.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:58.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:32:59.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:32:59.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:00.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:00.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:01.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:01.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:02.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:02.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:03.044 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:33:03.044+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:33:03.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:03.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:04.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:04.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:05.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:05.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:06.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:06.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:07.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:07.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:08.045 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:33:08.045+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:33:08.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:08.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:09.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:09.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:10.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:10.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:11.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:11.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:12.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:12.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:13.046 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:33:13.047+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:33:13.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:13.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:14.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:14.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:15.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:15.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:16.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:16.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:17.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:17.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:18.047 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:33:18.047+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:33:18.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:18.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:19.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:19.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:20.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:20.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:21.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:21.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:22.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:22.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:23.048 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:33:23.048+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:33:23.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:23.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:24.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:24.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:25.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:25.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:26.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:26.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:27.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:27.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:28.049 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:33:28.049+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:33:28.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:28.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:29.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:29.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:30.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:30.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:31.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:31.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:32.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:32.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:33.050 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:33:33.050+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:33:33.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:33.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:34.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:34.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:35.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:35.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:36.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:36.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:37.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:37.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:38.051 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:33:38.052+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:33:38.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:38.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:39.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:39.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:40.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:40.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:41.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:41.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:42.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:42.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:43.052 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:33:43.052+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:33:43.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:43.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:44.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:44.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:45.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:45.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:46.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:46.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:47.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:47.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:48.053 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:33:48.054+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:33:48.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:48.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:49.502 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:49.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:50.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:50.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:51.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:51.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:52.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:52.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:53.054 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:33:53.054+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:33:53.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:53.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:54.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:54.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:55.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:55.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:56.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:56.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:57.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:57.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:58.055 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:33:58.055+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:33:58.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:58.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:33:59.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:33:59.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:00.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:00.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:01.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:01.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:02.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:02.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:03.056 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:34:03.056+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:34:03.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:03.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:04.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:04.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:05.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:05.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:06.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:06.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:07.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:07.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:08.057 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:34:08.057+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:34:08.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:08.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:09.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:09.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:10.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:10.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:11.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:11.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:12.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:12.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:13.058 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:34:13.058+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:34:13.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:13.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:14.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:14.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:15.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:15.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:16.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:16.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:17.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:17.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:18.059 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:34:18.060+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:34:18.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:18.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:19.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:19.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:20.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:20.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:21.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:21.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:22.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:22.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:23.060 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:34:23.060+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:34:23.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:23.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:24.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:24.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:25.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:25.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:26.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:26.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:27.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:27.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:28.061 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:34:28.061+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:34:28.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:28.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:29.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:29.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:30.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:30.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:31.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:31.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:32.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:32.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:33.062 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:34:33.062+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:34:33.067 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:33.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:34.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:34.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:35.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:35.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:36.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:36.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:37.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:37.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:38.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:38.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:38.063 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:34:38.063+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:34:39.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:39.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:40.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:40.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:41.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:41.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:42.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:42.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:43.064 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:34:43.064+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:34:43.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:43.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:44.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:44.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:45.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:45.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:46.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:46.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:47.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:47.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:48.065 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:34:48.065+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:34:48.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:48.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:49.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:49.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:50.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:50.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:51.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:51.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:52.176 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:52.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:53.066 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:34:53.066+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:34:53.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:53.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:54.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:54.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:55.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:55.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:56.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:56.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:57.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:57.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:58.067 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:34:58.067+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:34:58.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:58.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:34:59.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:34:59.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:00.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:00.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:01.172 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:01.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:02.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:02.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:03.068 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:35:03.068+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:35:03.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:03.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:04.186 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:04.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:05.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:05.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:06.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:06.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:07.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:07.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:08.068 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:35:08.070+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:35:08.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:08.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:09.232 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:09.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:10.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:10.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:11.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:11.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:12.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:12.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:13.069 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:35:13.071+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:35:13.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:13.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:14.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:14.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:15.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:15.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:16.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:16.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:17.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:17.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:18.070 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:35:18.070+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:35:18.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:18.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:19.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:19.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:20.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:20.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:21.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:21.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:22.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:22.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:23.071 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:35:23.071+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:35:23.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:23.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:24.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:24.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:25.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:25.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:26.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:26.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:27.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:27.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:28.072 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:35:28.072+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:35:28.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:28.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:29.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:29.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:30.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:30.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:31.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:31.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:32.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:32.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:33.073 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:35:33.074+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:35:33.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:33.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:34.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:34.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:35.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:35.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:36.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:36.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:37.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:37.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:38.074 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:35:38.075+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:35:38.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:38.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:39.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:39.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:40.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:40.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:41.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:41.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:42.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:42.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:43.075 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:35:43.076+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:35:43.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:43.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:44.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:44.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:45.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:45.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:46.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:46.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:47.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:47.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:48.076 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:35:48.077+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:35:48.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:48.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:49.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:49.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:50.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:50.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:51.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:51.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:52.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:52.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:53.077 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:35:53.078+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:35:53.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:53.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:54.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:54.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:55.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:55.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:56.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:56.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:57.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:57.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:58.078 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:35:58.079+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:35:58.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:58.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:35:59.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:35:59.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:00.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:00.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:01.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:01.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:02.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:02.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:03.079 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:36:03.080+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:36:03.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:03.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:04.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:04.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:05.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:05.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:06.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:06.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:07.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:07.064+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:08.080 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:36:08.080+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:36:08.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:08.113+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:09.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:09.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:10.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:10.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:11.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:11.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:12.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:12.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:13.081 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:36:13.082+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:36:13.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:13.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:14.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:14.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:15.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:15.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:16.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:16.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:17.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:17.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:18.082 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:36:18.082+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:36:18.135 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:18.136+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:19.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:19.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:20.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:20.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:21.117 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:21.118+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:22.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:22.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:23.083 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:36:23.083+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:36:23.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:23.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:24.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:24.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:25.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:25.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:26.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:26.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:27.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:27.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:28.084 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:36:28.084+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:36:28.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:28.088+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:29.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:29.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:30.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:30.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:31.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:31.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:32.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:32.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:33.085 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:36:33.085+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:36:33.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:33.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:34.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:34.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:35.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:35.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:36.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:36.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:37.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:37.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:38.086 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:36:38.086+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:36:38.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:38.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:39.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:39.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:40.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:40.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:41.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:41.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:42.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:42.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:43.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:36:43.088+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:36:43.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:43.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:44.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:44.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:45.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:45.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:46.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:46.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:47.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:47.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:48.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:36:48.088+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:36:48.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:48.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:49.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:49.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:50.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:50.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:51.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:51.170+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:52.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:52.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:53.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:36:53.089+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:36:53.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:53.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:54.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:54.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:55.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:55.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:56.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:56.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:57.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:57.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:58.090 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:36:58.091+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:36:58.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:58.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:36:59.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:36:59.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:00.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:00.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:01.211 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:01.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:02.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:02.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:03.091 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:37:03.092+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:37:03.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:03.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:04.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:04.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:05.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:05.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:06.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:06.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:07.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:07.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:08.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:08.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:08.091 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:37:08.092+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:37:09.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:09.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:10.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:10.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:11.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:11.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:12.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:12.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:12.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:12.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:13.093 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:37:13.093+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:37:13.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:13.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:14.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:14.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:15.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:15.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:16.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:16.922+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:17.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:17.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:18.093 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:37:18.094+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:37:19.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:19.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:20.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:20.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:21.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:21.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:22.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:22.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:23.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:23.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:23.094 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:37:23.095+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:37:24.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:24.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:25.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:25.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:26.150 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:26.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:27.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:27.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:28.096 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:37:28.096+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:37:28.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:28.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:29.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:29.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:30.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:30.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:31.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:31.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:32.208 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:32.209+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:33.097 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:37:33.097+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:37:33.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:33.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:34.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:34.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:35.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:35.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:36.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:36.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:37.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:37.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:38.098 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:37:38.098+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:37:38.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:38.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:39.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:39.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:40.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:40.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:41.309 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:41.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:42.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:42.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:43.099 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:37:43.099+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:37:43.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:43.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:44.368 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:44.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:45.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:45.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:46.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:46.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:47.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:47.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:48.099 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:37:48.100+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:37:48.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:48.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:49.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:49.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:50.291 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:50.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:51.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:51.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:52.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:52.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:53.101 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:37:53.101+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:37:53.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:53.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:54.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:54.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:55.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:55.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:56.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:56.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:57.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:57.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:58.101 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:37:58.102+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:37:58.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:58.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:37:59.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:37:59.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:00.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:00.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:01.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:01.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:02.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:02.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:03.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:38:03.103+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:38:03.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:03.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:04.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:04.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:05.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:05.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:06.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:06.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:07.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:07.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:08.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:38:08.105+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:38:08.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:08.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:09.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:09.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:10.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:10.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:11.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:11.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:12.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:12.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:13.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:38:13.106+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:38:13.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:13.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:14.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:14.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:15.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:15.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:16.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:16.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:17.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:17.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:18.105 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:38:18.107+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:38:18.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:18.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:19.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:19.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:20.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:20.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:21.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:21.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:22.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:22.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:23.106 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:38:23.107+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:38:23.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:23.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:24.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:24.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:25.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:25.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:26.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:26.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:27.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:27.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:28.107 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:38:28.108+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:38:28.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:28.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:29.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:29.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:30.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:30.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:31.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:31.241+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:32.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:32.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:33.108 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:38:33.108+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:38:33.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:33.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:34.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:34.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:35.266 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:35.266+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:36.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:36.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:37.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:37.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:38.109 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:38:38.109+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:38:38.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:38.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:39.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:39.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:40.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:40.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:41.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:41.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:42.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:42.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:43.110 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:38:43.111+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:38:43.206 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:43.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:44.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:44.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:45.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:45.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:46.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:46.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:47.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:47.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:48.111 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:38:48.111+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:38:48.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:48.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:49.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:49.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:50.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:50.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:51.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:51.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:52.148 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:52.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:53.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:53.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:53.112 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:38:53.112+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:38:54.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:54.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:55.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:55.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:56.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:56.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:57.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:57.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:58.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:58.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:38:58.113 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:38:58.114+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:38:59.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:38:59.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:00.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:00.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:00.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:00.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:02.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:02.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:03.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:03.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:03.114 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:39:03.115+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:39:04.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:04.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:05.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:05.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:06.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:06.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:07.106 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:07.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:08.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:08.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:08.115 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:39:08.116+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:39:09.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:09.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:10.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:10.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:11.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:11.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:12.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:12.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:13.096 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:13.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:13.116 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:39:13.116+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:39:14.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:14.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:15.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:15.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:16.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:16.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:17.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:17.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:18.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:18.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:18.117 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:39:18.118+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:39:19.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:19.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:20.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:20.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:21.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:21.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:22.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:22.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:23.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:23.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:23.118 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:39:23.119+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:39:24.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:24.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:25.026 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:25.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:26.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:26.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:27.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:27.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:28.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:28.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:28.119 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:39:28.120+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:39:29.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:29.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:30.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:30.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:30.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:30.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:31.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:31.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:32.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:32.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:33.120 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:39:33.121+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:39:33.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:33.870+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:34.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:34.873+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:35.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:35.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:36.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:36.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:37.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:37.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:38.121 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:39:38.121+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:39:38.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:38.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:39.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:39.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:40.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:40.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:41.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:41.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:42.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:42.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:43.122 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:39:43.122+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:39:43.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:43.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:45.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:45.028+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:46.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:46.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:47.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:47.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:48.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:48.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:48.340 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:39:48.123+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:39:49.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:49.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:50.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:50.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:51.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:51.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:52.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:52.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:53.124 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:39:53.125+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:39:53.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:53.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:54.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:54.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:55.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:55.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:56.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:56.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:57.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:57.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:58.125 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:39:58.126+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:39:58.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:58.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:39:59.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:39:59.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:00.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:00.314+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:01.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:01.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:02.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:02.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:03.126 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:40:03.127+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:40:03.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:03.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:04.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:04.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:05.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:05.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:06.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:06.288+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:07.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:07.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:08.127 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:40:08.127+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:40:08.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:08.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:09.230 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:09.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:10.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:10.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:11.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:11.191+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:12.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:12.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:13.128 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:40:13.129+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:40:13.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:13.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:14.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:14.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:15.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:15.185+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:16.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:16.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:17.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:17.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:18.129 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:40:18.130+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:40:18.184 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:18.184+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:19.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:19.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:20.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:20.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:21.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:21.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:22.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:22.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:23.130 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:40:23.130+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:40:23.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:23.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:24.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:24.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:25.279 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:25.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:26.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:26.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:27.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:27.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:28.130 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:40:28.131+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:40:28.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:28.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:29.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:29.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:30.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:30.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:31.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:31.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:32.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:32.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:33.132 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:40:33.132+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:40:33.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:33.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:34.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:34.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:35.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:35.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:36.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:36.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:37.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:37.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:38.133 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:40:38.134+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:40:38.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:38.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:39.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:39.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:40.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:40.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:41.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:41.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:42.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:42.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:43.134 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:40:43.134+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:40:43.344 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:43.344+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:44.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:44.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:45.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:45.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:46.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:46.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:47.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:47.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:48.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:40:48.135+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:40:48.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:48.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:49.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:49.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:50.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:50.310+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:51.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:51.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:52.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:52.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:53.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:40:53.136+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:40:53.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:53.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:54.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:54.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:55.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:55.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:56.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:56.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:57.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:57.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:58.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:40:58.138+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:40:58.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:58.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:40:59.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:40:59.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:00.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:00.235+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:01.192 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:01.193+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:02.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:02.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:03.138 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:41:03.139+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:41:03.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:03.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:04.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:04.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:05.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:05.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:06.089 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:06.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:07.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:07.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:08.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:08.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:08.139 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:41:08.140+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:41:09.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:09.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:10.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:10.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:10.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:10.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:11.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:11.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:12.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:12.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:13.139 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:41:13.140+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:41:14.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:14.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:15.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:15.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:16.046 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:16.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:17.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:17.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:18.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:18.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:18.140 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:41:18.142+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:41:19.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:19.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:19.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:19.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:21.031 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:21.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:21.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:21.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:23.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:23.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:23.141 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:41:23.142+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:41:23.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:23.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:24.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:24.969+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:25.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:25.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:26.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:26.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:27.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:27.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:28.142 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:41:28.142+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:41:28.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:28.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:29.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:29.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:30.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:30.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:31.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:31.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:32.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:32.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:33.143 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:41:33.144+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:41:33.925 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:33.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:34.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:34.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:35.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:35.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:36.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:36.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:37.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:37.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:38.144 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:41:38.145+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:41:39.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:39.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:39.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:39.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:40.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:40.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:41.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:41.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:42.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:42.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:43.145 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:41:43.146+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:41:44.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:44.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:44.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:44.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:45.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:45.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:47.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:47.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:47.967 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:47.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:48.146 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:41:48.147+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:41:48.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:48.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:49.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:49.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:50.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:50.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:51.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:51.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:53.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:53.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:53.147 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:41:53.148+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:41:54.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:54.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:55.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:55.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:56.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:56.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:57.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:57.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:58.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:58.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:41:58.148 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:41:58.149+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:41:59.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:41:59.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:00.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:00.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:01.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:01.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:02.085 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:02.086+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:03.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:03.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:03.149 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:42:03.149+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:42:04.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:04.144+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:05.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:05.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:06.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:06.105+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:07.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:07.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:08.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:08.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:08.150 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:42:08.150+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:42:09.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:09.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:10.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:10.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:11.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:11.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:12.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:12.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:13.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:13.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:13.151 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:42:13.151+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:42:14.075 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:14.076+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:15.074 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:15.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:16.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:16.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:17.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:17.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:18.004 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:18.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:18.152 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:42:18.152+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:42:19.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:19.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:20.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:20.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:21.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:21.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:22.017 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:22.018+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:23.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:23.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:23.153 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:42:23.153+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:42:23.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:23.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:24.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:24.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:25.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:25.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:26.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:26.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:27.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:27.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:28.154 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:42:28.154+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:42:28.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:28.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:29.961 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:29.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:31.003 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:31.004+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:32.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:32.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:33.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:33.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:33.155 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:42:33.155+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:42:34.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:34.040+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:34.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:34.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:35.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:35.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:37.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:37.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:38.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:38.021+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:38.156 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:42:38.156+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:42:38.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:38.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:40.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:40.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:41.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:41.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:42.011 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:42.012+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:43.039 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:43.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:43.156 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:42:43.157+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:42:44.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:44.079+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:45.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:45.092+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:46.141 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:46.142+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:47.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:47.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:48.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:48.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:48.255 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:42:48.158+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:42:49.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:49.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:50.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:50.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:51.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:51.097+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:52.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:52.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:53.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:53.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:53.158 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:42:53.159+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:42:54.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:54.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:55.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:55.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:56.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:56.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:57.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:57.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:58.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:58.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:42:58.159 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:42:58.160+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:42:59.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:42:59.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:00.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:00.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:01.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:01.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:02.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:02.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:03.147 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:03.148+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:03.160 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:43:03.161+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:43:04.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:04.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:05.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:05.187+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:06.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:06.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:07.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:07.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:08.162 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:43:08.162+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:43:08.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:08.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:09.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:09.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:10.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:10.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:11.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:11.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:12.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:12.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:13.162 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:43:13.163+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:43:13.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:13.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:14.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:14.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:15.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:15.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:16.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:16.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:17.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:17.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:18.164 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:43:18.164+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:43:18.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:18.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:19.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:19.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:20.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:20.152+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:21.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:21.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:22.158 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:22.159+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:23.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:23.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:23.165 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:43:23.165+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:43:24.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:24.115+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:25.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:25.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:26.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:26.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:27.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:27.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:28.165 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:43:28.166+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:43:28.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:28.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:29.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:29.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:30.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:30.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:31.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:31.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:32.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:32.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:33.167 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:43:33.167+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:43:33.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:33.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:34.246 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:34.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:35.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:35.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:36.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:36.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:37.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:37.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:38.168 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:43:38.168+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:43:38.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:38.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:39.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:39.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:40.156 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:40.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:41.127 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:41.128+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:42.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:42.109+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:43.139 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:43.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:43.169 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:43:43.169+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:43:44.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:44.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:45.123 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:45.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:46.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:46.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:47.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:47.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:48.048 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:48.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:48.170 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:43:48.170+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:43:49.079 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:49.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:50.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:50.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:51.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:51.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:52.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:52.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:53.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:53.080+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:53.170 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:43:53.171+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:43:54.110 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:54.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:55.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:55.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:56.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:56.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:57.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:57.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:58.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:58.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:43:58.171 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:43:58.172+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:43:59.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:43:59.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:00.145 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:00.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:01.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:01.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:02.152 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:02.153+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:03.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:03.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:03.173 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:44:03.173+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:44:04.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:04.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:05.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:05.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:06.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:06.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:07.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:07.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:08.174 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:44:08.174+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:44:08.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:08.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:09.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:09.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:10.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:10.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:11.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:11.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:12.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:12.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:13.175 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:44:13.175+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:44:13.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:13.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:14.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:14.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:15.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:15.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:16.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:16.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:17.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:17.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:18.175 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:44:18.177+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:44:18.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:18.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:19.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:19.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:20.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:20.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:21.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:21.378+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:22.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:22.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:23.176 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:44:23.178+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:44:23.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:23.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:24.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:24.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:25.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:25.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:26.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:26.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:27.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:27.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:28.177 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:44:28.178+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:44:28.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:28.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:29.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:29.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:30.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:30.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:31.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:31.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:32.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:32.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:33.178 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:44:33.178+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:44:33.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:33.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:34.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:34.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:35.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:35.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:36.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:36.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:37.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:37.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:38.179 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:44:38.179+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:44:38.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:38.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:39.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:39.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:40.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:40.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:41.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:41.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:42.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:42.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:43.180 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:44:43.180+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:44:43.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:43.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:44.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:44.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:45.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:45.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:46.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:46.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:47.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:47.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:48.180 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:44:48.181+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:44:48.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:48.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:49.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:49.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:50.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:50.654+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:51.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:51.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:52.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:52.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:53.182 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:44:53.182+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:44:53.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:53.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:54.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:54.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:55.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:55.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:56.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:56.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:57.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:57.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:58.183 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:44:58.184+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:44:58.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:58.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:44:59.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:44:59.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:00.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:00.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:01.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:01.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:02.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:02.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:03.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:03.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:04.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:04.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:05.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:05.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:06.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:06.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:07.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:07.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:08.185 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:45:08.186+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:45:08.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:08.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:09.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:09.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:10.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:10.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:11.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:11.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:12.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:12.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:13.186 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:45:13.187+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:45:13.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:13.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:14.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:14.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:15.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:15.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:16.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:16.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:17.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:17.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:18.187 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:45:18.187+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:45:18.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:18.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:19.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:19.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:20.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:20.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:21.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:21.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:22.330 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:22.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:23.188 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:45:23.189+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:45:23.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:23.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:24.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:24.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:25.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:25.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:26.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:26.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:27.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:27.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:28.189 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:45:28.189+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:45:28.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:28.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:29.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:29.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:30.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:30.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:31.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:31.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:32.202 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:32.203+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:33.181 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:33.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:33.189 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:45:33.190+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:45:34.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:34.182+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:35.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:35.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:36.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:36.125+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:37.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:37.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:38.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:38.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:38.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:45:38.191+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:45:39.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:39.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:40.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:40.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:41.174 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:41.175+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:42.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:42.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:43.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:45:43.193+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:45:43.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:43.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:44.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:44.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:45.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:45.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:46.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:46.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:47.350 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:47.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:48.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:45:48.193+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:45:48.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:48.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:49.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:49.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:50.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:50.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:51.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:51.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:52.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:52.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:53.194 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:45:53.195+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:45:53.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:53.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:54.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:54.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:55.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:55.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:56.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:56.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:57.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:57.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:58.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:45:58.195+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:45:58.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:58.278+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:45:59.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:45:59.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:00.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:00.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:01.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:01.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:02.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:02.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:03.195 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:46:03.196+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:46:03.287 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:03.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:04.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:04.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:05.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:05.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:06.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:06.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:07.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:07.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:08.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:46:08.197+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:46:08.278 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:08.279+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:09.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:09.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:10.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:10.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:11.275 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:11.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:12.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:12.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:13.198 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:46:13.199+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:46:13.250 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:13.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:14.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:14.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:15.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:15.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:16.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:16.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:17.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:17.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:18.199 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:46:18.199+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:46:18.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:18.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:19.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:19.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:20.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:20.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:21.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:21.350+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:22.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:22.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:23.200 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:46:23.201+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:46:23.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:23.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:24.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:24.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:25.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:25.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:26.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:26.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:27.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:27.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:28.201 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:46:28.201+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:46:28.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:28.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:29.378 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:29.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:30.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:30.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:31.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:31.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:32.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:32.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:33.202 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:46:33.202+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:46:33.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:33.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:34.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:34.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:35.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:35.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:36.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:36.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:37.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:37.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:38.203 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:46:38.203+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:46:38.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:38.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:39.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:39.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:40.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:40.388+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:41.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:41.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:42.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:42.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:43.204 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:46:43.204+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:46:43.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:43.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:44.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:44.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:45.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:45.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:46.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:46.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:47.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:47.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:48.205 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:46:48.205+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:46:48.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:48.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:49.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:49.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:50.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:50.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:51.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:51.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:52.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:52.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:53.205 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:46:53.206+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:46:53.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:53.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:54.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:54.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:55.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:55.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:56.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:56.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:57.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:57.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:58.206 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:46:58.207+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:46:58.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:58.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:46:59.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:46:59.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:00.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:00.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:01.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:01.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:02.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:02.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:03.207 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:47:03.208+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:47:03.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:03.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:04.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:04.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:05.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:05.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:06.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:06.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:07.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:07.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:08.209 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:47:08.209+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:47:08.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:08.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:09.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:09.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:10.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:10.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:11.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:11.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:12.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:12.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:13.210 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:47:13.210+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:47:13.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:13.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:14.630 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:14.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:15.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:15.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:16.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:16.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:17.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:17.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:18.211 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:47:18.212+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:47:18.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:18.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:19.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:19.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:20.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:20.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:21.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:21.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:22.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:22.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:23.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:47:23.213+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:47:23.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:23.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:24.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:24.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:25.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:25.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:26.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:26.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:27.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:27.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:28.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:47:28.214+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:47:28.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:28.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:29.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:29.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:30.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:30.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:31.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:31.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:32.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:32.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:33.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:47:33.215+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:47:33.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:33.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:34.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:34.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:35.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:35.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:36.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:36.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:37.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:37.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:38.214 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:47:38.214+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:47:38.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:38.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:39.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:39.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:40.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:40.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:41.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:41.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:42.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:42.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:43.215 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:47:43.215+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:47:43.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:43.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:44.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:44.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:45.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:45.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:46.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:46.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:47.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:47.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:48.216 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:47:48.217+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:47:48.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:48.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:49.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:49.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:50.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:50.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:51.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:51.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:52.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:52.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:53.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:47:53.218+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:47:53.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:53.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:54.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:54.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:55.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:55.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:56.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:56.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:57.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:57.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:58.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:47:58.218+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:47:58.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:58.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:47:59.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:47:59.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:00.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:00.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:01.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:01.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:02.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:02.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:03.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:48:03.220+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:48:03.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:03.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:04.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:04.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:05.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:05.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:06.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:06.631+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:07.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:07.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:08.220 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:48:08.220+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:48:08.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:08.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:09.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:09.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:10.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:10.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:11.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:11.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:12.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:12.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:13.221 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:48:13.221+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:48:13.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:13.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:14.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:14.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:15.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:15.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:16.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:16.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:17.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:17.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:18.223 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:48:18.223+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:48:18.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:18.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:19.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:19.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:20.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:20.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:21.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:21.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:22.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:22.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:23.223 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:48:23.224+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:48:23.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:23.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:24.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:24.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:25.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:25.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:26.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:26.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:27.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:27.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:28.224 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:48:28.225+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:48:28.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:28.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:29.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:29.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:30.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:30.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:31.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:31.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:32.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:32.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:33.224 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:48:33.225+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:48:33.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:33.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:34.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:34.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:35.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:35.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:36.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:36.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:37.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:37.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:38.226 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:48:38.226+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:48:38.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:38.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:39.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:39.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:40.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:40.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:41.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:41.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:42.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:42.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:43.227 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:48:43.227+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:48:43.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:43.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:44.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:44.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:45.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:45.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:46.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:46.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:47.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:47.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:48.228 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:48:48.229+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:48:48.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:48.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:49.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:49.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:50.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:50.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:51.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:51.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:52.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:52.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:53.229 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:48:53.229+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:48:53.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:53.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:54.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:54.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:55.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:55.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:56.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:56.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:57.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:57.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:58.230 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:48:58.230+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:48:58.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:58.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:48:59.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:48:59.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:00.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:00.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:01.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:01.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:02.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:02.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:03.231 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:49:03.231+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:49:03.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:03.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:04.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:04.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:05.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:05.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:06.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:06.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:07.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:07.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:08.232 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:49:08.233+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:49:08.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:08.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:09.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:09.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:10.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:10.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:11.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:11.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:12.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:12.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:13.232 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:49:13.233+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:49:13.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:13.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:14.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:14.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:15.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:15.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:16.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:16.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:17.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:17.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:18.234 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:49:18.234+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:49:18.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:18.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:19.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:19.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:20.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:20.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:21.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:21.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:22.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:22.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:23.235 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:49:23.235+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:49:23.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:23.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:24.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:24.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:25.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:25.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:26.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:26.649+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:27.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:27.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:28.235 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:49:28.236+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:49:28.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:28.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:29.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:29.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:30.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:30.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:31.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:31.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:32.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:32.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:33.237 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:49:33.237+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:49:33.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:33.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:34.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:34.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:35.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:35.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:36.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:36.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:37.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:37.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:38.238 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:49:38.238+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:49:38.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:38.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:39.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:39.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:40.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:40.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:41.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:41.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:42.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:42.759+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:43.239 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:49:43.239+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:49:43.788 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:43.789+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:44.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:44.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:45.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:45.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:46.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:46.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:47.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:47.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:48.240 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:49:48.240+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:49:48.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:48.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:49.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:49.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:50.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:50.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:51.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:51.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:52.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:52.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:53.241 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:49:53.241+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:49:53.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:53.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:54.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:54.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:55.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:55.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:56.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:56.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:57.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:57.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:58.242 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:49:58.242+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:49:58.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:58.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:49:59.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:49:59.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:00.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:00.946+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:01.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:01.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:02.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:02.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:03.243 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:50:03.243+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:50:03.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:03.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:04.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:04.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:05.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:05.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:06.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:06.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:07.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:07.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:08.243 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:50:08.244+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:50:08.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:08.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:09.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:09.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:10.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:10.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:11.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:11.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:12.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:12.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:13.244 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:50:13.245+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:50:13.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:13.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:14.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:14.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:15.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:15.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:16.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:16.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:17.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:17.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:18.245 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:50:18.246+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:50:18.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:18.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:19.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:19.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:20.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:20.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:21.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:21.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:22.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:22.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:23.246 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:50:23.247+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:50:23.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:23.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:24.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:24.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:25.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:25.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:26.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:26.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:27.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:27.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:28.247 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:50:28.248+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:50:28.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:28.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:29.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:29.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:30.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:30.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:31.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:31.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:32.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:32.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:33.248 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:50:33.249+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:50:33.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:33.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:34.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:34.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:35.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:35.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:36.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:36.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:37.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:37.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:38.249 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:50:38.251+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:50:38.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:38.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:39.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:39.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:40.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:40.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:41.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:41.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:42.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:42.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:43.250 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:50:43.250+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:50:43.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:43.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:44.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:44.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:45.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:45.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:46.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:46.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:47.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:47.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:48.251 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:50:48.251+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:50:48.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:48.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:49.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:49.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:50.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:50.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:51.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:51.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:52.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:52.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:53.252 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:50:53.252+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:50:53.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:53.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:54.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:54.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:55.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:55.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:56.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:56.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:57.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:57.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:58.253 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:50:58.253+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:50:58.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:58.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:50:59.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:50:59.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:00.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:00.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:01.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:01.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:02.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:02.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:03.254 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:51:03.254+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:51:03.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:03.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:04.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:04.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:05.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:05.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:06.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:06.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:07.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:07.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:08.255 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:51:08.256+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:51:08.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:08.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:09.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:09.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:10.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:10.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:11.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:11.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:12.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:12.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:13.256 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:51:13.256+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:51:13.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:13.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:14.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:14.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:15.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:15.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:16.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:16.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:17.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:17.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:18.257 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:51:18.257+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:51:18.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:18.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:19.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:19.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:20.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:20.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:21.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:21.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:22.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:22.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:23.258 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:51:23.258+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:51:23.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:23.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:24.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:24.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:25.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:25.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:26.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:26.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:27.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:27.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:28.259 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:51:28.259+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:51:28.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:28.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:29.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:29.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:30.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:30.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:31.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:31.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:32.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:32.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:33.260 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:51:33.261+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:51:33.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:33.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:34.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:34.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:35.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:35.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:36.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:36.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:37.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:37.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:38.261 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:51:38.261+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:51:38.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:38.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:39.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:39.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:40.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:40.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:41.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:41.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:42.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:42.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:43.262 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:51:43.263+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:51:43.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:43.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:44.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:44.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:45.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:45.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:46.812 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:46.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:47.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:47.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:48.263 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:51:48.264+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:51:48.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:48.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:49.858 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:49.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:50.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:50.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:51.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:51.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:52.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:52.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:53.264 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:51:53.265+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:51:53.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:53.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:54.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:54.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:55.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:55.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:56.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:56.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:57.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:57.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:58.265 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:51:58.265+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:51:58.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:58.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:51:59.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:51:59.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:00.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:00.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:01.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:01.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:02.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:02.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:03.266 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:52:03.266+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:52:03.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:03.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:04.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:04.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:05.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:05.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:06.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:06.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:07.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:07.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:08.267 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:52:08.267+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:52:08.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:08.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:09.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:09.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:10.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:10.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:11.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:11.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:12.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:12.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:13.268 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:52:13.268+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:52:13.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:13.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:14.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:14.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:15.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:15.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:16.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:16.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:17.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:17.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:18.269 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:52:18.270+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:52:18.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:18.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:19.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:19.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:20.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:20.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:21.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:21.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:22.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:22.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:23.270 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:52:23.271+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:52:23.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:23.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:24.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:24.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:25.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:25.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:26.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:26.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:27.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:27.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:28.271 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:52:28.272+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:52:28.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:28.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:29.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:29.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:30.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:30.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:31.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:31.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:32.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:32.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:33.272 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:52:33.273+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:52:33.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:33.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:34.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:34.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:35.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:35.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:36.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:36.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:37.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:37.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:38.273 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:52:38.274+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:52:38.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:38.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:39.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:39.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:40.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:40.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:41.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:41.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:42.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:42.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:43.274 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:52:43.275+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:52:43.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:43.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:44.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:44.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:45.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:45.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:46.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:46.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:47.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:47.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:48.275 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:52:48.275+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:52:48.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:48.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:49.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:49.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:50.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:50.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:51.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:51.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:52.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:52.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:53.276 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:52:53.277+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:52:53.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:53.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:54.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:54.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:55.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:55.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:56.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:56.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:57.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:57.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:58.277 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:52:58.278+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:52:58.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:58.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:52:59.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:52:59.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:00.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:00.430+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:01.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:01.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:02.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:02.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:03.278 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:53:03.279+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:53:03.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:03.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:04.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:04.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:05.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:05.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:06.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:06.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:07.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:07.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:08.279 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:53:08.279+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:53:08.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:08.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:09.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:09.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:10.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:10.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:11.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:11.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:12.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:12.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:13.280 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:53:13.280+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:53:13.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:13.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:14.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:14.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:15.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:15.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:16.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:16.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:17.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:17.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:18.280 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:53:18.281+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:53:18.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:18.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:19.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:19.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:20.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:20.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:21.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:21.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:22.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:22.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:23.281 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:53:23.283+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:53:23.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:23.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:24.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:24.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:25.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:25.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:26.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:26.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:27.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:27.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:28.282 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:53:28.283+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:53:28.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:28.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:29.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:29.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:30.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:30.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:31.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:31.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:32.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:32.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:33.283 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:53:33.284+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:53:33.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:33.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:34.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:34.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:35.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:35.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:36.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:36.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:37.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:37.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:38.284 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:53:38.286+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:53:38.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:38.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:39.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:39.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:40.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:40.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:41.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:41.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:42.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:42.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:43.285 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:53:43.287+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:53:43.299 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:43.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:44.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:44.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:45.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:45.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:46.343 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:46.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:47.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:47.346+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:48.286 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:53:48.287+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:53:48.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:48.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:49.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:49.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:50.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:50.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:51.416 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:51.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:52.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:52.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:53.287 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:53:53.287+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:53:53.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:53.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:54.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:54.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:55.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:55.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:56.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:56.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:57.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:57.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:58.288 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:53:58.289+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:53:58.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:58.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:53:59.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:53:59.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:00.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:00.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:01.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:01.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:02.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:02.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:03.289 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:54:03.290+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:54:03.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:03.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:04.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:04.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:05.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:05.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:06.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:06.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:07.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:07.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:08.290 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:54:08.290+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:54:08.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:08.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:09.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:09.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:10.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:10.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:11.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:11.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:12.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:12.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:13.291 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:54:13.291+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:54:13.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:13.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:14.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:14.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:15.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:15.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:16.693 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:16.694+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:17.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:17.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:18.292 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:54:18.292+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:54:18.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:18.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:19.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:19.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:20.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:20.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:21.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:21.704+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:22.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:22.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:23.293 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:54:23.294+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:54:23.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:23.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:24.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:24.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:25.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:25.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:26.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:26.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:27.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:27.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:28.294 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:54:28.295+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:54:28.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:28.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:29.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:29.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:30.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:30.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:31.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:31.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:32.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:32.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:33.294 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:54:33.295+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:54:33.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:33.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:34.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:34.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:35.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:35.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:36.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:36.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:37.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:37.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:38.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:54:38.296+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:54:38.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:38.763+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:39.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:39.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:40.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:40.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:41.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:41.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:42.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:42.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:43.296 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:54:43.297+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:54:43.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:43.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:44.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:44.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:45.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:45.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:46.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:46.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:47.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:47.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:48.297 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:54:48.298+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:54:48.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:48.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:49.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:49.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:50.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:50.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:51.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:51.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:52.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:52.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:53.299 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:54:53.299+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:54:53.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:53.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:54.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:54.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:55.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:55.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:56.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:56.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:57.913 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:57.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:58.300 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:54:58.301+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:54:58.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:58.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:54:59.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:54:59.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:00.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:00.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:01.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:01.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:02.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:02.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:03.301 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:55:03.302+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:55:03.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:03.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:04.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:04.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:05.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:05.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:06.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:06.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:07.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:07.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:08.302 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:55:08.303+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:55:08.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:08.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:09.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:09.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:11.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:11.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:11.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:11.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:12.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:12.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:13.303 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:55:13.303+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:55:13.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:13.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:14.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:14.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:15.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:15.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:17.010 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:17.011+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:18.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:18.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:18.304 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:55:18.304+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:55:18.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:18.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:19.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:19.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:20.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:20.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:21.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:21.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:22.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:22.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:23.304 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:55:23.305+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:55:24.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:24.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:24.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:24.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:25.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:25.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:26.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:26.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:27.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:27.981+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:28.306 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:55:28.306+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:55:28.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:28.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:30.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:30.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:31.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:31.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:32.058 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:32.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:33.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:33.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:33.306 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:55:33.307+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:55:34.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:34.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:35.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:35.060+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:36.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:36.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:37.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:37.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:38.041 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:38.042+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:38.308 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:55:38.309+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:55:39.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:39.046+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:40.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:40.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:41.077 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:41.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:42.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:42.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:43.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:43.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:43.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:55:43.310+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:55:44.142 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:44.143+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:45.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:45.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:46.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:46.150+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:47.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:47.132+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:48.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:48.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:48.309 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:55:48.311+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:55:49.105 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:49.106+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:50.062 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:50.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:51.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:51.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:52.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:52.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:53.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:53.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:53.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:55:53.311+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:55:54.133 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:54.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:55.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:55.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:56.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:56.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:57.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:57.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:58.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:58.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:55:58.312 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:55:58.313+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:55:59.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:55:59.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:00.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:00.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:01.242 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:01.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:02.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:02.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:03.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:03.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:03.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:56:03.314+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:56:04.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:04.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:05.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:05.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:06.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:06.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:07.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:07.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:08.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:08.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:08.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:56:08.314+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:56:09.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:09.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:10.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:10.172+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:11.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:11.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:12.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:12.174+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:13.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:13.211+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:13.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:56:13.315+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:56:14.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:14.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:15.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:15.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:16.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:16.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:17.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:17.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:18.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:18.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:18.315 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:56:18.316+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:56:19.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:19.292+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:20.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:20.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:21.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:21.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:22.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:22.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:23.293 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:23.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:23.316 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:56:23.317+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:56:24.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:24.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:25.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:25.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:26.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:26.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:27.337 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:27.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:28.318 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:56:28.319+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:56:28.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:28.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:29.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:29.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:30.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:30.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:31.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:31.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:32.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:32.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:33.318 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:56:33.319+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:56:33.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:33.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:34.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:34.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:35.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:35.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:36.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:36.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:37.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:37.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:38.320 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:56:38.320+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:56:38.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:38.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:39.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:39.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:40.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:40.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:41.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:41.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:42.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:42.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:43.320 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:56:43.322+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:56:43.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:43.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:44.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:44.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:45.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:45.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:46.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:46.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:47.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:47.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:48.321 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:56:48.323+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:56:48.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:48.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:49.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:49.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:50.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:50.497+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:51.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:51.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:52.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:52.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:53.322 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:56:53.323+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:56:53.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:53.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:54.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:54.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:55.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:55.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:56.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:56.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:57.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:57.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:58.323 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:56:58.324+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:56:58.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:58.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:56:59.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:56:59.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:00.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:00.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:01.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:01.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:02.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:02.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:03.324 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:57:03.325+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:57:03.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:03.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:04.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:04.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:05.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:05.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:06.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:06.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:07.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:07.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:08.325 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:57:08.326+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:57:08.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:08.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:09.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:09.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:10.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:10.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:11.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:11.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:12.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:12.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:13.326 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:57:13.326+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:57:13.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:13.526+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:14.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:14.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:15.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:15.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:16.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:16.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:17.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:17.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:18.326 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:57:18.327+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:57:18.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:18.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:19.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:19.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:20.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:20.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:21.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:21.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:22.648 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:22.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:23.328 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:57:23.329+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:57:23.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:23.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:24.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:24.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:25.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:25.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:26.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:26.670+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:27.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:27.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:28.329 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:57:28.329+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:57:28.716 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:28.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:29.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:29.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:30.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:30.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:31.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:31.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:32.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:32.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:33.330 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:57:33.330+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:57:33.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:33.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:34.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:34.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:35.882 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:35.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:36.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:36.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:37.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:37.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:38.330 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:57:38.331+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:57:38.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:38.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:39.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:39.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:40.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:40.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:41.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:41.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:42.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:42.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:43.332 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:57:43.332+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:57:43.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:43.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:44.853 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:44.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:45.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:45.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:46.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:46.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:47.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:47.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:48.332 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:57:48.333+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:57:48.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:48.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:49.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:49.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:50.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:50.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:51.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:51.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:52.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:52.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:53.333 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:57:53.334+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:57:53.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:53.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:54.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:54.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:55.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:55.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:56.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:56.808+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:57.847 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:57.848+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:58.335 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:57:58.335+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:57:58.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:58.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:57:59.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:57:59.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:00.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:00.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:01.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:01.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:02.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:02.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:03.336 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:58:03.337+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:58:03.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:03.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:04.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:04.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:05.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:05.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:06.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:06.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:07.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:07.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:08.336 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:58:08.337+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:58:08.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:08.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:09.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:09.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:10.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:10.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:11.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:11.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:12.768 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:12.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:13.338 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:58:13.338+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:58:13.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:13.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:14.778 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:14.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:15.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:15.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:16.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:16.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:17.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:17.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:18.338 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:58:18.339+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:58:18.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:18.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:19.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:19.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:20.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:20.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:21.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:21.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:22.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:22.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:23.339 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:58:23.340+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:58:23.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:23.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:24.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:24.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:25.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:25.712+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:26.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:26.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:27.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:27.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:28.341 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:58:28.342+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:58:28.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:28.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:29.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:29.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:30.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:30.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:31.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:31.725+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:32.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:32.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:33.342 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:58:33.343+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:58:33.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:33.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:34.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:34.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:35.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:35.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:36.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:36.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:37.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:37.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:38.343 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:58:38.343+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:58:38.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:38.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:39.766 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:39.767+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:40.737 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:40.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:41.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:41.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:42.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:42.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:43.343 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:58:43.344+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:58:43.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:43.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:44.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:44.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:45.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:45.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:46.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:46.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:47.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:47.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:48.345 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:58:48.345+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:58:48.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:48.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:49.730 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:49.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:50.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:50.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:51.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:51.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:52.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:52.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:53.346 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:58:53.347+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:58:53.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:53.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:54.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:54.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:55.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:55.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:56.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:56.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:57.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:57.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:58.347 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:58:58.347+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:58:58.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:58.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:58:59.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:58:59.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:00.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:00.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:01.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:01.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:02.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:02.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:03.347 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:59:03.348+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:59:03.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:03.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:04.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:04.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:05.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:05.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:06.840 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:06.841+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:07.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:07.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:08.348 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:59:08.349+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:59:08.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:08.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:09.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:09.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:10.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:10.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:11.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:11.831+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:12.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:12.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:13.350 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:59:13.351+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:59:13.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:13.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:14.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:14.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:15.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:15.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:16.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:16.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:17.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:17.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:18.351 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:59:18.351+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:59:18.827 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:18.828+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:19.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:19.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:20.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:20.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:21.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:21.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:22.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:22.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:23.352 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:59:23.352+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:59:23.896 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:23.897+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:24.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:24.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:25.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:25.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:26.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:26.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:27.979 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:27.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:28.352 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:59:28.353+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:59:29.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:29.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:29.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:29.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:30.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:30.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:31.984 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:31.985+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:33.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:33.008+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:33.353 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:59:33.355+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:59:33.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:33.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:34.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:34.989+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:35.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:35.986+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:36.994 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:36.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:37.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:37.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:38.355 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:59:38.355+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:59:39.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:39.005+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:40.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:40.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:40.990 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:40.991+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:41.975 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:41.976+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:42.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:42.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:43.355 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:59:43.356+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:59:44.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:44.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:44.985 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:44.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:46.020 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:46.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:46.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:46.979+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:47.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:47.960+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:48.356 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:59:48.358+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:59:48.999 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:49.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:49.988 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:49.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:50.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:50.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:51.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:51.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:52.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:52.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:53.357 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:59:53.359+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:59:53.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:53.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:55.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:55.047+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:56.024 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:56.025+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:57.054 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:57.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:58.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:58.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T14:59:58.357 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T14:59:58.358+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T14:59:59.076 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T14:59:59.077+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:00.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:00.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:01.056 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:01.057+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:02.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:02.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:03.100 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:03.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:03.359 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:00:03.360+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:00:04.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:04.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:05.160 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:05.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:06.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:06.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:07.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:07.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:08.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:08.164+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:08.360 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:00:08.361+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:00:09.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:09.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:10.115 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:10.116+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:11.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:11.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:12.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:12.095+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:13.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:13.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:13.361 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:00:13.362+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:00:14.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:14.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:15.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:15.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:16.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:16.069+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:17.073 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:17.074+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:18.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:18.085+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:18.361 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:00:18.362+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:00:19.118 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:19.119+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:20.144 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:20.145+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:21.168 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:21.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:22.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:22.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:23.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:23.205+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:23.362 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:00:23.363+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:00:24.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:24.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:25.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:25.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:26.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:26.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:27.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:27.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:28.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:28.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:28.364 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:00:28.365+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:00:29.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:29.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:30.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:30.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:31.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:31.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:32.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:32.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:33.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:33.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:33.364 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:00:33.365+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:00:34.346 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:34.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:35.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:35.393+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:36.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:36.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:37.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:37.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:38.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:38.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:38.365 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:00:38.366+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:00:39.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:39.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:40.314 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:40.315+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:41.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:41.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:42.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:42.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:43.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:43.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:43.367 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:00:43.367+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:00:44.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:44.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:45.236 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:45.237+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:46.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:46.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:47.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:47.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:48.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:48.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:48.368 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:00:48.369+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:00:49.240 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:49.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:50.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:50.200+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:51.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:51.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:52.201 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:52.202+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:53.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:53.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:53.369 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:00:53.370+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:00:54.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:54.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:55.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:55.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:56.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:56.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:57.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:57.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:58.243 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:58.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:00:58.369 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:00:58.371+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:00:59.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:00:59.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:00.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:00.242+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:01.237 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:01.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:02.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:02.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:03.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:03.299+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:03.371 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:01:03.372+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:01:04.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:04.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:05.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:05.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:06.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:06.301+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:07.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:07.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:08.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:08.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:08.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:01:08.373+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:01:09.268 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:09.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:10.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:10.270+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:11.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:11.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:12.221 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:12.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:13.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:13.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:13.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:01:13.373+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:01:14.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:14.295+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:15.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:15.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:16.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:16.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:17.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:17.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:18.373 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:01:18.374+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:01:18.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:18.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:19.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:19.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:20.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:20.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:21.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:21.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:22.420 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:22.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:23.375 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:01:23.375+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:01:23.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:23.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:24.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:24.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:25.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:25.442+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:26.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:26.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:27.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:27.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:28.376 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:01:28.377+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:01:28.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:28.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:29.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:29.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:30.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:30.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:31.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:31.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:32.371 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:32.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:33.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:33.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:33.376 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:01:33.377+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:01:34.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:34.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:35.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:35.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:36.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:36.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:37.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:37.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:38.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:38.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:38.378 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:01:38.379+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:01:39.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:39.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:40.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:40.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:41.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:41.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:42.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:42.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:43.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:43.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:43.379 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:01:43.379+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:01:44.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:44.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:45.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:45.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:46.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:46.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:47.394 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:47.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:48.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:01:48.381+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:01:48.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:48.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:49.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:49.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:50.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:50.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:51.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:51.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:52.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:52.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:53.381 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:01:53.381+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:01:53.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:53.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:54.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:54.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:55.482 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:55.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:56.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:56.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:57.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:57.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:58.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:01:58.382+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:01:58.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:58.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:01:59.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:01:59.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:00.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:00.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:01.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:01.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:02.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:02.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:03.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:03.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:04.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:04.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:05.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:05.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:06.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:06.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:07.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:07.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:08.384 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:02:08.385+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:02:08.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:08.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:09.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:09.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:10.522 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:10.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:11.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:11.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:12.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:12.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:13.385 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:02:13.385+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:02:13.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:13.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:14.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:14.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:15.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:15.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:16.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:16.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:17.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:17.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:18.386 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:02:18.387+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:02:18.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:18.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:19.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:19.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:20.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:20.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:21.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:21.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:22.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:22.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:23.387 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:02:23.387+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:02:23.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:23.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:24.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:24.447+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:25.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:25.463+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:26.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:26.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:27.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:27.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:28.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:02:28.388+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:02:28.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:28.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:29.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:29.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:30.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:30.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:31.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:31.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:32.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:32.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:33.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:02:33.390+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:02:33.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:33.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:34.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:34.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:35.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:35.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:36.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:36.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:37.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:37.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:38.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:02:38.390+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:02:38.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:38.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:39.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:39.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:40.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:40.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:41.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:41.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:42.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:42.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:43.390 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:02:43.391+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:02:43.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:43.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:44.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:44.657+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:45.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:45.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:46.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:46.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:47.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:47.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:48.392 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:02:48.392+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:02:48.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:48.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:49.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:49.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:50.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:50.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:51.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:51.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:52.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:52.713+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:53.392 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:02:53.394+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:02:53.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:53.752+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:54.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:54.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:55.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:55.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:56.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:56.817+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:57.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:57.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:58.393 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:02:58.395+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:02:58.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:58.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:02:59.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:02:59.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:00.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:00.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:01.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:01.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:02.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:02.896+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:03.394 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:03:03.395+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:03:03.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:03.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:04.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:04.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:05.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:05.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:06.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:06.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:07.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:07.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:08.395 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:03:08.396+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:03:08.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:08.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:09.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:09.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:10.924 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:10.925+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:11.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:11.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:12.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:12.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:13.395 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:03:13.396+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:03:13.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:13.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:14.969 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:14.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:16.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:16.016+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:16.991 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:16.992+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:17.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:17.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:18.397 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:03:18.397+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:03:19.037 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:19.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:20.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:20.034+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:21.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:21.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:22.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:22.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:23.103 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:23.103+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:23.397 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:03:23.398+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:03:24.129 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:24.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:25.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:25.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:26.138 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:26.139+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:27.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:27.100+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:28.132 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:28.133+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:28.399 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:03:28.400+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:03:29.153 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:29.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:30.180 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:30.181+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:31.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:31.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:32.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:32.223+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:33.225 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:33.226+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:33.400 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:03:33.400+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:03:34.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:34.198+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:35.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:35.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:36.205 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:36.206+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:37.175 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:37.176+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:38.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:38.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:38.401 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:03:38.402+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:03:39.113 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:39.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:40.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:40.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:41.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:41.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:42.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:42.056+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:43.097 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:43.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:43.402 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:03:43.403+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:03:44.057 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:44.058+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:45.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:45.038+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:46.040 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:46.041+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:47.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:47.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:48.047 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:48.048+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:48.403 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:03:48.404+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:03:49.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:49.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:50.051 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:50.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:51.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:51.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:52.069 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:52.070+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:53.065 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:53.066+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:53.403 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:03:53.404+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:03:54.088 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:54.089+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:55.125 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:55.126+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:56.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:56.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:57.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:57.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:58.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:58.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:03:58.405 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:03:58.405+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:03:59.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:03:59.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:00.087 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:00.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:01.053 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:01.054+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:02.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:02.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:02.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:02.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:03.405 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:04:03.406+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:04:03.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:03.955+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:04.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:04.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:05.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:05.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:06.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:06.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:07.905 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:07.906+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:08.406 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:04:08.407+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:04:08.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:08.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:09.907 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:09.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:10.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:10.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:11.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:11.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:12.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:12.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:13.407 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:04:13.408+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:04:13.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:13.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:14.915 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:14.915+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:15.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:15.936+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:16.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:16.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:17.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:17.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:18.408 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:04:18.409+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:04:18.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:18.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:19.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:19.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:20.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:20.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:21.947 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:21.948+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:22.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:22.971+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:23.409 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:04:23.410+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:04:23.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:23.923+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:24.894 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:24.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:25.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:25.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:26.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:26.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:27.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:27.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:28.410 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:04:28.411+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:04:28.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:28.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:29.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:29.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:30.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:30.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:31.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:31.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:32.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:32.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:33.411 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:04:33.412+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:04:33.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:33.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:34.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:34.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:35.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:35.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:36.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:36.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:37.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:37.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:38.413 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:04:38.413+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:04:38.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:38.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:39.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:39.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:40.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:40.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:41.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:41.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:42.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:42.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:43.414 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:04:43.414+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:04:43.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:43.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:44.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:44.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:45.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:45.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:46.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:46.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:47.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:47.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:48.415 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:04:48.415+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:04:48.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:48.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:49.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:49.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:50.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:50.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:51.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:51.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:52.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:52.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:53.416 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:04:53.417+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:04:53.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:53.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:54.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:54.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:55.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:55.778+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:56.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:56.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:57.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:57.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:58.417 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:04:58.418+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:04:58.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:58.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:04:59.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:04:59.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:00.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:00.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:01.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:01.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:02.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:02.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:03.417 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:05:03.418+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:05:03.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:03.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:04.713 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:04.714+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:05.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:05.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:06.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:06.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:07.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:07.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:08.419 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:05:08.419+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:05:08.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:08.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:09.695 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:09.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:10.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:10.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:11.631 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:11.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:12.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:12.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:13.420 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:05:13.420+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:05:13.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:13.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:14.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:14.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:15.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:15.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:16.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:16.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:17.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:17.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:18.420 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:05:18.421+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:05:18.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:18.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:19.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:19.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:20.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:20.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:21.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:21.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:22.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:22.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:23.422 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:05:23.423+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:05:23.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:23.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:24.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:24.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:25.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:25.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:26.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:26.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:27.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:27.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:28.422 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:05:28.423+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:05:28.553 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:28.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:29.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:29.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:30.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:30.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:31.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:31.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:32.546 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:32.547+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:33.424 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:05:33.425+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:05:33.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:33.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:34.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:34.525+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:35.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:35.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:36.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:36.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:37.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:37.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:38.425 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:05:38.425+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:05:38.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:38.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:39.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:39.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:40.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:40.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:41.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:41.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:42.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:42.709+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:43.425 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:05:43.426+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:05:43.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:43.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:44.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:44.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:45.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:45.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:46.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:46.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:47.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:47.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:48.427 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:05:48.428+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:05:48.771 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:48.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:49.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:49.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:50.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:50.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:51.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:51.838+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:52.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:52.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:53.428 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:05:53.428+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:05:53.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:53.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:54.887 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:54.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:55.914 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:55.916+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:56.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:56.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:57.923 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:57.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:58.428 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:05:58.430+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:05:58.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:58.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:05:59.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:05:59.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:00.922 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:00.924+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:01.886 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:01.888+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:02.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:02.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:03.429 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:06:03.431+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:06:03.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:03.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:04.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:04.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:05.754 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:05.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:06.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:06.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:07.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:07.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:08.430 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:06:08.431+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:06:08.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:08.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:09.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:09.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:10.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:10.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:11.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:11.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:12.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:12.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:13.431 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:06:13.432+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:06:13.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:13.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:14.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:14.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:15.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:15.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:16.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:16.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:17.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:17.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:18.432 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:06:18.433+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:06:18.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:18.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:19.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:19.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:20.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:20.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:21.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:21.740+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:22.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:22.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:23.433 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:06:23.434+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:06:23.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:23.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:24.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:24.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:25.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:25.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:26.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:26.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:27.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:27.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:28.434 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:06:28.435+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:06:28.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:28.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:29.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:29.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:30.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:30.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:31.897 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:31.898+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:32.869 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:32.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:33.435 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:06:33.436+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:06:33.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:33.892+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:34.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:34.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:35.850 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:35.851+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:36.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:36.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:37.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:37.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:38.436 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:06:38.437+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:06:38.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:38.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:39.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:39.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:40.929 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:40.930+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:41.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:41.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:42.950 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:42.951+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:43.437 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:06:43.438+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:06:43.983 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:43.984+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:44.946 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:44.947+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:45.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:45.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:46.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:46.941+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:47.909 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:47.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:48.438 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:06:48.439+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:06:48.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:48.907+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:49.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:49.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:50.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:50.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:51.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:51.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:52.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:52.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:53.439 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:06:53.440+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:06:53.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:53.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:54.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:54.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:55.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:55.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:56.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:56.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:57.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:57.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:58.440 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:06:58.440+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:06:58.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:58.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:06:59.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:06:59.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:00.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:00.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:01.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:01.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:02.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:02.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:03.440 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:07:03.441+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:07:03.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:03.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:04.855 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:04.856+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:05.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:05.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:06.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:06.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:07.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:07.787+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:08.441 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:07:08.442+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:07:08.794 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:08.795+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:09.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:09.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:10.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:10.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:11.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:11.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:12.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:12.810+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:13.442 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:07:13.443+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:07:13.820 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:13.821+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:14.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:14.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:15.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:15.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:16.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:16.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:17.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:17.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:18.444 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:07:18.444+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:07:18.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:18.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:19.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:19.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:20.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:20.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:21.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:21.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:22.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:22.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:23.444 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:07:23.445+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:07:23.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:23.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:24.750 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:24.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:25.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:25.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:26.744 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:26.745+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:27.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:27.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:28.446 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:07:28.446+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:07:28.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:28.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:29.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:29.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:30.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:30.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:31.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:31.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:32.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:32.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:33.447 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:07:33.448+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:07:33.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:33.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:34.658 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:34.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:35.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:35.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:36.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:36.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:37.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:37.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:38.448 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:07:38.448+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:07:38.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:38.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:39.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:39.688+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:40.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:40.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:41.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:41.675+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:42.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:42.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:43.449 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:07:43.450+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:07:43.740 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:43.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:44.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:44.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:45.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:45.700+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:46.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:46.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:47.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:47.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:48.450 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:07:48.451+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:07:48.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:48.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:49.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:49.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:50.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:50.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:51.663 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:51.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:52.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:52.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:53.450 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:07:53.451+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:07:53.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:53.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:54.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:54.765+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:55.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:55.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:56.761 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:56.762+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:57.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:57.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:58.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:07:58.453+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:07:58.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:58.761+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:07:59.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:07:59.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:00.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:00.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:01.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:01.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:02.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:02.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:03.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:08:03.453+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:08:03.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:03.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:04.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:04.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:05.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:05.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:06.849 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:06.850+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:07.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:07.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:08.453 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:08:08.455+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:08:08.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:08.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:09.857 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:09.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:10.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:10.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:11.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:11.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:12.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:12.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:13.455 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:08:13.456+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:08:13.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:13.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:14.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:14.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:15.817 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:15.818+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:16.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:16.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:17.824 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:17.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:18.455 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:08:18.456+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:08:18.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:18.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:19.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:19.773+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:20.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:20.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:21.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:21.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:22.690 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:22.691+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:23.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:08:23.457+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:08:23.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:23.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:24.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:24.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:25.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:25.718+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:26.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:26.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:27.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:27.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:28.457 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:08:28.458+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:08:28.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:28.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:29.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:29.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:30.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:30.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:31.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:31.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:32.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:32.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:33.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:08:33.460+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:08:33.795 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:33.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:34.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:34.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:35.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:35.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:36.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:36.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:37.688 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:37.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:38.460 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:08:38.461+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:08:38.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:38.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:39.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:39.661+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:40.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:40.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:41.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:41.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:42.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:42.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:43.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:08:43.462+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:08:43.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:43.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:44.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:44.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:45.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:45.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:46.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:46.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:47.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:47.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:48.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:08:48.462+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:08:48.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:48.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:49.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:49.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:50.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:50.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:51.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:51.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:52.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:52.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:53.462 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:08:53.463+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:08:53.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:53.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:54.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:54.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:55.525 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:55.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:56.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:56.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:57.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:57.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:58.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:08:58.465+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:08:58.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:58.503+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:08:59.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:08:59.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:00.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:00.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:01.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:01.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:02.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:02.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:03.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:03.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:03.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:09:03.466+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:09:04.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:04.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:05.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:05.521+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:06.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:06.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:07.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:07.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:08.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:09:08.466+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:09:08.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:08.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:09.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:09.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:10.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:10.564+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:11.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:11.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:12.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:12.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:13.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:09:13.466+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:09:13.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:13.489+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:14.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:14.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:15.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:15.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:16.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:16.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:17.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:17.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:18.467 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:09:18.467+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:09:18.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:18.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:19.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:19.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:20.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:20.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:21.584 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:21.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:22.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:22.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:23.467 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:09:23.468+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:09:23.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:23.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:24.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:24.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:25.704 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:25.705+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:26.743 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:26.744+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:27.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:27.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:28.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:09:28.470+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:09:28.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:28.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:29.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:29.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:30.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:30.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:31.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:31.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:32.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:32.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:33.470 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:09:33.471+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:09:33.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:33.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:34.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:34.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:35.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:35.742+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:36.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:36.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:37.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:37.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:38.470 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:09:38.471+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:09:38.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:38.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:39.670 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:39.671+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:40.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:40.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:41.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:41.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:42.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:42.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:43.472 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:09:43.473+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:09:43.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:43.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:44.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:44.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:45.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:45.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:46.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:46.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:47.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:47.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:48.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:09:48.473+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:09:48.589 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:48.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:49.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:49.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:50.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:50.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:51.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:51.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:52.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:52.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:53.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:09:53.474+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:09:53.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:53.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:54.657 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:54.658+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:55.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:55.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:56.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:56.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:57.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:57.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:58.474 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:09:58.475+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:09:58.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:58.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:09:59.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:09:59.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:00.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:00.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:01.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:01.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:02.654 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:02.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:03.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:10:03.476+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:10:03.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:03.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:04.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:04.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:05.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:05.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:06.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:06.666+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:07.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:07.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:08.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:10:08.477+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:10:08.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:08.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:09.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:09.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:10.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:10.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:11.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:11.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:12.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:12.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:13.477 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:10:13.478+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:10:13.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:13.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:14.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:14.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:15.626 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:15.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:16.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:16.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:17.629 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:17.630+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:18.478 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:10:18.479+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:10:18.597 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:18.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:19.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:19.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:20.619 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:20.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:21.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:21.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:22.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:22.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:23.480 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:10:23.480+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:10:23.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:23.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:24.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:24.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:25.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:25.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:26.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:26.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:27.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:27.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:28.481 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:10:28.482+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:10:28.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:28.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:29.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:29.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:30.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:30.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:31.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:31.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:32.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:32.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:33.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:10:33.482+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:10:33.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:33.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:34.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:34.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:35.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:35.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:36.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:36.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:37.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:37.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:38.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:10:38.483+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:10:38.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:38.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:39.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:39.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:40.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:40.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:41.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:41.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:42.549 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:42.549+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:43.483 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:10:43.484+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:10:43.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:43.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:44.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:44.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:45.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:45.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:46.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:46.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:47.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:47.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:48.484 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:10:48.485+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:10:48.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:48.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:49.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:49.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:50.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:50.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:51.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:51.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:52.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:52.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:53.486 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:10:53.486+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:10:53.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:53.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:54.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:54.626+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:55.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:55.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:56.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:56.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:57.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:57.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:58.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:10:58.487+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:10:58.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:58.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:10:59.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:10:59.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:00.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:00.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:01.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:01.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:02.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:02.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:03.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:11:03.488+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:11:03.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:03.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:04.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:04.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:05.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:05.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:06.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:06.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:07.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:07.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:08.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:08.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:08.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:11:08.489+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:11:09.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:09.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:10.500 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:10.501+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:11.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:11.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:12.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:12.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:13.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:11:13.490+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:11:13.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:13.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:14.541 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:14.542+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:15.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:15.495+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:16.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:16.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:17.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:17.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:18.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:18.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:18.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:11:18.491+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:11:19.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:19.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:20.316 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:20.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:21.289 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:21.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:22.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:22.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:23.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:23.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:23.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:11:23.492+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:11:24.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:24.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:25.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:25.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:26.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:26.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:27.319 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:27.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:28.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:28.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:28.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:11:28.493+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:11:29.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:29.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:30.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:30.318+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:31.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:31.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:32.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:32.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:33.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:33.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:33.493 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:11:33.494+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:11:34.310 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:34.311+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:35.327 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:35.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:36.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:36.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:37.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:37.308+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:38.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:38.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:38.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:11:38.495+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:11:39.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:39.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:40.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:40.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:41.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:41.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:42.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:42.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:43.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:43.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:43.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:11:43.496+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:11:44.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:44.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:45.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:45.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:46.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:46.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:47.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:47.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:48.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:48.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:48.496 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:11:48.497+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:11:49.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:49.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:50.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:50.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:51.399 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:51.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:52.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:52.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:53.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:53.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:53.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:11:53.498+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:11:54.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:54.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:55.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:55.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:56.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:56.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:57.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:57.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:58.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:58.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:11:58.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:11:58.500+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:11:59.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:11:59.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:00.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:00.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:01.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:01.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:02.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:02.452+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:03.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:03.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:03.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:12:03.501+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:12:04.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:04.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:05.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:05.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:06.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:06.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:07.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:07.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:08.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:08.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:08.501 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:12:08.503+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:12:09.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:09.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:10.465 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:10.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:11.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:11.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:12.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:12.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:13.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:13.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:13.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:12:13.502+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:12:14.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:14.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:15.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:15.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:16.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:16.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:17.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:17.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:18.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:12:18.503+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:12:18.583 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:18.584+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:19.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:19.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:20.599 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:20.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:21.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:21.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:22.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:22.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:23.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:12:23.504+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:12:23.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:23.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:24.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:24.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:25.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:25.733+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:26.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:26.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:27.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:27.737+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:28.505 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:12:28.506+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:12:28.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:28.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:29.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:29.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:30.671 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:30.672+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:31.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:31.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:32.702 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:32.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:33.505 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:12:33.506+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:12:33.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:33.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:34.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:34.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:35.787 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:35.788+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:36.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:36.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:37.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:37.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:38.506 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:12:38.507+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:12:38.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:38.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:39.836 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:39.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:40.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:40.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:41.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:41.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:42.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:42.791+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:43.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:12:43.508+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:12:43.781 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:43.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:44.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:44.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:45.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:45.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:46.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:46.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:47.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:47.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:48.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:12:48.509+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:12:48.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:48.859+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:49.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:49.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:50.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:50.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:51.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:51.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:52.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:52.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:53.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:12:53.510+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:12:53.903 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:53.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:54.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:54.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:55.920 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:55.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:56.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:56.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:57.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:57.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:58.510 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:12:58.511+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:12:58.823 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:58.824+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:12:59.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:12:59.785+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:00.767 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:00.768+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:01.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:01.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:02.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:02.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:03.512 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:13:03.512+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:13:03.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:03.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:04.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:04.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:05.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:05.826+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:06.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:06.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:07.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:07.820+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:08.512 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:13:08.513+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:13:08.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:08.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:09.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:09.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:10.832 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:10.833+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:11.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:11.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:12.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:12.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:13.513 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:13:13.514+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:13:13.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:13.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:14.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:14.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:15.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:15.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:16.774 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:16.775+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:17.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:17.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:18.514 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:13:18.515+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:13:18.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:18.781+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:19.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:19.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:20.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:20.784+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:21.753 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:21.754+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:22.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:22.800+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:23.515 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:13:23.516+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:13:23.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:23.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:24.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:24.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:25.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:25.884+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:26.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:26.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:27.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:27.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:28.516 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:13:28.517+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:13:28.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:28.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:29.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:29.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:30.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:30.843+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:31.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:31.854+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:32.839 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:32.840+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:33.518 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:13:33.518+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:13:33.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:33.814+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:34.825 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:34.825+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:35.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:35.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:36.799 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:36.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:37.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:37.793+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:38.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:13:38.520+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:13:38.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:38.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:39.843 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:39.844+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:40.831 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:40.832+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:41.877 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:41.878+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:42.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:42.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:43.520 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:13:43.521+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:13:43.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:43.861+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:44.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:44.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:45.870 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:45.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:46.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:46.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:47.874 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:47.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:48.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:13:48.521+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:13:48.848 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:48.849+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:49.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:49.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:50.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:50.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:51.821 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:51.822+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:52.854 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:52.855+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:53.522 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:13:53.522+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:13:53.891 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:53.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:54.916 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:54.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:55.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:55.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:56.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:56.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:57.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:57.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:58.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:13:58.523+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:13:58.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:58.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:13:59.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:13:59.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:00.921 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:00.921+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:01.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:01.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:02.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:02.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:03.524 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:14:03.524+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:14:03.893 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:03.894+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:04.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:04.876+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:05.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:05.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:06.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:06.866+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:07.883 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:07.883+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:08.525 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:14:08.526+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:14:08.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:08.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:09.834 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:09.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:10.791 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:10.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:11.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:11.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:12.829 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:12.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:13.526 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:14:13.526+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:14:13.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:13.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:14.777 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:14.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:15.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:15.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:16.789 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:16.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:17.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:17.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:18.526 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:14:18.527+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:14:18.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:18.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:19.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:19.715+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:20.752 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:20.753+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:21.708 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:21.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:22.758 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:22.758+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:23.527 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:14:23.528+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:14:23.747 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:23.747+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:24.733 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:24.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:25.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:25.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:26.773 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:26.774+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:27.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:27.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:28.528 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:14:28.529+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:14:28.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:28.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:29.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:29.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:30.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:30.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:31.696 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:31.697+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:32.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:32.680+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:33.530 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:14:33.530+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:14:33.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:33.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:34.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:34.627+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:35.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:35.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:36.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:36.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:37.679 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:37.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:38.531 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:14:38.531+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:14:38.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:38.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:39.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:39.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:40.680 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:40.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:41.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:41.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:42.672 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:42.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:43.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:14:43.532+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:14:43.675 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:43.676+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:44.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:44.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:45.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:45.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:46.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:46.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:47.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:47.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:48.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:14:48.533+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:14:48.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:48.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:49.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:49.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:50.797 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:50.798+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:51.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:51.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:52.867 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:52.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:53.533 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:14:53.534+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:14:53.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:53.836+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:54.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:54.804+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:55.805 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:55.806+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:56.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:56.846+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:57.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:57.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:58.535 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:14:58.535+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:14:58.872 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:58.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:14:59.861 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:14:59.862+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:00.864 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:00.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:01.846 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:01.847+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:02.807 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:02.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:03.536 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:15:03.536+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:15:03.784 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:03.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:04.806 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:04.807+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:05.765 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:05.766+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:06.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:06.750+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:07.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:07.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:08.537 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:15:08.538+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:15:08.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:08.696+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:09.714 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:09.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:10.724 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:10.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:11.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:11.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:12.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:12.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:13.537 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:15:13.539+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:15:13.762 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:13.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:14.810 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:14.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:15.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:15.811+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:16.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:16.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:17.741 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:17.741+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:18.538 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:15:18.539+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:15:18.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:18.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:19.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:19.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:20.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:20.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:21.776 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:21.777+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:22.772 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:22.772+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:23.539 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:15:23.539+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:15:23.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:23.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:24.763 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:24.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:25.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:25.731+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:26.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:26.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:27.726 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:27.727+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:28.540 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:15:28.541+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:15:28.742 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:28.743+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:29.775 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:29.776+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:30.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:30.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:31.779 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:31.779+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:32.793 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:32.794+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:33.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:15:33.541+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:15:33.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:33.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:34.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:34.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:35.818 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:35.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:36.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:36.796+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:37.826 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:37.827+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:38.542 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:15:38.542+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:15:38.838 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:38.839+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:39.804 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:39.805+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:40.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:40.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:41.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:41.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:42.811 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:42.812+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:43.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:15:43.544+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:15:43.764 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:43.764+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:44.719 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:44.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:45.718 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:45.719+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:46.701 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:46.702+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:47.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:47.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:48.544 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:15:48.545+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:15:48.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:48.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:49.676 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:49.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:50.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:50.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:51.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:51.678+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:52.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:52.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:53.545 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:15:53.545+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:15:53.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:53.663+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:54.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:54.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:55.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:55.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:56.692 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:56.693+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:57.667 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:57.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:58.546 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:15:58.546+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:15:58.694 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:58.695+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:15:59.647 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:15:59.648+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:00.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:00.690+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:01.677 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:01.677+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:02.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:02.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:03.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:16:03.547+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:16:03.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:03.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:04.717 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:04.717+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:05.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:05.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:06.705 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:06.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:07.735 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:07.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:08.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:16:08.548+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:16:08.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:08.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:09.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:09.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:10.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:10.729+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:11.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:11.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:12.746 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:12.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:13.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:16:13.549+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:16:13.697 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:13.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:14.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:14.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:15.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:15.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:16.666 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:16.667+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:17.665 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:17.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:18.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:16:18.550+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:16:18.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:18.618+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:19.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:19.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:20.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:20.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:21.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:21.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:22.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:22.600+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:23.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:16:23.551+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:16:23.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:23.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:24.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:24.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:25.617 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:25.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:26.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:26.641+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:27.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:27.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:28.552 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:16:28.552+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:16:28.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:28.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:29.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:29.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:30.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:30.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:31.561 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:31.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:32.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:32.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:33.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:33.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:33.553 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:16:33.553+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:16:34.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:34.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:35.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:35.523+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:36.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:36.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:37.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:37.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:38.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:38.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:38.554 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:16:38.555+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:16:39.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:39.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:40.570 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:40.570+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:41.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:41.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:42.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:42.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:43.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:43.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:43.555 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:16:43.555+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:16:44.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:44.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:45.563 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:45.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:46.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:46.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:47.548 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:47.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:48.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:48.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:48.556 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:16:48.556+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:16:49.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:49.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:50.595 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:50.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:51.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:51.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:52.625 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:52.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:53.557 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:16:53.557+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:16:53.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:53.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:54.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:54.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:55.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:55.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:56.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:56.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:57.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:57.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:58.558 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:16:58.558+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:16:58.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:58.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:16:59.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:16:59.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:00.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:00.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:01.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:01.596+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:02.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:02.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:03.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:03.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:03.559 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:17:03.559+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:17:04.474 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:04.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:05.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:05.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:06.501 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:06.502+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:07.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:07.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:08.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:08.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:08.559 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:17:08.560+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:17:09.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:09.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:10.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:10.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:11.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:11.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:12.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:12.582+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:13.560 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:17:13.561+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:17:13.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:13.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:14.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:14.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:15.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:15.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:16.731 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:16.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:17.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:17.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:18.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:17:18.562+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:17:18.678 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:18.679+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:19.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:19.722+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:20.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:20.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:21.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:21.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:22.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:22.770+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:23.563 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:17:23.563+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:17:23.785 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:23.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:24.816 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:24.816+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:25.814 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:25.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:26.822 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:26.823+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:27.828 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:27.829+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:28.564 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:17:28.564+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:17:28.833 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:28.834+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:29.790 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:29.790+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:30.760 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:30.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:31.711 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:31.711+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:32.729 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:32.730+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:33.565 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:17:33.565+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:17:33.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:33.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:34.745 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:34.746+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:35.748 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:35.748+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:36.770 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:36.771+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:37.736 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:37.736+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:38.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:17:38.566+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:17:38.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:38.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:39.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:39.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:40.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:40.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:41.606 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:41.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:42.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:42.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:43.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:43.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:43.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:17:43.567+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:17:44.489 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:44.490+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:45.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:45.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:46.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:46.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:47.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:47.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:48.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:48.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:48.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:17:48.568+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:17:49.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:49.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:50.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:50.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:51.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:51.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:52.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:52.540+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:53.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:53.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:53.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:17:53.569+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:17:54.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:54.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:55.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:55.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:56.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:56.610+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:57.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:57.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:58.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:58.561+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:17:58.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:17:58.570+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:17:59.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:17:59.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:00.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:00.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:01.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:01.550+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:02.586 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:02.586+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:03.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:18:03.572+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:18:03.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:03.616+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:04.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:04.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:05.580 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:05.580+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:06.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:06.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:07.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:07.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:08.555 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:08.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:08.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:18:08.574+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:18:09.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:09.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:10.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:10.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:11.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:11.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:12.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:12.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:13.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:18:13.574+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:18:13.609 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:13.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:14.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:14.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:15.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:15.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:16.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:16.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:17.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:17.647+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:18.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:18:18.574+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:18:18.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:18.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:19.655 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:19.655+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:20.641 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:20.642+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:21.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:21.606+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:22.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:22.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:23.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:18:23.575+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:18:23.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:23.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:24.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:24.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:25.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:25.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:26.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:26.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:27.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:27.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:28.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:18:28.576+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:18:28.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:28.599+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:29.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:29.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:30.610 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:30.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:31.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:31.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:32.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:32.575+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:33.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:18:33.577+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:18:33.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:33.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:34.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:34.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:35.524 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:35.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:36.535 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:36.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:37.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:37.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:38.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:38.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:38.577 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:18:38.578+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:18:39.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:39.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:40.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:40.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:41.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:41.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:42.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:42.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:43.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:43.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:43.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:18:43.578+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:18:44.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:44.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:45.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:45.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:46.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:46.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:47.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:47.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:48.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:48.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:48.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:18:48.579+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:18:49.469 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:49.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:50.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:50.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:51.433 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:51.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:52.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:52.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:53.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:53.455+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:53.580 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:18:53.580+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:18:54.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:54.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:55.523 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:55.524+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:56.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:56.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:57.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:57.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:58.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:58.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:18:58.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:18:58.582+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:18:59.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:18:59.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:00.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:00.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:01.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:01.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:02.497 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:02.498+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:03.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:03.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:03.582 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:19:03.582+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:19:04.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:04.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:05.596 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:05.597+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:06.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:06.607+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:07.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:07.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:08.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:08.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:08.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:19:08.583+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:19:09.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:09.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:10.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:10.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:11.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:11.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:12.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:12.563+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:13.585 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:19:13.585+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:19:13.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:13.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:14.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:14.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:15.566 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:15.567+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:16.562 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:16.562+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:17.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:17.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:18.585 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:19:18.586+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:19:18.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:18.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:19.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:19.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:20.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:20.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:21.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:21.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:22.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:22.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:23.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:19:23.586+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:19:23.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:23.622+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:24.620 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:24.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:25.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:25.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:26.567 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:26.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:27.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:27.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:28.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:28.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:28.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:19:28.587+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:19:29.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:29.504+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:30.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:30.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:31.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:31.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:32.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:32.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:33.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:33.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:33.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:19:33.588+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:19:34.559 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:34.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:35.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:35.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:36.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:36.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:37.605 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:37.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:38.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:38.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:38.589 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:19:38.589+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:19:39.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:39.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:40.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:40.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:41.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:41.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:42.517 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:42.518+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:43.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:43.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:43.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:19:43.590+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:19:44.481 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:44.481+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:45.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:45.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:46.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:46.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:47.486 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:47.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:48.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:48.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:48.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:19:48.592+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:19:49.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:49.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:50.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:50.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:51.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:51.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:52.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:52.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:53.493 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:53.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:53.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:19:53.593+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:19:54.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:54.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:55.507 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:55.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:56.528 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:56.528+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:57.538 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:57.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:58.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:58.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:19:58.593 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:19:58.593+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:19:59.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:19:59.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:00.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:00.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:01.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:01.566+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:02.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:02.587+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:03.545 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:03.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:03.594 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:20:03.595+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:20:04.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:04.589+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:05.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:05.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:06.542 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:06.543+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:07.547 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:07.548+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:08.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:08.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:08.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:20:08.595+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:20:09.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:09.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:10.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:10.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:11.519 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:11.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:12.568 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:12.568+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:13.539 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:13.539+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:13.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:20:13.597+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:20:14.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:14.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:15.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:15.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:16.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:16.602+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:17.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:17.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:18.587 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:18.588+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:18.597 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:20:18.598+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:20:19.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:19.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:20.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:20.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:21.674 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:21.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:22.707 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:22.708+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:23.598 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:20:23.598+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:20:23.739 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:23.739+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:24.722 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:24.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:25.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:25.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:26.683 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:26.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:27.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:27.683+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:28.599 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:20:28.599+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:20:28.703 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:28.703+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:29.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:29.684+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:30.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:30.637+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:31.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:31.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:32.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:32.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:33.600 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:20:33.600+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:20:33.681 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:33.681+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:34.634 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:34.634+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:35.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:35.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:36.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:36.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:37.565 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:37.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:38.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:38.536+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:38.601 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:20:38.601+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:20:39.578 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:39.578+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:40.560 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:40.560+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:41.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:41.512+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:42.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:42.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:43.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:43.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:43.601 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:20:43.602+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:20:44.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:44.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:45.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:45.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:46.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:46.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:47.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:47.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:48.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:48.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:48.602 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:20:48.603+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:20:49.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:49.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:50.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:50.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:51.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:51.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:52.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:52.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:53.431 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:53.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:53.603 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:20:53.604+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:20:54.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:54.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:55.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:55.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:56.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:56.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:57.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:57.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:58.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:58.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:20:58.604 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:20:58.605+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:20:59.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:20:59.476+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:00.511 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:00.511+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:01.476 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:01.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:02.506 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:02.507+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:03.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:03.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:03.605 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:21:03.606+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:21:04.490 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:04.491+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:05.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:05.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:06.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:06.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:07.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:07.529+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:08.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:08.534+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:08.606 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:21:08.607+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:21:09.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:09.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:10.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:10.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:11.543 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:11.545+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:12.536 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:12.538+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:13.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:13.509+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:13.607 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:21:13.608+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:21:14.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:14.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:15.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:15.546+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:16.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:16.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:17.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:17.614+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:18.588 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:18.590+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:18.608 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:21:18.609+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:21:19.564 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:19.565+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:20.526 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:20.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:21.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:21.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:22.601 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:22.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:23.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:23.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:23.609 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:21:23.609+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:21:24.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:24.611+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:25.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:25.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:26.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:26.593+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:27.581 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:27.581+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:28.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:28.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:28.610 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:21:28.610+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:21:29.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:29.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:30.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:30.559+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:31.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:31.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:32.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:32.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:33.530 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:33.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:33.611 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:21:33.611+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:21:34.579 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:34.579+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:35.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:35.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:36.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:36.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:37.593 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:37.594+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:38.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:38.555+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:38.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:21:38.612+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:21:39.572 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:39.573+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:40.575 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:40.576+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:41.574 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:41.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:42.544 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:42.544+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:43.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:43.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:43.613 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:21:43.613+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:21:44.607 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:44.608+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:45.573 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:45.574+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:46.576 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:46.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:47.556 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:47.556+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:48.552 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:48.553+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:48.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:21:48.615+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:21:49.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:49.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:50.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:50.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:51.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:51.571+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:52.616 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:52.617+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:53.615 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:21:53.616+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:21:53.640 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:53.640+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:54.652 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:54.652+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:55.633 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:55.633+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:56.661 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:56.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:57.684 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:57.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:58.616 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:21:58.616+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:21:58.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:58.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:21:59.651 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:21:59.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:00.649 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:00.650+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:01.614 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:01.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:02.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:02.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:03.590 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:03.591+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:03.617 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:22:03.618+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:22:04.612 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:04.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:05.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:05.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:06.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:06.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:07.687 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:07.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:08.619 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:22:08.619+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:22:08.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:08.707+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:09.738 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:09.738+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:10.732 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:10.732+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:11.725 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:11.726+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:12.728 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:12.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:13.619 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:22:13.620+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:22:13.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:13.734+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:14.783 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:14.783+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:15.808 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:15.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:16.837 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:16.837+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:17.868 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:17.869+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:18.620 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:22:18.620+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:22:18.898 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:18.899+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:19.936 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:19.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:20.927 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:20.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:21.958 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:21.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:22.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:22.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:23.621 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:22:23.621+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:22:23.959 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:23.959+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:24.974 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:24.975+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:26.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:26.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:27.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:27.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:28.025 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:28.026+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:28.621 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:22:28.622+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:22:29.036 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:29.037+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:29.997 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:29.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:31.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:31.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:31.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:31.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:32.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:32.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:33.623 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:22:33.623+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:22:33.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:33.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:35.044 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:35.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:36.082 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:36.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:37.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:37.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:38.001 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:38.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:38.624 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:22:38.624+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:22:39.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:39.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:40.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:40.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:41.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:41.029+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:42.006 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:42.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:42.998 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:42.999+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:43.625 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:22:43.625+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:22:44.000 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:44.001+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:44.992 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:44.993+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:45.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:45.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:46.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:46.965+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:47.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:47.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:48.626 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:22:48.627+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:22:49.030 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:49.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:50.071 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:50.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:51.043 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:51.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:52.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:52.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:52.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:52.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:53.627 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:22:53.627+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:22:53.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:53.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:55.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:55.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:56.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:56.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:57.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:57.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:58.064 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:58.065+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:22:58.628 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:22:58.628+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:22:59.095 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:22:59.096+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:00.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:00.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:01.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:01.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:02.070 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:02.071+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:03.093 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:03.093+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:03.629 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:23:03.630+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:23:04.060 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:04.061+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:05.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:05.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:05.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:05.996+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:06.981 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:06.982+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:08.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:08.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:08.630 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:23:08.630+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:23:09.063 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:09.063+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:10.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:10.107+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:11.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:11.141+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:12.111 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:12.111+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:13.119 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:13.120+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:13.631 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:23:13.631+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:23:14.104 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:14.104+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:15.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:15.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:16.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:16.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:17.134 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:17.134+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:18.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:18.155+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:18.632 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:23:18.632+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:23:19.151 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:19.151+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:20.126 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:20.127+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:21.091 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:21.091+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:22.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:22.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:23.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:23.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:23.633 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:23:23.633+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:23:24.131 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:24.131+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:25.083 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:25.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:26.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:26.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:27.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:27.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:28.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:28.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:28.634 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:23:28.634+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:23:28.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:28.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:29.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:29.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:30.953 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:30.953+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:31.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:31.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:32.978 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:32.978+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:33.635 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:23:33.635+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:23:33.995 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:33.995+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:35.019 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:35.019+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:36.007 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:36.007+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:37.023 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:37.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:38.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:38.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:38.636 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:23:38.636+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:23:39.055 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:39.055+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:40.068 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:40.068+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:41.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:41.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:42.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:42.072+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:43.061 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:43.062+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:43.637 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:23:43.637+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:23:44.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:44.049+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:45.005 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:45.006+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:46.014 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:46.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:46.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:46.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:47.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:47.929+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:48.638 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:23:48.638+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:23:48.944 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:48.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:49.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:49.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:50.949 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:50.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:51.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:51.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:53.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:53.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:53.639 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:23:53.639+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:23:54.035 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:54.036+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:55.015 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:55.015+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:56.059 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:56.059+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:57.027 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:57.027+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:58.038 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:58.039+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:23:58.640 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:23:58.640+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:23:59.045 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:23:59.045+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:00.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:00.014+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:01.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:01.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:01.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:01.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:02.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:02.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:03.641 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:24:03.641+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:24:03.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:03.900+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:04.942 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:04.942+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:05.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:05.926+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:06.889 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:06.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:07.881 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:07.882+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:08.641 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:24:08.643+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:24:08.884 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:08.885+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:09.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:09.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:10.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:10.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:11.873 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:11.874+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:12.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:12.858+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:13.642 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:24:13.643+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:24:13.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:13.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:14.859 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:14.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:15.880 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:15.881+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:16.906 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:16.908+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:17.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:17.932+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:18.643 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:24:18.644+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:24:18.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:18.914+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:19.878 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:19.880+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:20.876 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:20.877+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:21.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:21.867+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:22.866 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:22.868+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:23.644 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:24:23.644+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:24:23.856 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:23.857+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:24.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:24.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:25.912 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:25.913+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:26.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:26.871+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:27.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:27.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:28.645 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:24:28.645+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:24:28.863 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:28.864+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:29.892 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:29.893+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:30.902 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:30.903+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:31.900 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:31.901+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:32.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:32.918+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:33.646 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:24:33.647+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:24:33.937 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:33.937+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:34.904 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:34.904+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:35.930 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:35.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:36.939 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:36.939+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:37.938 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:37.938+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:38.647 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:24:38.647+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:24:38.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:38.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:39.960 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:39.961+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:40.966 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:40.967+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:41.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:41.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:42.951 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:42.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:43.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:24:43.648+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:24:43.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:43.973+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:44.980 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:44.980+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:45.986 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:45.987+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:46.976 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:46.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:47.982 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:47.983+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:48.649 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:24:48.650+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:24:48.970 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:48.970+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:49.945 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:49.945+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:50.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:50.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:51.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:51.934+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:52.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:52.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:53.650 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:24:53.651+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:24:53.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:53.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:54.955 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:54.956+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:55.972 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:55.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:56.963 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:56.963+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:57.962 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:57.962+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:58.651 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:24:58.651+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:24:58.968 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:58.968+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:24:59.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:24:59.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:00.919 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:00.920+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:01.911 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:01.912+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:02.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:02.890+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:03.652 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:25:03.652+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:25:03.875 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:03.875+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:04.835 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:04.835+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:05.813 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:05.813+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:06.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:06.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:07.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:07.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:08.653 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:25:08.653+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:25:08.865 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:08.865+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:09.908 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:09.909+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:10.940 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:10.940+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:11.948 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:11.949+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:12.989 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:12.990+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:13.654 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:25:13.654+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:25:14.032 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:14.032+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:15.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:15.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:16.078 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:16.078+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:17.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:17.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:18.170 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:18.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:18.655 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:25:18.655+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:25:19.204 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:19.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:20.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:20.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:21.276 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:21.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:22.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:22.267+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:23.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:23.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:23.656 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:25:23.656+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:25:24.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:24.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:25.265 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:25.265+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:26.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:26.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:27.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:27.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:28.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:28.283+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:28.657 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:25:28.657+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:25:29.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:29.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:30.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:30.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:31.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:31.343+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:32.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:32.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:33.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:33.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:33.658 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:25:33.659+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:25:34.487 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:34.487+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:35.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:35.485+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:36.531 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:36.531+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:37.550 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:37.551+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:38.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:38.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:38.659 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:25:38.660+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:25:39.518 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:39.519+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:40.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:40.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:41.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:41.499+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:42.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:42.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:43.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:43.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:43.660 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:25:43.660+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:25:44.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:44.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:45.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:45.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:46.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:46.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:47.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:47.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:48.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:48.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:48.661 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:25:48.661+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:25:49.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:49.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:50.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:50.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:51.494 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:51.494+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:52.463 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:52.464+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:53.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:53.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:53.662 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:25:53.662+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:25:54.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:54.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:55.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:55.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:56.520 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:56.520+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:57.505 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:57.506+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:58.513 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:58.514+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:25:58.663 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:25:58.663+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:25:59.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:25:59.473+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:00.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:00.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:01.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:01.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:02.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:02.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:03.387 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:03.387+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:03.664 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:26:03.664+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:26:04.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:04.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:05.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:05.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:06.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:06.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:07.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:07.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:08.308 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:08.309+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:08.665 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:26:08.666+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:26:09.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:09.329+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:10.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:10.371+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:11.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:11.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:12.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:12.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:13.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:13.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:13.666 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:26:13.666+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:26:14.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:14.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:15.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:15.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:16.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:16.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:17.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:17.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:18.450 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:18.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:18.667 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:26:18.668+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:26:19.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:19.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:20.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:20.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:21.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:21.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:22.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:22.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:23.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:23.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:23.668 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:26:23.669+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:26:24.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:24.374+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:25.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:25.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:26.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:26.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:27.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:27.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:28.437 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:28.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:28.669 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:26:28.669+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:26:29.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:29.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:30.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:30.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:31.347 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:31.347+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:32.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:32.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:33.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:33.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:33.670 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:26:33.670+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:26:34.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:34.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:35.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:35.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:36.294 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:36.294+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:37.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:37.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:38.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:38.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:38.671 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:26:38.671+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:26:39.312 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:39.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:40.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:40.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:41.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:41.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:42.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:42.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:43.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:43.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:43.672 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:26:43.672+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:26:44.311 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:44.312+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:45.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:45.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:46.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:46.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:47.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:47.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:48.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:48.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:48.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:26:48.674+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:26:49.381 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:49.381+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:50.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:50.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:51.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:51.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:52.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:52.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:53.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:53.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:53.674 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:26:53.674+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:26:54.428 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:54.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:55.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:55.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:56.380 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:56.380+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:57.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:57.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:58.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:58.368+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:26:58.675 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:26:58.675+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:26:59.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:26:59.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:00.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:00.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:01.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:01.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:02.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:02.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:03.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:03.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:03.676 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:27:03.676+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:27:04.328 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:04.328+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:05.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:05.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:06.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:06.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:07.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:07.286+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:08.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:08.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:08.677 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:27:08.677+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:27:09.315 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:09.316+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:10.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:10.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:11.354 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:11.354+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:12.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:12.372+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:13.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:13.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:13.678 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:27:13.678+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:27:14.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:14.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:15.468 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:15.469+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:16.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:16.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:17.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:17.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:18.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:18.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:18.678 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:27:18.680+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:27:19.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:19.453+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:20.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:20.411+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:21.442 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:21.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:22.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:22.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:23.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:23.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:23.679 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:27:23.680+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:27:24.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:24.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:25.375 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:25.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:26.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:26.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:27.340 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:27.341+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:28.306 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:28.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:28.680 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:27:28.680+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:27:29.274 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:29.275+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:30.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:30.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:31.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:31.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:32.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:32.291+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:33.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:33.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:33.681 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:27:33.682+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:27:34.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:34.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:35.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:35.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:36.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:36.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:37.234 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:37.234+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:38.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:38.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:38.682 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:27:38.683+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:27:39.223 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:39.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:40.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:40.248+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:41.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:41.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:42.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:42.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:43.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:43.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:43.683 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:27:43.683+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:27:44.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:44.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:45.379 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:45.379+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:46.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:46.399+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:47.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:47.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:48.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:48.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:48.684 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:27:48.685+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:27:49.388 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:49.389+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:50.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:50.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:51.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:51.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:52.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:52.423+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:53.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:53.436+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:53.685 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:27:53.686+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:27:54.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:54.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:55.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:55.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:56.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:56.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:57.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:57.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:58.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:58.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:27:58.686 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:27:58.686+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:27:59.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:27:59.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:00.516 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:00.517+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:01.496 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:01.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:02.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:02.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:03.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:03.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:03.687 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:28:03.688+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:28:04.430 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:04.431+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:05.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:05.427+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:06.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:06.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:07.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:07.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:08.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:08.420+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:08.688 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:28:08.688+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:28:09.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:09.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:10.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:10.459+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:11.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:11.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:12.483 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:12.483+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:13.495 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:13.496+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:13.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:28:13.689+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:28:14.529 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:14.530+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:15.499 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:15.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:16.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:16.467+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:17.426 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:17.426+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:18.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:18.450+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:18.690 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:28:18.691+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:28:19.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:19.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:20.466 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:20.466+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:21.438 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:21.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:22.485 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:22.486+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:23.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:23.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:23.691 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:28:23.691+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:28:24.491 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:24.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:25.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:25.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:26.477 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:26.477+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:27.453 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:27.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:28.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:28.443+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:28.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:28:28.692+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:28:29.412 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:29.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:30.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:30.403+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:31.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:31.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:32.386 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:32.386+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:33.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:33.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:33.693 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:28:33.693+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:28:34.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:34.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:35.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:35.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:36.383 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:36.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:37.341 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:37.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:38.366 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:38.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:38.694 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:28:38.694+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:28:39.403 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:39.404+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:40.408 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:40.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:41.456 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:41.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:42.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:42.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:43.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:43.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:43.695 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:28:43.695+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:28:44.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:44.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:45.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:45.433+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:46.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:46.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:47.373 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:47.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:48.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:48.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:48.696 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:28:48.696+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:28:49.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:49.353+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:50.392 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:50.392+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:51.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:51.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:52.338 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:52.338+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:53.325 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:53.325+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:53.697 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:28:53.697+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:28:54.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:54.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:55.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:55.369+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:56.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:56.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:57.369 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:57.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:58.396 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:58.396+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:28:58.698 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:28:58.698+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:28:59.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:28:59.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:00.462 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:00.462+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:01.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:01.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:02.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:02.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:03.440 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:03.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:03.699 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:29:03.699+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:29:04.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:04.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:05.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:05.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:06.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:06.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:07.449 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:07.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:08.422 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:08.422+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:08.700 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:29:08.701+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:29:09.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:09.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:10.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:10.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:11.444 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:11.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:12.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:12.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:13.475 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:13.475+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:13.701 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:29:13.701+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:29:14.473 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:14.474+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:15.446 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:15.446+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:16.423 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:16.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:17.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:17.415+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:18.384 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:18.384+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:18.702 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:29:18.703+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:29:19.357 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:19.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:20.322 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:20.322+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:21.360 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:21.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:22.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:22.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:23.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:23.362+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:23.703 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:29:23.703+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:29:24.411 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:24.412+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:25.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:25.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:26.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:26.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:27.435 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:27.435+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:28.432 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:28.432+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:28.704 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:29:28.705+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:29:29.479 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:29.479+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:30.472 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:30.472+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:31.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:31.440+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:32.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:32.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:33.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:33.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:33.705 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:29:33.705+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:29:34.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:34.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:35.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:35.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:36.429 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:36.429+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:37.397 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:37.397+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:38.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:38.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:38.706 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:29:38.706+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:29:39.377 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:39.377+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:40.364 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:40.364+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:41.345 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:41.345+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:42.296 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:42.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:43.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:43.323+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:43.707 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:29:43.707+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:29:44.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:44.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:45.352 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:45.352+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:46.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:46.339+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:47.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:47.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:48.318 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:48.319+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:48.708 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:29:48.709+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:29:49.335 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:49.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:50.295 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:50.296+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:51.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:51.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:52.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:52.222+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:53.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:53.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:53.709 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:29:53.709+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:29:54.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:54.216+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:55.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:55.213+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:56.207 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:56.207+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:57.188 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:57.189+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:58.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:58.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:29:58.710 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:29:58.710+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:29:59.193 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:29:59.194+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:00.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:00.166+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:01.163 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:01.163+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:02.155 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:02.156+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:03.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:03.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:03.711 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:30:03.712+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:30:04.137 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:04.138+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:05.116 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:05.117+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:06.090 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:06.090+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:07.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:07.098+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:08.124 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:08.124+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:08.712 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:30:08.712+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:30:09.094 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:09.094+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:10.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:10.123+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:11.157 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:11.158+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:12.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:12.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:13.164 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:13.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:13.713 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:30:13.713+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:30:14.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:14.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:15.239 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:15.240+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:16.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:16.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:17.241 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:17.243+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:18.219 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:18.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:18.714 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:30:18.715+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:30:19.222 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:19.224+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:20.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:20.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:21.270 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:21.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:22.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:22.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:23.281 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:23.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:23.714 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:30:23.716+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:30:24.323 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:24.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:25.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:25.359+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:26.374 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:26.375+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:27.353 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:27.355+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:28.389 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:28.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:28.715 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:30:28.715+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:30:29.425 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:29.425+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:30.376 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:30.376+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:31.363 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:31.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:32.333 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:32.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:33.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:33.336+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:33.716 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:30:33.716+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:30:34.367 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:34.367+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:35.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:35.334+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:36.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:36.304+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:37.334 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:37.335+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:38.331 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:38.331+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:38.717 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:30:38.717+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:30:39.317 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:39.317+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:40.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:40.332+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:41.329 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:41.330+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:42.361 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:42.361+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:43.339 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:43.340+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:43.718 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:30:43.718+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:30:44.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:44.366+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:45.414 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:45.414+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:46.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:46.400+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:47.417 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:47.417+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:48.457 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:48.457+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:48.719 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:30:48.720+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:30:49.470 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:49.470+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:50.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:50.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:51.478 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:51.478+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:52.508 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:52.508+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:53.514 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:53.515+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:53.720 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:30:53.720+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:30:54.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:54.532+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:55.504 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:55.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:56.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:56.492+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:57.467 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:57.468+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:58.427 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:58.428+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:30:58.721 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:30:58.721+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:30:59.458 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:30:59.458+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:00.443 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:00.444+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:01.415 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:01.416+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:02.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:02.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:03.436 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:03.437+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:03.722 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:31:03.722+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:31:04.409 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:04.409+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:05.391 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:05.391+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:06.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:06.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:07.365 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:07.365+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:08.349 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:08.349+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:08.723 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:31:08.723+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:31:09.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:09.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:10.348 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:10.348+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:11.356 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:11.357+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:12.390 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:12.390+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:13.410 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:13.410+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:13.724 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:31:13.724+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:31:14.421 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:14.421+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:15.451 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:15.451+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:16.419 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:16.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:17.400 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:17.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:18.355 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:18.356+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:18.725 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:31:18.725+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:31:19.372 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:19.373+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:20.405 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:20.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:21.385 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:21.385+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:22.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:22.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:23.351 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:23.351+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:23.726 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:31:23.726+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:31:24.342 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:24.342+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:25.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:25.327+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:26.332 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:26.333+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:27.358 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:27.358+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:28.393 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:28.394+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:28.727 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:31:28.727+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:31:29.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:29.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:30.434 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:30.434+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:31.471 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:31.471+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:32.510 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:32.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:33.521 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:33.522+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:33.728 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:31:33.729+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:31:34.509 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:34.510+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:35.492 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:35.493+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:36.484 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:36.484+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:37.480 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:37.480+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:38.448 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:38.449+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:38.729 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:31:38.729+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:31:39.447 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:39.448+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:40.424 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:40.424+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:41.461 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:41.461+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:42.460 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:42.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:43.441 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:43.441+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:43.730 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:31:43.731+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:31:44.459 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:44.460+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:45.418 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:45.419+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:46.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:46.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:47.402 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:47.402+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:48.359 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:48.360+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:48.731 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:31:48.731+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:31:49.336 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:49.337+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:50.320 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:50.320+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:51.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:51.280+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:52.313 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:52.313+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:53.271 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:53.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:53.732 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:31:53.732+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:31:54.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:54.273+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:55.235 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:55.236+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:56.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:56.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:57.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:57.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:58.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:58.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:31:58.733 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:31:58.733+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:31:59.247 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:31:59.247+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:00.218 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:00.219+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:01.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:01.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:02.231 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:02.231+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:03.210 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:03.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:03.734 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:32:03.734+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:32:04.213 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:04.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:05.217 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:05.218+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:06.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:06.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:07.251 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:07.251+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:08.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:08.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:08.735 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:32:08.735+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:32:09.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:09.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:10.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:10.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:11.257 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:11.257+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:12.254 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:12.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:13.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:13.220+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:13.736 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:32:13.736+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:32:14.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:14.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:15.252 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:15.252+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:16.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:16.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:17.307 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:17.307+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:18.282 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:18.282+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:18.737 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:32:18.738+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:32:19.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:19.239+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:20.272 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:20.271+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:21.285 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:21.285+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:22.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:22.253+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:23.283 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:23.284+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:23.738 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:32:23.738+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:32:24.324 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:24.324+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:25.280 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:25.281+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:26.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:26.297+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:27.321 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:27.321+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:28.277 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:28.277+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:28.739 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:32:28.739+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:32:29.248 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:29.249+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:30.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:30.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:31.263 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:31.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:32.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:32.255+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:33.292 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:33.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:33.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:32:33.740+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:32:34.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:34.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:35.273 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:35.274+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:36.269 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:36.269+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:37.303 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:37.303+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:38.302 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:38.302+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:38.741 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:32:38.741+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:32:39.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:39.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:40.233 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:40.233+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:41.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:41.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:42.189 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:42.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:43.185 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:43.186+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:43.742 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:32:43.742+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:32:44.195 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:44.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:45.179 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:45.179+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:46.165 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:46.165+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:47.182 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:47.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:48.140 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:48.140+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:48.743 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:32:48.743+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:32:49.102 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:49.102+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:50.130 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:50.130+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:51.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:51.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:52.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:52.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:53.099 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:53.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:53.744 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:32:53.744+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:32:54.114 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:54.114+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:55.107 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:55.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:56.084 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:56.084+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:57.052 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:57.053+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:58.008 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:58.009+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:58.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:32:58.745+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:32:58.971 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:58.972+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:32:59.956 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:32:59.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:00.934 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:00.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:01.952 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:01.952+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:02.931 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:02.931+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:03.746 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:33:03.746+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:33:03.895 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:03.895+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:04.851 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:04.852+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:05.842 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:05.842+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:06.815 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:06.815+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:07.802 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:07.802+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:08.746 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:33:08.747+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:33:08.852 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:08.853+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:09.890 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:09.891+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:10.860 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:10.860+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:11.879 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:11.879+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:12.885 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:12.886+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:13.748 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:33:13.748+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:33:13.928 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:13.928+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:14.973 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:14.974+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:16.021 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:16.022+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:17.042 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:17.043+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:18.081 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:18.082+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:18.749 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:33:18.749+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:33:19.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:19.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:20.101 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:20.101+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:21.072 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:21.073+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:22.029 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:22.031+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:22.993 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:22.994+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:23.749 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:33:23.751+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:33:24.018 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:24.020+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:25.012 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:25.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:26.050 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:26.051+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:27.034 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:27.035+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:27.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:27.998+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:28.750 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:33:28.751+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:33:29.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:29.003+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:30.016 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:30.017+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:30.996 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:30.997+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:32.022 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:32.023+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:33.002 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:33.002+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:33.751 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:33:33.751+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:33:33.987 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:33.988+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:35.033 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:35.033+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:36.080 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:36.081+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:37.108 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:37.108+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:38.122 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:38.122+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:38.751 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:33:38.752+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:33:39.109 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:39.110+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:40.112 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:40.112+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:41.128 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:41.129+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:42.086 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:42.087+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:43.098 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:43.099+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:43.752 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:33:43.753+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:33:44.121 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:44.121+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:45.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:45.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:46.214 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:46.214+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:47.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:47.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:48.227 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:48.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:48.753 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:33:48.754+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:33:49.190 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:49.190+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:50.146 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:50.147+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:51.161 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:51.161+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:52.183 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:52.183+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:53.187 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:53.188+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:53.754 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:33:53.755+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:33:54.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:54.229+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:55.194 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:55.195+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:56.171 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:56.171+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:57.154 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:57.154+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:58.166 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:58.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:33:58.755 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:33:58.756+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:33:59.136 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:33:59.137+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:00.149 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:00.149+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:01.197 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:01.197+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:02.159 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:02.160+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:03.199 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:03.199+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:03.757 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:34:03.757+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:34:04.177 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:04.177+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:04.844 INFO:tasks.ceph.cluster1.osd.2.gibba022.stderr:2021-11-21T15:34:04.844+0000 7fb5c8707700 -1 reset not still connected to 0x5596d1d90410 2021-11-21T15:34:05.169 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:05.169+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:06.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:06.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:07.220 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:07.221+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:08.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:08.245+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:08.758 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:34:08.758+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:34:09.224 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:09.225+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:10.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:10.260+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:11.228 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:11.228+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:12.215 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:12.215+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:13.212 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:13.212+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:13.759 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:34:13.759+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:34:14.229 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:14.230+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:15.255 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:15.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:16.298 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:16.298+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:17.305 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:17.306+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:18.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:18.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:18.760 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:34:18.760+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:34:19.261 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:19.262+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:20.288 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:20.289+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:21.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:21.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:22.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:22.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:23.260 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:23.261+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:23.761 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:34:23.761+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:34:24.262 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:24.263+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:25.264 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:25.264+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:26.286 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:26.287+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:27.267 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:27.268+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:28.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:28.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:28.762 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:34:28.762+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:34:29.297 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:29.293+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:30.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:30.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:31.203 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:31.204+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:32.167 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:32.167+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:33.173 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:33.173+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:33.763 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:34:33.763+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:34:34.196 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:34.196+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:35.216 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:35.217+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:36.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:36.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:37.253 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:37.254+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:38.290 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:38.290+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:38.764 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:34:38.764+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:34:39.245 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:39.246+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:40.256 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:40.256+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:41.238 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:41.238+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:42.200 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:42.201+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:43.209 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:43.210+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:43.765 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:34:43.765+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:34:44.244 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:44.244+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:45.258 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:45.258+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:46.259 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:46.259+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:47.300 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:47.300+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:48.304 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:48.305+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:48.766 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:34:48.766+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:34:49.326 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:49.326+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:50.370 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:50.370+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:51.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:51.408+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:52.398 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:52.398+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:53.362 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:53.363+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:53.767 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:34:53.767+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:34:54.406 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:54.406+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:55.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:55.382+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:56.395 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:56.395+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:57.404 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:57.405+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:58.439 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:58.439+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:34:58.768 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:34:58.768+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:34:59.455 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:34:59.456+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:00.445 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:00.445+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:01.407 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:01.407+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:02.382 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:02.383+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:03.401 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:03.401+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:03.769 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:35:03.769+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:35:04.413 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:04.413+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:05.454 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:05.454+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:06.488 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:06.488+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:07.537 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:07.537+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:08.527 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:08.527+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:08.770 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:35:08.770+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:35:09.533 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:09.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:10.557 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:10.557+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:11.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:11.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:12.598 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:12.598+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:13.644 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:13.644+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:13.771 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:35:13.772+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:35:14.613 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:14.613+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:15.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:15.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:16.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:16.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:17.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:17.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:18.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:18.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:18.772 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:35:18.772+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:35:19.643 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:19.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:20.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:20.664+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:21.628 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:21.629+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:22.627 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:22.628+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:23.582 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:23.583+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:23.773 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:35:23.773+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:35:24.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:24.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:25.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:25.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:26.600 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:26.601+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:27.632 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:27.632+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:28.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:28.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:28.773 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:35:28.774+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:35:29.569 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:29.569+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:30.534 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:30.535+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:31.558 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:31.558+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:32.585 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:32.585+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:33.611 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:33.612+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:33.774 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:35:33.775+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:35:34.621 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:34.621+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:35.653 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:35.653+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:36.635 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:36.635+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:37.638 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:37.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:38.591 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:38.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:38.775 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:35:38.776+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:35:39.615 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:39.615+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:40.639 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:40.639+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:41.656 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:41.656+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:42.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:42.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:43.669 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:43.669+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:43.777 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:35:43.777+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:35:44.636 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:44.636+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:45.659 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:45.659+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:46.622 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:46.623+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:47.642 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:47.643+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:48.623 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:48.624+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:48.778 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:35:48.778+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:35:49.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:49.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:50.645 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:50.645+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:51.660 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:51.660+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:52.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:52.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:53.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:53.687+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:53.778 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:35:53.779+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:35:54.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:54.724+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:55.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:55.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:56.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:56.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:57.786 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:57.786+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:58.780 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:35:58.780+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:35:58.798 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:58.799+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:35:59.792 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:35:59.792+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:00.830 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:00.830+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:01.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:01.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:02.803 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:02.803+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:03.757 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:03.757+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:03.780 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:36:03.781+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:36:04.759 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:04.760+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:05.727 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:05.728+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:06.691 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:06.692+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:07.682 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:07.682+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:08.715 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:08.716+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:08.781 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:36:08.782+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:36:09.755 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:09.755+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:10.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:10.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:11.749 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:11.749+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:12.700 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:12.701+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:13.698 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:13.698+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:13.782 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:36:13.783+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:36:14.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:14.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:15.650 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:15.651+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:16.602 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:16.603+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:17.637 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:17.638+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:18.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:18.674+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:18.784 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:36:18.785+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:36:19.699 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:19.699+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:20.689 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:20.689+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:21.662 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:21.662+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:22.624 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:22.625+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:23.618 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:23.620+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:23.785 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:36:23.786+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:36:24.603 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:24.604+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:25.594 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:25.595+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:26.551 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:26.552+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:27.515 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:27.516+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:28.503 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:28.505+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:28.785 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:36:28.787+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:36:29.498 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:29.500+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:30.540 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:30.541+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:31.512 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:31.513+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:32.532 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:32.533+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:33.571 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:33.572+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:33.786 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:36:33.787+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:36:34.577 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:34.577+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:35.608 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:35.609+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:36.592 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:36.592+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:37.554 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:37.554+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:38.604 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:38.605+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:38.787 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:36:38.787+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:36:39.646 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:39.646+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:40.668 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:40.668+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:41.710 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:41.710+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:42.664 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:42.665+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:43.685 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:43.685+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:43.788 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:36:43.788+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:36:44.673 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:44.673+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:45.706 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:45.706+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:46.723 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:46.723+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:47.720 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:47.720+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:48.751 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:48.751+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:48.788 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:36:48.789+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:36:49.769 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:49.769+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:50.756 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:50.756+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:51.721 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:51.721+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:52.686 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:52.686+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:53.734 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:53.735+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:53.790 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:36:53.790+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:36:54.782 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:54.782+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:55.801 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:55.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:56.800 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:56.801+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:57.845 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:57.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:58.791 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:36:58.791+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:36:58.862 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:58.863+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:36:59.819 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:36:59.819+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:00.809 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:00.809+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:01.780 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:01.780+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:02.796 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:02.797+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:03.791 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:37:03.792+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:37:03.844 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:03.845+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:04.871 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:04.872+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:05.910 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:05.910+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:06.932 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:06.933+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:07.954 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:07.954+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:08.792 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:37:08.793+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:37:08.926 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:08.927+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:09.917 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:09.917+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:10.957 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:10.957+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:11.935 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:11.935+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:12.977 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:12.977+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:13.793 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba043.stderr:2021-11-21T15:37:13.793+0000 7fdfbbd72700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x555e418d1c80 finish: resending after timeout 2021-11-21T15:37:13.964 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:13.964+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:15.013 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:15.013+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:16.049 INFO:tasks.ceph.cluster2.osd.2.gibba043.stderr:2021-11-21T15:37:16.050+0000 7f6ba6a34700 -1 osd.2 138 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4818.0:139 3.b 3.34ea24cb (undecoded) ondisk+retry+read+known_if_redirected e128) 2021-11-21T15:37:16.819 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-11-21T15:37:16.820 DEBUG:teuthology.task.console_log:Killing console logger for gibba022 2021-11-21T15:37:16.821 DEBUG:teuthology.task.console_log:Killing console logger for gibba043 2021-11-21T15:37:16.822 DEBUG:teuthology.exit:Finished running handlers